A banda foi formada logo após Brian Viglione testemunhar uma apresentação de Amanda Palmer em uma festa de Halloween. Suas apresentações dramáticas, no qual os membros maquilavam-se e vestiam vestimentas de cabaré, logo ganhou fãs.
A banda apresentou-se em 2002 no Prêmio IgNobel em Cambridge, Massachusetts. Após uma demo produzida pelos próprios integrantes, seu primeiro lançamento oficial foi um álbum contendo em sua maioria compilações de apresentações, A is for Accident.
Quatro anos de trabalho duro!Neste mês de maio fizemos quatro anos no ar. Continuamos trabalhando na divulgação deste maravilhoso instrumento, obrigado por participar da nossa história!
Am half underwater FCG i'm half my mother's daughter AmFCB7Am a fraction's left up to dispute AhAh AhAh AhAh
Am the whole collection FCG half off the price they're asking AmFCB7Am in the halfway house of ill repute AhAh AhAh AhAh
AmFCB7Am Ahahahah Ahahahah ahahahah ahah ahah
Am half accidental FC half pain full instrumental AmFCB7Am i have a lot to think about AhAh AhAh AhAh
Am you think they're joking FC you have to go provoke him AmFCB7Am i guess it's high time you found out AhAh AhAh AhAh
FCGFAm it's half biology and half corrective surgery gone wrong FCG you'll notice something funny if you hang around here for too FAmG FAm long ago in some black hole before they had these pills to take it back E i'm half jill
Am two halves are equal FC a cross between two evils AmFCB7Am it's not an enviable lot AhAh AhAh AhAh
Am but if you listen FC you'll learn to hear the difference AmFCB7Am between the halfs and the half nots AhAh AhAh AhAh
G and when i let him in i feel my stitches getting sicker
i try to wash him out but like she said the blood is thicker FAm i see my mother in my face EEsus4E but only when i travel FAm i run as fast as i can run but EC jack comes tumbling after
FCGF Am and when i'm brave enough and find a clever way to kick him out AmFCG and i'm so high not even you and all your love could bring me down FAmGF Am on 3rd he never found the magic words to change this fact E i'm half jill
Am i'm halfway home now FC half hoping for a showdown AmFC B7Am cause i'm not big enough to house this crowd AhAh AhAh AhAh F it might destroy me CAm but i'd sacrifice my body AmFCB7Am if it meant i'd get the jack part OUT AhAh AhAh AhAh