The title of the song originates from what Jack White thought the Salvation Army was called when he was a child. White will often take a distinctive phrase he finds interesting and use it as the title of a song. The White Stripes had no bass player, so the popular riff is actually a guitar with an octave effect to sound like a bass.
The song was conceived while The White Stripes toured Australia and was originally recorded in 2002. But wouldn’t find placement on The White Stripes’ discography until their fourth album Elephant arrived with aplomb.