Violent Femmes formed in 1981 as an acoustic punk band playing on the streets of Milwaukee. Their main influences at that time were Gene Vincent and the Blue Caps, and The Velvet Underground. Their goal was to rock harder than any other acoustic act on the planet. They were rejected