You Can't Keep a Good Band Down received critical acclaim upon its release. AllMusic reviewer Kurt Morris, who awarded the album 4.5 out of 5 stars, credited the band for "creatively displaying a mix of infectious grooves, '50s influence, anti-establishment energy, and much more," stating that the band's harmonies and melodies are "remarkable for a punk act." Lyrically, Morris compliments the band for "[expressing] their anarchist views […] in a way that is honest and open," as well as for including "silly stories" in songs such as "The Exorcist," "Me and the Boys," and "Randy, I Don't Need You." Morris concludes his review by stating, "Randy seems to have made a very successful album that will most likely be overlooked by many, but it's their loss, as all the pieces truly are in place." Morris distinguishes "Holy Shit," "The Exorcist," and "They Fear Us" as standout tracks.[1]
In a retrospective review for PunkNews published four years after the album's release, Dubar also awards the album with 4.5 out of 5 stars. He points out the band's drastic "reinvention" compared to their previous style, which was more in line with skate punk outfits like Satanic Surfers. On the contrary, Dubar points out that You Can't Keep a Good Band Down is "noticeably less aggressive, much more catchy, and that's not a bad thing at all." He positively likens the band's reinvention to Bad Religion, "but with less big words, and they seem to be having a LOT more fun." He compliments Randy's "straightforward" lyrical style and avoidance of metaphors and poetry in favor of "tackling realistic ideas and offering real-world solutions." Dubar distinguishes "The Exorcist," "Superstar," "Randy, I Don't Need You," "They Fear Us," and "Working Class Radio" as stand-out tracks.[2]