As the saying goes:

Heretics are worse that Heathens

My high school girlfriend's parents were catholic and they used to say: The only thing worse than a heretic is a protestant all the time. They meant it in jest, but the joke was that plenty of others didn't say it and did mean it.