Bitter Pill Tasted Like Shit?

I've heard the expression "that's a bitter pill to swallow" but until I took the wrong one in the dark last night, I didn't quite get it. In fact, I still don't know exactly what is going to happen, because it was a suppository. I wonder if shit tastes bitter?