The origin of the term "Tory", meaning a member of the Conservative Party in the UK, is the Irish word tóraidhe, or outlaw. Being an Irish term, it also implied, in 17th Century England, that a Tory was a crypto Roman Catholic. The "Whig" of both the UK and American Whig parties came from "whiggamore" or cattle driver. Both parties eventually adopted for themselves a label that had begun as a term of abuse.
I'm less ruffled by tea bag than some (sticks and stones) but the examples you cite are quite different from an explicit pornographic reference.