Actually, you have things backwards.
It was the Pilgrims who wore black and white.
The Puritans dressed in colorful clothes and were criticized by the Pilgrims for doing so.
The Pilgrims were more "puritanical" than those "awful" Puritans.
I bet you did not know that one man was excommunicated from his Boston congregation because he refused to have sex with his wife... (It is a myth that the Puritans did not like sex...they enjoyed it as much as any modern person, but only within marriage. However, it was believed that sex within marriage should be for pleasure, not just procreation).
Oh yeah, those Puritans were real dour people.