A law that specifically forbids the freedom not to associate is not in support of freedom of association. The claim that it would be gone by now if it were unconstitutional is laughable, given how much of the federal government activities fall into that category and remain unmolested by judicial decree.
We would not have needed the Civil Rights Act if we hadn’t denied people their civil rights. We brought that on ourselves.