That's exactly right.
Private individuals/property owners have a natural right to associate or disassociate with whomever they please for any reason whatsoever.
The idea of a business being a "public charge" is completely abstract concept created out of whole cloth by statists and 60s liberals.
Private property owners forcibly share an ownership interest with the collective.
I agree. When did the feds investigate “no shirt, no shoes, no service”? Never. And for good reason.