No, you don’t have to do that (avoid visiting) - just don’t “work” there - and certainly sell anything you own there.
We just sold commercial property in CA and did a 2031 tax-free exchange for “like kind” properties in NV & AZ. So unless we sell either of the new properties and not do another 1031, CA will never see a dime! Furthermore, since the properties are in a Living Trust with our children as joint beneficiaries, unless the laws change in the future, they will inherit without any taxes.