You outlined the exact reasons why I would not go to Canada. It has a lot to offer but I would never go there for the reason you noted, i.e., cannot protect myself with a firearm of my choice.
There are some states (New Jersey, New York, all of New England come immediately to mind) I wouldn’t go to either, for the same reason.
The states north and east of Pennsylvania, West Virginia and Virginia are at the bottom of my list of places to visit in my RV.
Some good people, great sights, but...