I would really like to dismiss this as mere semantics. After all how much difference is there between “Freedom of Religion” and “Freedom of Worship”? The problem of course is that if was not an ulterior there would be no point in changing a phrase that has had deep meaning to Americans for 223 years.
FYI Hitler allowed worship, but did not allow religion.