I've been there too and often walk by it when I am in the downtown area. I always think about the fact that the majority of people walking through there have no idea about the history that happened there (including a 1975 terrorist bombing) or even understand the significance of Washington disbanding his army - up to that point in history, it was expected that victorious generals crown themselves as king. Yes, Washington could have been crowned as King George I of the United States and nobody would have batted an eye.
The building however is not the original, it had been rebuilt many times mostly due to fires. At one time, it was to be torn down for a parking lot. Still, it's the same actual location and that is what makes it so historic.