Legally. But not morally. The descendants who come to the visit the site should have a say. After all some of the descendants of Lee don't want (and say Lee didn't want) the statues. Lee will remain in history. But when a dead prisoner of war has his plaque removed that's pretty much it, except the gravestone which doesn't explain anything.
Since when does morality have anything to do with politics.