Islam doesn't have a patent on the crescent.
And the swastika was a Hindu symbol for a thousand years before the Nazis appropriated it.
Still, a swastika themed memorial to the holocaust would be considered, by most, to be a poor selection of a symbol.