You know the answer to that - it's okay to destroy a temple to build a mosque, but it's crime against humanity to destroy a mosque to build a temple. Simple muslim logic.
But, of course. In the Islamist world view, Islamic supremacy and hegemony is a fundamental human right.
Look it up in the Qu'ran.
There are a few examples of Islamic societies which are succeeding in living with the rest of the world. In every case, these are the societies which reject fundamentalist, literal interpretations of the Qu'ran (e.g., Turkey, Uzbekistan).