If the priest turns in his license to perform marriages, will his church remain tax-exempt?
Yes, because there are other sacraments churches perform, not just marriages. Marriages would be blessed, and they will obviously only bless marriages that are in line with Church Doctrine.