He punishes the wicked, because he hates their wickedness.
Psalm 11:5, "The Lord tests the righteous and the wicked, and the one who loves violence His soul hates."
Lev. 20:23, "Moreover, you shall not follow the customs of the nation which I shall drive out before you, for they did all these things, and therefore I have abhorred them."
Prov. 6:16-19, "There are six things which the Lord hates, yes, seven which are an abomination to Him: 17 Haughty eyes, a lying tongue, and hands that shed innocent blood, 18 A heart that devises wicked plans, feet that run rapidly to evil, 19 A false witness who utters lies, and one who spreads strife among brothers."
Hosea 9:15, "All their evil is at Gilgal; indeed, I came to hate them there! Because of the wickedness of their deeds I will drive them out of My house! I will love them no more; All their princes are rebels."