Indeed He did.
But by Moses' time, He was ready wipe them out again!
I have seen these people, the LORD said to Moses, and they are a stiff-necked people. Now leave me alone so that my anger may burn against them and that I may destroy them. Then I will make you into a great nation.
Exodus 32:9-10, NIV
Not because of the fallen angels this time though.