Stepping back from the specific language, checks and balances were the clear intent of the Framers. That a single district court judge could unseat a president is ludicrous. The Constitution prescribes precisely one means of removing a president from office, and it’s impeachment.
If he was never eligble then he is not POTUS.