It's not well know, but this has actually been done before although the reason for doing it then stunk aout as much as Judge Greer does today.
During the Civil War the D.C. Circuit Court of Appeals remained active hearing civilian cases in the capital. It was made up of hard line strict constructionist judges who had been appointed by presidents going back to James Madison. In 1861 a military general in the Union Army named Andrew Porter disagreed with a very minor ruling the court issued pertaining to a soldier under his command and challenged their authority on the grounds that he exercised martial law in the District of Columbia (this was much disputed at the time and was not settled in favor of the civilian courts until 1866). In the ensuing weeks General Porter used his soldiers to harass the judges on the court including putting one of them under house arrest. The other judges, led by the one appointed by Madison, issued a contempt of court citation against Porter in response but found themselves unable to enforce it since he obviously had superior force at his disposal. Anyway, Porter's cause, even though he was clearly in the wrong, got taken up by the Radical Republicans who controlled congress in the day. In 1863 they pushed through a bill that abolished the D.C. Circuit Court and reconstituted it as the "Supreme Court for the Distict of Columbia." The result: all the judges on the D.C. Circuit Court were thrown out of office and five new slots were open for presidential appointments.
Again, the reason for doing this in the 1863 case is far from reputable or advisable as General Porter was clearly acting in violation of the constitution as was later found by the Supreme Court in another similar case. But it shows that Congress can and has exercised its power to clear the federal court benches before and could theoretically do so again.