That doesn’t make sense.
The pass was issued by The White House, just like the microphone was.
While I agree with you that it doesn’t make sense, that is one of CNN’s legal arguments, as I understand it.
Their suit is on First and Fifth Amendment grounds. Part of the Fifth is a requirement for due process in before deprivation of property by the government.