The claim that the White House can revoke press credentials at will because they are "a privilege, not a right" is fundamentally incompatible with modern constitutional law.
In American jurisprudence, the Unconstitutional Conditions Doctrine establishes that even when the government provides a discretionary benefit, license, or privilege that it was never obligated to offer, it cannot withhold, condition, or revoke that privilege to penalize someone's protected speech. Once the government creates an accreditation process and opens a limited public forum to journalists, the First Amendment strictly forbids revoking that access based on viewpoint or critical coverage, and the Fifth Amendment bars doing so without published standards and procedural due process.
This principle is supported by several bedrock cases. In Perry v. Sindermann (1972), the Supreme Court ruled that a non-tenured professor could not be denied contract renewal over public criticism of the board, establishing that even if a citizen has no inherent right to a valuable government benefit, the government cannot deny or revoke that benefit to penalize constitutionally protected speech.
In Speiser v. Randall (1958), the Court held that California could not deny a property tax exemption, an undisputable government privilege, to military veterans who refused to sign a loyalty oath disclaiming subversive speech. In Board of County Commissioners v. Umbehr (1996), the Court held that an independent contractor could not have his at-will municipal trash-hauling contract terminated in retaliation for his public criticism of county commissioners, confirming that discretionary government contracts carry First Amendment protections against political retaliation. In Elrod v. Burns (1976), the Court ruled that non-policymaking county employees could not be discharged based on their political party affiliation, proving that public employment cannot be conditioned on partisan loyalty even under traditional at-will hiring principles.
Finally, in Sherrill v. Knight (1977), the federal appeals court applied these exact principles to White House press passes, holding that while journalists have no automatic right to enter the building, once a dedicated press facility is established, access becomes a constitutionally protected First Amendment liberty interest that cannot be denied arbitrarily, based on viewpoint, or without Fifth Amendment due process.
The entire premise of the "privilege" argument assumes that if the government can choose not to hand something out, it holds unlimited power over how it takes it away. Under the Constitution, the power to grant or deny an entry pass does not include the power to violate the Bill of Rights.
A city does not have to build a public park, but once it does, it cannot ban protesters whose views it dislikes. A state does not have to issue vanity license plates, but it cannot revoke one because the driver criticized the governor. Saying a press pass is a privilege simply means the White House is not required to let every single citizen through the front gate. It does not mean the President can use access as a political weapon by admitting outlets that provide favorable coverage while stripping credentials from those that ask tough questions or publish critical reports.