Video from March of an IRS official testifying that the e-mails are archived.
https://www.youtube.com/watch?v=Ax6QGmKhRwo
Amazing arrogance by the IRS guy.
But you are correct, they are all on archival drives, not on an individual computer.