Skip to comments.Remembrances of VENONA
Posted on 05/06/2003 8:39:27 AM PDT by ckilmer
Remembrances of VENONA
National Cryptologic Museum
NSA Home Page
Note: The following are the remarks made by Mr. William P. Crowell, Deputy Director of NSA when the declassification of the VENONA project was announced at CIA Headquarters on 11 July 1995. Mr. Crowell retired from NSA on 12 September 1997.
In the early 1960's, shortly after joining NSA, I was one of a small but fortunate group of agency employees invited to a meeting with Frank Rowlett, one of the eminent NSA cryptologists who had been so successful during World War II. For over an hour Frank told us stories about the successful exploitation of codes and ciphers during the war. He spoke about how those successes had helped U.S. military leaders and the forces under their command win crucial battles and make strategic choices. But, he was very careful to avoid claiming that cryptography had won any battles. That distinction---between providing information that can make a difference---and using information to make a difference is still an important one and certainly applies to the results that were achieved in the successful breaking of the codes and ciphers known as VENONA.
Twelve years later I was assigned as a manager in an NSA division that included the VENONA project. In a very short time I came to appreciate that VENONA was an absolutely fascinating story of the personal determination and dedication of a small group of cryptanalysts. It was, in addition, a brilliantly intellectual cryptanalysis effort. Lastly, VENONA was a model of outstanding interagency cooperation.
I also realized it was a story of considerable historical moment and that someday, when the need and responsibility to protect the sources and methods involved was diminished, it would be made public. That time has now come and today we give the first of the over 2200 VENONA translations to historians to judge. But, as we make this release, I think it is most appropriate that we recognize the extraordinary people who did the work.
The story of the efforts to attack Soviet KGB and GRU traffic began in February 1943 when a young woman, Miss Gene Grabeel, was assigned to organize, characterize, and analyze thousands of encrypted Soviet diplomatic messages. Through nearly a decade following, a number of analysts, by dint of their dogged determination, slowly made headway against a family of extremely sophisticated, double-encrypted cryptographic systems. They painstakingly extracted information, a word or two at a time, from one of the most challenging systems that had ever been exploited.
The first and most significant breakthroughs against the VENONA cryptosystems were made without even the most rudimentary computers or other sophisticated tools which we are accustomed to using today.
While the Soviet traffic that was ultimately read under the VENONA project spanned the years 1942-46, efforts to exploit it continued for decades. This was due to the agonizingly slow and difficult process in which sometimes only one or two words at a time were wrenched grudgingly from the code. Each new recovery came with the elation akin to finding a pearl in an oyster. But each recovery also led to renewed work as each message had to be reviewed to see if that code group was present and, if it was, then the enlarged context was checked and scrutinized to see if it provided clues to other unrecovered code groups. Similarly, as counterintelligence information based on the decrypts was passed to the FBI and the FBI investigated the leads, new information was developed which sometimes enabled new breaks into the code. Then the process would begin all over again.
People continued to work on VENONA so long as the possibility remained that counterintelligence information might be developed that could possibly reveal new agents or espionage activities that might still be active. When it was no longer reasonable to expect that those named in 1942-45 might still be alive or active in an espionage role, then ongoing efforts to continue to break the VENONA cryptosystems was terminated.
From the early days of WWII, Arlington Hall assembled teams of gifted linguists and cryptographers of the highest intellectual caliber to work against the German and Japanese codes and subsequently on the VENONA project. These were linguists like the brilliant and dedicated bookbreaker, Meredith Gardner who came with outstanding credentials in six or seven languages and who made some of the first, really vital breakthroughs against the VENONA systems -- like 1st LT Ferdinand Coudert who came with a BA and an MA from Harvard in Slavic studies, a law degree from Columbia University, and a working knowledge of French, German, Russian, Serbo-Croatian, Bulgarian, and Japanese -- and like CAPT William B.S. Smith, a contemporary of Coudert's from Harvard who knew French and Breton and who had been an editor at the prestigious Columbia University Press. It included cryptographers like Genevieve Feinstein, Gene Grabeel, Cecil Phillips, and Dr. Richard Leibler, just to name a few. They and their colleagues brought a fearsome intellectual firepower to bear on various aspects of the VENONA puzzle with astounding, but hard won success.
As I mentioned, VENONA also was characterized by unprecedented interagency cooperation. First and foremost was the cooperation between the intelligence and law enforcement communities. This cooperation began with Wes Reynolds, the FBI liaison to Arlington Hall, and is typified by the close, cooperative efforts of Bob Lamphere who became the FBI's direct link to VENONA. There is no clearer example of synergism in the early days than these cooperative relationships. VENONA also included cooperation with HUMINT collectors and international intelligence partners in prosecuting counterintelligence leads.
A word about the VENONA cryptosystems---they should have been impossible to read. They consisted of a code book in which letters, words, and phrases were equated to numbers. So a code clerk would take a plain text message and encode the message using numbers from the codebook. This would have presented a significant challenge itself depending on how long the code book was used. However, the messages were further modified, in other words double-encrypted, by use of a one time pad. The use of a one time pad effectively randomizes the code and renders it unreadable. The key to the VENONA success was that mistakes were made in the construction and use of the one time pads---a fact that was discovered only through brute force and analysis of the message traffic.
Once sufficient breakthroughs had occurred, it became clear that the Soviet diplomatic traffic was encrypted in several similar systems and that it included KGB and GRU espionage traffic in addition to diplomatic and trade messages. Gradually a picture of a massive Soviet espionage effort began to emerge from the work of the VENONA team.
In deciding to declassify and release the VENONA translations, we gave the utmost consideration to the appropriate protection of individuals' privacy rights. It is not our desire or our responsibility to further interpret the VENONA translations---they will speak for themselves and the historians will help us understand and put them in context. But today, it is also our privilege to recognize the efforts and sacrifices of the VENONA team members publicly for the first time. Seldom do intelligence officers get the chance to talk about successes. The VENONA project is one of the best, and I am proud to have had a small part in telling the story.
Venona: Decoding Soviet Espionage in America http://www.amazon.com/exec/obidos/tg/detail/-/0300077718/ref=pd_sim_books_1/104-0884201-3667931?v=glance&s=books
The really interesting thing that venona shows is that there were a lot more russian communist spies than were actually arrested. In fact, McCarthy's numbers roughly correspond to the number spies that the Venona cables point to. So whether McCarthy knew about the Venona cables or not--he was essentially right.
It gave the lie to almost everything they had been saying for nearly fifty years, and , though it revealed only the tip of the Soviet/American Left iceberg, there was some devastating stuff !
The Left screamed : "Mis-translation ! Dis-information ! Right-wing propaganda !" to anyone who would listen; but the scarey part was this :
There was no widespread dissemination to the American public, and , at a guess, 99 out of 100 people are completely ignorant of the transcripts themselves - let alone what was revealed.
Link to the Senate COMMITTEE ON GOVERNMENTAL AFFAIRS / PERMANENT SUBCOMMITTEE ON INVESTIGATIONS page for information now being "disclosed".
WARNING -- These are big files!!!
From the New American .. The Real McCarthy Record
Then she is misinformed. Venona was inaugurated by the ASA (Army Security Agency) which evolved into the NSA, during World War II, before the CIA ever came into existence and the FBI had naught to do with it.