Suggest you go look up US State Department Travel Advisory for Pakistan in 1981, No. 81-33A
Thank you, there was no ban.
The Legend in His Own Mind probably used a US passport. He could have used a Kenyan one has he still had Kenyan citizenship (until his 21st birthday), but I doubt he did. It would not have made any sense since a US passport was easier to get.