I have always carried a handheld GPS when I flew since they were made available.
It's awfully nice to have something that the aircraft and avionics designer don't know about!
Having said that, I hope they at least had a standby horizon!
I used to use one all the time flying F-14A's because our INS was so bad.