So could I come to pray to God as they pray?Or would I be barred?
No way, Rn. Haven’t you heard of separation of church and state? (Applies to Christians only.)
Is there even a Chapel at the Pentagon?
I don't know, are you gainfully employed at the Pentagon? If so, then yes, you could use the interfaith chapel just like they do, and as I have dozens of times.