I hated that the first time I heard it.
I think, "A little late, aren't you? What did you do during the war?"
It's as if the person saying it has put himself in a class that has no obligation other than to say "Thank you for your service."