“The only was to be a former Navy veteran is to die.”
Or, I suppose, to return to active duty.
I’d say the moment you are honorably discharged, you are a veteran and retain the status even if you rejoin later.