A photon lives "forever" unbound does it not? What happens to it when bound?
Einstein created photons as a handy entity in a few of his theoretical models. That is still where photons exist: in the physical models.