That could be why we haven’t seen time travelers. They are floating in space somewhere. Maybe even inside some other object that happened to occupy that same space.
Like a star or asteroid..........................