Asimov addressed that in The End of Eternity, where time travel required a field of some sort to be set up, and therefore time travel could not go before the date this field was first set up.
“Asimov addressed that in The End of Eternity,....”
Isaac probably had lot’s of visitors in his fictional stories/dreams. :)