Agriculture would have started just as soon as someone ran out of something like watermelon that they wanted more of.
Besides, how long would it have taken for population pressures to mount? Assuming the population doubles every 100 years, in 2000 years (50 generations) you have 2 million people. In 4000 years (100 generations) you have 2 trillion.
Historical Estimates of World Population
Google is our friend.