Washington was ringed by over 60 forts, and at the time of Gettysburg had a garrison of close to 25,000 men. Lee's army after Gettysburg wasn't a whole lot larger and he had all those wounded to deal with and little ammunition left.
Where do you get 25,000?