Lee freed his slaves in 1862 because his father-in-law's will required it.
And while Grant may have freed a slave in 1959, there were still people of color calling him Master at wars end.
No there were not.
Robert E. Lee letter dated December 27, 1856: "...There are few, I believe, in this enlightened age, who will not acknowledge that slavery as an institution is a moral and political evil. It is idle to expatiate on its disadvantages. I think it is a greater evil to the white than to the colored race. While my feelings are strongly enlisted in behalf of the latter, my sympathies are more deeply engaged for the former. The blacks are immeasurably better off here than in Africa, morally, physically, and socially. The painful discipline they are undergoing is necessary for their further instruction as a race, and will prepare them, I hope, for better things. How long their servitude may be necessary is known and ordered by a merciful Providence. Their emancipation will sooner result from the mild and melting influences of Christianity than from the storm and tempest of fiery controversy. This influence, though slow, is sure. The doctrines and miracles of our Saviour have required nearly two thousand years to convert but a small portion of the human race, and even among Christian nations what gross errors still exist! While we see the course of the final abolition of human slavery is still onward, and give it the aid of our prayers, let us leave the progress as well as the results in the hands of Him who, chooses to work by slow influences, and with whom a thousand years are but as a single day. Although the abolitionist must know this, must know that he has neither the right not the power of operating, except by moral means; that to benefit the slave he must not excite angry feelings in the master..."In other words, black folks are better off in bondage than they were free in Africa, and regardless, slavery will be around until Providence decides, and who are we to second guess that? And the only reason the masters beat their slaves is because of the abolitionists.