They do but imagine the odds against their preservation over such time and through so many plate shifts and restructuring. A whole lot of recycling going on.
I believe the two oldest cratons are in Australia and South Africa.
A related fact is that half of all the gold ever mined comes from a very large meteorite that impacted what is now South Africa some two billion years ago.