This warmer period started to end when the first continent-sized ice sheets began appearing on Antarctica around 34 million years ago
34 million years ago there was little difference in Antarctica's location.
Since we know that the axis of rotation of the earth has moved over the eras, but shows no movement in those charts, it seems likely that the charts were drawn in such a way as to keep the current orientation. This does not mean that the south pole has always been in Antactica, or its proto-continental ancestors.