And at what point in history were Muslims forced to abandon Mecca so that such a switch could be a possibility?
They didn’t “abandon Mecca”.
They “adopted Mecca”.....
They were first praying to Petra, but the winning forces in the 2nd Ilsmiac civil war switched the direction to Mecca AFTEr the Kaaba was moved there.