Yeah, but different Celts from the Gaelic speakers. They spoke Brittonic languages, as opposed to Goidelic like Gaelic. They were Picts, British, Welsh. As for Scots living in Ireland before coming to Scotland, look at Dal Riada.
I only see speculation concerning the origins of Dal Riada, and it certainly isn’t established it was Irish settlers moving to Scotland.