Until the Council of Jerusalem in 49 AD which affirmed that Jesus would return after the times of the Gentiles to restore Jerusalem and set up the kingdom from there in Acts 15:
"Simeon hath declared how God at the first did visit the Gentiles, to take out of them a people for his name. And to this agree the words of the prophets; as it is written, After this I will return, and will build again the tabernacle of David, which is fallen down; and I will build again the ruins thereof, and I will set it up: That the residue of men might seek after the Lord, and all the Gentiles, upon whom my name is called, saith the Lord, who doeth all these things."
Some things I guess were just hard to forget for those Jewish apostles, especially when filled with the Holy Spirit at Pentecost.
Actually, if you read the passage in Acts 15 very carefully you will see that what James is referring to is the then present calling of the gentiles, since it was the nature of that calling that was the present dispute before the council (whether gentiles needed to convert to Judaism after coming to faith in Christ). If was not the future, but the present that was James and Peters concern. As was their custom, the interpret the OT prophecy and apply it to Christ and the present, not the far distant future (the lone habitation of the dispensationalist).
Once again your futurist presuppositions cloud the plain reading of the text.