One would think that the term "all men" should mean that Jesus meant to draw one hundred percent of all people to Himself. Now one who has faith in the One who healed the sick, raised the dead, and resurrected Himself from the grave should be able to say without reservation that Jesus did not mean in any literal sense that He intended to bring one hundred percent of all people to himself.
Jesus meant literally ment what he said
But why dost thou judge thy brother? or why dost thou set at nought thy brother? for we shall all stand before the judgment seat of Christ.
For it is written, As I live, saith the Lord, every knee shall bow to me, and every tongue shall confess to God.
So then every one of us shall give account of himself to God.
And being found in fashion as a man, he humbled himself, and became obedient unto death, even the death of the cross. Wherefore God also hath highly exalted him, and given him a name which is above every name: That at the name of Jesus every knee should bow, of things in heaven, and things in earth, and things under the earth; And that every tongue should confess that Jesus Christ is Lord, to the glory of God the Father
And before him shall be gathered all nations: and he shall separate them one from another, as a shepherd divideth his sheep from the goats: And he shall set the sheep on his right hand, but the goats on the left.
Sheep are predestined to be sheep, and goats are predestined to be goats. They don’t change their identities by exercising their own will.
On my reading of this scripture, I'd say Jesus did indeed signify His divine intent to bring one hundred percent of all men to Himself as He will surely do, on Judgment Day. No man can avoid this judgment. More, God Who created each and every individual human soul and loves each and every one sent His Son to redeem all of them. Only man's refusal to accept his redemption in Christ can separate him from the Body of Christ and his salvation in Christ.
So I think that Jesus, indeed, meant what He said, in the literal sense.
FWIW.