Jesus' sacrifice was only for His sheep, not for the others.
If you say He came for all then that means some resist Him, denying Uncondintional Election and also denying Irresistable Grace. You cannot deny one of the 5 points. It is all or nothing. If you reject these 5 points of Calvinism, you are rejecting the cornerstone of Christianity. There is no such thing as a 4 point Calvinist, there is only one who accepts all five or who rejects them all.
Nobody is claiming everybody is called by the Father, nor that everybody is elected, but He has paid the price for all. He is faithful, though fallen man may not be. It’s really a moot point if one simply places faith in Christ and let God handle the fight.