All will not be saved but all men have the opportunity to be saved. Do you believe God created certain people for salvation and purposely excluded others? I have read the NT quite extensively and the only way the concept of the 'elect' is supported is when certain Scriptures are considered in isolation of others. Context is taking all Scriptures in entirety, including this one. Context works against you in this case.
That passage also directly contradicts the notion that all born again or so called 'elect' Christians are automatically "saved".
Here's another one for you:
1 Timothy 4:10 For to this end we toil and strive, because we have our hope set on the living God, who is the Savior of all men, especially of those who believe.