That too. Of the eleven Apostles remaining, only John even showed up. We have the accounts of Jesus getting grief from his family. A few:
Then Jesus went home, and once again a crowd gathered, so that He and His disciples could not even eat. When His family heard about this, they went out to take custody of Him, saying, He is out of His mind. (Mark 3:20,21)
Protestant Reformers Martin Luther, John Calvin, and Ulrich Zwinglihonored the perpetual virginity of Mary and recognized it as the teaching of the Bible, as have other Protestant theologians. But todays evangelicals know more than did. They have ways of finding things in the Bible no one else could in the last 2,000 years.