“Where did Jesus take St. Peters position of authority away?”
Christ never gave him “a position of authority”.
... So it isn’t easy to take away what never existed.
“Christ never gave him a position of authority.”
Yes, he did. Right in Matthew. Matthew clearly states that Jesus, after Peter confessed that Jesus was the Messiah, that he was going to build his church upon Peter - and gave him the Keys to the Kingdom of heaven.
It’s all right there. Now you’re free to deny the Gospels and what they teach, but that doesn’t mean you get to deny the Gospels and at the same time claim sola scriptura. Either the Gospels are true or they are not.