Which referred to 82 disciples, not simply 12, while the Lord said that even though who were not of the formal ordained company of the 12 were on His side. (Mk. 9:38-41)
The authority was to Peter and his successors. This is Petrine authority. It was the Church that authenticated the canonical texts. If you doubt Petrine authority, then you must also for sure have doubts on whether the canonical books chose by the Church are indeed the true written word of God.
You can’t have it both ways. Dispute Petrine authority and also accept the selection of books made by the Church is the true written Word of God. This is why preeminent Protestant and Episcopalian theological have after a lifetime of intense study and instruction have converted to Catholicism.