Ephesians 2:19-20 says that the “household of God” is “built on the foundation of the apostles and prophets, Christ Jesus Himself being the corner stone” ... so it would seem that there is indeed a sense in which the Church is built on the Apostles.
Key words: "household of God". It's in the possesive. It's His household....not Peter's.
What is the foundation laid by the apostles? The Gospel.
The focus should be on Christ....not man.