You have never read a shred of Church history have you? Also please explain the replacement of Judas. Are you saying that the other apostles did not ordain Matthias by the charism given to them by Christ Himself? Explain the offic of Deacon? Did the Apostles overstep their bounds?
This charisma you speak of is mental not spiritual..
God(Holy Spirit) bestows gifts men do not..
But men do elect officers to their Clubs(denominations,sects)..