Interesting idea. I used to be Catholic and am Lutheran. I now understand the priesthood of all believers and the fact that all of us Christians are saints — ones set aside for God’s use. I don’t see the pastor of a church as bad, just don’t think of him the way I was supposed to revere the priests I used to work with who were in that church’s hierarchy.
Once baptized a Catholic, aren’t you always a Catholic? You may be an inactive Catholic, but you are still baptized (and maybe confirmed) in the Catholic Church. Those marks stay on your soul.
Perhaps you should reread the first chapter of the Acts of the Apostles.