As a married man with children I would never join a church where the pastor is determined never to marry.
I most likely we not join a church where the pastor was not yet married.
If my wife and I want counseling regarding any issue concerning our home, we want it from a pastor who has family; the experience of family.
Is the pastor the only person who can council people? In a very large church, there are often counseling ministries designated for that purpose.