No, I disagree with your definition of who "we" is and what it means to be in "unity" and with whom. We are not to have fellowship with the unfruitful works of darkness. The Lord said his mother and his brothers were those who did the will of God, not those who didn't, therefore glad-handing and hugging and backslapping others and calling them "Brother" is inappropriate if they are not true brethren. Unfortunately many people who say they are Christians have not continued but rather have fallen away, are an embarrassment to the Name of the Lord and have proven they despise ("do not esteem highly enough") Him and His Word because they live lives of hypocrisy instead of holiness. They are the unfruitful works of darkness, the dry branches which refused to abide and are lopped off, the tares gathered for the fire.
Rather than concentrating on the antiChrist lie of Ecumenicism/Unity which you have received, you would do better to identify who is true and false, even examine yourself and see if you are. That starts with hearing, doing and obeying.
Joh 10:27 My sheep hear my voice, and I know them, and they follow me.
There are a number of specific reasons people do not "hear" Him. We have written about them many times. Common reasons are that instead of understanding that the Lord will speak Himself to those who come up the right way, that person prefers the voices of false prophets and teachers, the Nicolaitans, and those preaching another Jesus, another spirit, or another gospel. Doctrines of demons will cause the recipient to be totally blind and deaf to understanding the things of God because the Lord will not fellowship with one trying to serve two masters, Himself and Belial. Pre-Trib, OSAS, Ecumenicism, Replacement Theology and Anti-Semitism are probably the ones that head the list. More here: Jezebel.
The true gospel is so simple a little child could understand it. That child doesn't need a library of books from the Christian Booksellers Convention. He just needs a Bible and an open heart.