Talking to a passenger does not require the use of a hand or for you to take your eyes off the road. Additionally the passenger can look where you are going and stop talking if the situation demands it.
Plus all the data I have seen seems to show that auto accidents having been dropping every year for a good while, even as cell phone usage has skyrocketed.
If cell phones are so dangerous, why is this happening?
Practice, practice, practice.