I don’t think your self-driving car will enter a ghetto. It’ll be on some no-go list that you note in the system as you purchase the car. It’ll be like driving south through Birmingham, Alabama....it’ll ask you if you want to refuel 40 miles before or 40 miles after....but it’ll tell you that getting off the interstate in Birmingham is not possible.
Technology this advanced could map out any trip with preferences and advisory. People might want to go to a dangerous neighborhood for any number of reasons. If an emergency suggested a dangerous neighborhood stop, the car could ask the rider for permission, warning about the trade-offs. Maybe a little hatch would open, a la James Bond, to give the passenger a gun.
More likely, you will be preferentially steered through these neighborhoods, because avoiding them would be “profiling”.
Then, if your car breaks down, there will a large flag and strobe light to proclaim your helplessness.
Think of it as a magnet.