It would be my choice to use #4 Buck for home defense. Slugs or 00 would easily go through walls and possibly hit the neighbors, your children, pets, etc. The same goes for high powered rifles.
At close range, even 7 1/2 trap loads would be a great home defense round and extremely lethal at such close range.
I wouldn’t trust anything smaller than #5 shot. My duplex loads are military issue.