I read somewhere that a delta wing gives a very bumpy ride at low altitude. Not sure that's the reason. The Israelis did very well with Delta-wing Mirages & Kfirs. The F-106 was reportedly a good dogfighter when put up against the F-4 Phantom II.
General Dynamics developed a "cranked-delta" design with their F-16XL, but it got beat out for the strike bomber role by the F-15E Mudhen.
I really liked the looks of that F-20 Tiger Shark, back in the day. Alas, it didn't have the range or payload wanted, compared to the 16.
This most modern Mirage looks like it has some of that F-5/T-38 in there behind the cockpit, along with some F-105 from the nose back.
F-105 would still be feared to this day, under certain circumstances. Down low, coming at you full AB, with some nukes.