Better an inexpensive gun than no gun at all. Normally I'd recommend a pre-owned gun, but if one isn't all the familiar with firearms, you can waste money that way as well.
Other, slightly less expensive choices are EAA Witness, in steel, or polymer and steel, Taurus (both revolvers and semi-autos).
But for the most bang for the buck, a 12 gauge shotgun can't be beat. I have a Maverick (by Mossberg) but that was purchased at time of monetary distress, if I had it to do again, I'd get the Mossberg, but the only major difference is the action bars and the safety. (Mossberg has thumb safety, Maverick a cross bolt type, both work fine, Brownings also use the thumb type, Remington and others the cross bolt)
A Maverick can be had for less than $200, new. The Mossberg for more like $260.
The nice thing about the shotguns is that with a second barrel you can have a multipurpose gun, for hunting, trap, skeet, sporting clays, etc.
Mossberg 500 Special Purpose, 18.5" 6 Shot
Maverick 88 6-Shot Security
As you can see, very similar, and the prices I gave might be a little high.
In the case of the HiPoint, a cheap gun is worse than no gun - because it has a very high chance of not going "bang" when you need it to, as many people have found.
I'd mention the Hungarian and Argentinian copies of the Browning High Power as being good candidates - and they can be had at roughly the same prices as the HiPoints. Other options include Makarovs from the former Soviet Union and Eastern Block.
Names to avoid in pistols: Jennings, Bryco, HiPoint, Norinco.