Get him the real thing! Since he's only a toddler I recommend the Ruger Single Six in 22LR.
I actually considered my old .22 (my first gun!) as a possibility...unloaded, with the firing pin removed. But then I figured that some of my neighbors are such screaming PC drama queens that it might not be worth the hassle.