.40 S&W hands down. The .357 Sig, like all bottleneck handgun cartridges, is a solution in search of a problem. Much much complication alongside the .40 if you're a handloader, which I hope you are. Plus more muzzle blast too.
(BTW, you do have a .38 special and a .22, right?)
:)