Yes, Jesus died for the sins of all criminals but unless they repent and accept Him as Lord, they are still in their sins. Besides, this refers only to the spiritual side. Accepting Christ does not exempt you from the physical consequences of your sin.
Whoever sheds mans blood,
By man his blood shall be shed;
For in the image of God
He made man.
(Gen. 9:6)
As far as the state is concerned, that crime has already been paid for. So punishment for the same crime is unjust because it is double jeopardy.
As far as that person receiving Jesus, that is really between him and the Lord, not the state.