It all depends on the application requirements. The corrosion problem you rightly warn about is only a problem if the product being repaired will last longer than the negative effects of using a penny for a washer instead of a washer.
For example, in the case of a repair to a General Motors car, the penny will certainly outlast the car.
Chevy Vega