This would probably explain why food deprivation and other environmental factors can affect children and grandchildren. If I remember correctly, some such affects seem to be stronger in the male line.
I remember reading an article about the study of children born in Holland during the Nazi occupation. There was a deliberate famine inflicted on the population, and infants who were affected during gestation were studied later to assess the impacts.
There were identifiable effects, depending on the time of conception vis a vis the food deprivation of the mother, that carried on to the progeny of those children gestated during the famine.
So the grandchildren of starving mothers were affected, as you have stated.
I read this in Discovery magazine years ago.