That's more or less our attitude.
Another complication is that we don't live in the same town, but rather about 3 3/4 hours apart (on limited access Texas highways at Texas speeds!) We'd like to retire to San Antonio, or nearby, but now have to factor in not moving the girls after they get into high school, and preferably middle school. (My wife's family moved when she, the oldest, was a junior in HS, and she feels it really messed up the younger siblings, including the girls grandmother, who has since turned herself around, but it's been a long journey, including so many husbands, I've lost track. She's now married to the girls' grandfather's brother. :) ).
We moved, because my wife got her position as una professora , just before our oldest (now mother of the delightful Miss Victoria) started high school. Even that was traumatic, but it worked out OK.