I'm 5'2" and, as a young woman, preferred men just a little bit taller than I was. But, those shorter guys tended to prefer taller girls, and I was asked out by tall men (6' and over). Bottom line: Don't rule out someone based on height.
BTW, the kids tend to be a little bit taller than halfway between your two heights. Two of my sons are not happy about that, but, oh, well, guys, I have no control over my genes. lol
Your explanation fits my family.
One of our boys said he thought if hed get my husbands size and my speed that hed be a great linebacker. Then he sighed and said, But I got your size and dads speed.
Our girls are tall, only our middle son is close to his dads height. The youngest one is still young, but his baby sister is already his height.