We're like you; my husband and I did not care one way or the other.
During my pregnancies, people - usually strangers - would ask, "What are you hoping for...a boy or a girl?"
"It doesn't matter. I'll be happy with either," I'd reply.
Most folks accepted the answer with quiet nods of agreement, but occasionally people would press the issue. "No, really," they would insist, oftentimes with a tone that suggested mild disbelief or implying that I wasn't being truthful. "You don't have any preference?"
"Oh, I have a preference," I would insist. "Alive and healthy."
That usually shut them up.
A friend of mine used to respond to that question with “we’re hoping to one day have 3 children - one of each. So whatever is fine.” As they looked at her trying to figure out just exactly what she said, she’d just walk away.