I don't think so. Depends on if you use your backyard or if you have a door that opens right to it.
In the house I grew up in, the back door opened into the driveway on the side. The backyard wasn't all that accessible and didn't have a good view to it anyways. And nobody stops to regularly check their backyard to make sure nobody is frozen to death in it. Especially if nobody has any cause to be using it.
It also depends upon whether they were in view, or covered with snow.