This has nothing to do with your home being on Streetview.
Yes it does because that serves as evidence they were at your house.