The Bible tells us that the Wise Men came to a house. Not a stable or a cave.
Interesting little detail to explain?
Well it took time for the wise men to make the trip to meet the Christ Child, so it could be possible that Joseph and Mary found a home or were taken in by family relations by that time, who knows in this life. Plus the infant Christ most likely was a bit older.