I think there's a theory that the ancient Egyptians gathered up meteorites because they believed them to be the frozen ejaculate of their god Osiris and therefore imbued with power.
Wish I could recall the source. It would provide an interesting interpretation of the kaaba in Mecca if true.