Spain imports a lot of their population from South America (just like the US); I don’t think many North Africans speak Spanish anymore. The Moroccans crossing into Spain are probably on their way to France, where more of them would speak the language (and unemployment isn’t 22% yet).