When a Navy Chaplain is assigned to a Marine unit, he is referred to as a “Marine Chaplain.”
Informally, perhaps but not exclusively. Officially he's a Navy Chaplain and should be referred to as such so as to avoid confusing those who don't know any better.