I use dualism in the sense that they are the fundamental bases of the universe. Your example: matter and spirit (or whatever terms you've chosen).
I think temporality splits the world of spirit. The only duality I recognize(not necessarily antagonistic) is between the temporal (or extensive) and the eternal. Obviously the temporal is not also eternal.
I don't view the finite and the infinite as a basic division of nature, but merely a thought construct. The finite we can handle in our logic. The logic of the infinite seems to involve abstraction, that is, removing all content from the form.