Not everything swept up in the asteroid belt is an asteroid. Some will be captured comets.
And some won't be captured comets.