When you read the context of the verse you can understand that the false teachers once acknowledged Jesus and then turned back to the "defilements" of the world. Thus, though once they knew Christ and his sacrifice, later they rejected Christ's sacrifice. The question is, once they knew Christ's sacrifice and the sacrifice was sufficient, now that they deny the sacrifice is it still sufficient for them?
Good question. I think this verse argues against the "perserverence of the saints" prong of Calvinism. I think we must note here that while dogs return to their vomit, sheep are led back to the pasture.
The question is not really whether the sacrifice is sufficient for even these, but whether or not it is effective for them. If you reject the sacrifice, then the sacrifice will not do you any good. If someone offers you a million bucks it isn't going to do you any good unless you reach out and take it.