That's true. And in the long run it's not practical. Not to knock others who like it. Whatever works. But I like milk and cereal and fruit....they are healthy, wholesome food! I can't be convinced otherwise.
If they made you fat (despite intense exercise), and if cutting back on them caused you to lose weight, I guarantee that you'd be convinced otherwise.
But if you're not carb-sensitive, you don't have to worry about it.