I was raised on potatoes. It seems unnatural to not eat them.
Potato is one of the best foods. If you eat less and replace it with something else, your nutrition will almost always be worse.