As I understand it: more sunspots = less high level clouds = lower albedo for the Earth, and vice-versa.
Yes, you are correct. Some think less sunspots=more cosmic rays reaching atmosphere and forming more clouds, and thus keeping earth cooler.