Funny; I remember brick rooms painted white, and attached to the lower level of the main house, near the kitchens and with doors on the side of the vast gardens.
No....these were over by the gardens....west of the house. They were tiny huts. I was there in 1988.