Maybe the person wasn’t talking about dress, but was talking about behavior.
Considering he specifically mentioned my clothing, doubtful.