Yes, because it’s MY workplace. If YOU want to wear skunk perfume in YOUR workplace, and your co-workers are OK with that, then it’s all good.
Your workspace would also be my workspace. You make no sense. If I can’t ware my “Skunk” then you can’t ware your “Whatever”.