Using the word “buck” is probably racist, a cruel term applied to black males in the days of slavery.
I agree many will take it that way. Can’t hurt their feelings.
Side note: I believe in the late 1700s, a dollar was called a buck because that was the amount a trader or hunter would get for selling a deer in town.