Some people are perfectly happy to believe ANY accusation, however absurd, if it is leveled against a person who is part of a disfavored group. The disfavor could be racial, religious, political, cultural, etc.
If you’re willing to give everybody a fair shake, good for you. Others should follow your example.
The more shocking and absurd the accusation is the better. Rape used to be the most falsely accused crime out there but now false hate crime accusations are gaining fast.