I assume the similarities in the appearance is the reason they don’t allow a mute swan hunt. The much rarer native trumpeter swan is nearly identical. Mute swans have an orange bill and trumpeter swans have a black bill.
When we were fighting for a crow season the antis said we would mistake eagles for crows.
The argument that you might mistake them for something else is just another anti hunting blue herring.