Well, the ferry guy was concerned for him risking his life out there - those wakes from other watercraft can be very rough and come from unexpected directions.
People paddle in Maui in 20 knots of wind and 8 seas every day. Its really a stable ride once you get the hang of it!