Maryland wasn't neutral, it was occupied. As for accent, it used to depend on where you were from in the state. Southern Maryland, Eastern Shore, and Western Maryland all were fairly distinct from one another. Television and mobile society have pretty much homogenized that now, and accents fall more along ethnic and national origin lines than regional within the state.
IIRC, the Maryland legislature wasn’t given a chance to vote on secession. That makes them officially neutral.
I’ll readily admit to being corrected.
My daddy’s people in Kentucky were very confused.
And the county heads in my home county voted against secession because war would interfere with our traditional industry: smuggling. And that’s true to this day.