I don't think Fort McHenry is anything more than a tourist attraction anymore, so that's a historically accurate and legally vetted option for you. ;-)
Actually Brown and the others were all released by November, 1862. And most of them weren't held in Ft. McHenry. They were held in Ft. Warren in Boston.