Hit me over the head with it... I am not sure I do get it!
If you're reading for the first time, you assume his "departure" is just his booking off for Gondor, about which he's constantly harped hitherto. But alas! it's the other definition.
Tricksy.
Dan