The memos were about conversations he had with his boss, the President. Therefore, they were work product. The Director of the FBI does not get to have private conversations with his boss.
Then you missed the rules memo. LOL! Apparently comey can rewrite the rules as long as it helps make Trump look bad. ;-)
He also screwed over President Trump again by violating Executive Privilege. The President gets to decide, not Comey.