That is a beautiful area and I’m ashamed to admit I’ve never taken the time to visit it on foot.
The Navy Memorial is on the north side of PA Ave. about have way between the White House and the Capitol.
http://www.navymemorial.org/about.php