Definitely not Tyler.
Took some searching. Benjamin Henry Latrobe—maybe http://architecture.about.com/od/housetours/ss/whitehouse_2.htm