You don’t have to “serve” him. You have to obey the just laws, and you should honor the office.
The phrase he’s using is a reference to Joshua 24:15:
“But as for me and my house, we will serve the LORD.”
Obama all but required an oath of loyalty personal to him. Remember when he referred to the military as “his”? It’s the way liberals think.