Of course...as long as he doesn't come back.
Vacation implies an annual event that takes a few, 1 or 2, weeks to be with your family.
By this definition we need to, first, decide which one of the quarterly vacations we are talking about. Then, we need to define the term family - not friends but people with direct blood relationships. I would stop it at grandparents.
Using my criteria, above, I would stop every “vacation’ that the Obamas have been on since they aren't vacations. Unfortunately, I don't have an accurate term to describe them. Most of the terms that come to my mind deal with graft and corruption.