Presidential vacations have often been contentious and a source of criticism for presidents throughout history.
Martha's Vineyard is one choice taken for location for vacation, since the time of Ulysses S. Grant, during 1874. Presidents who have taken a vacation there include President Kennedy, President Adams, President Clinton, and President Obama.
John Adams was criticized for spending time caring for his ailing wife.
The longest vacation by any United States president was James Madison. Madison was at the end of his presidency, when he took a four-month vacation from sometime during June 1816 until sometime during October 1816.
James Garfield was shot while leaving Washington for his vacation.
Theodore Roosevelt was criticized for leaving Washington for months at a time.
Franklin Roosevelt was criticized for spending time on his yacht.
George W. Bush was often criticized by Democrats for taking long vacations to his ranch in Crawford, Texas, during the Iraq war, the previous President often chose to take a vacation on his ranch.
Barack Obama's vacations have been scrutinized by the media. During the 2009-2010 recession he was criticized for vacationing at Martha's Vineyard. President Obama returned from vacation on Hawaii, sometime during January the 2nd 2017.
Sources: