I am pretty sure that his son, John Quincy Adams, didn’t attend Andrew Jackson’s inauguration. AndrewJohnson skipped Grant’s. Wilson was ill when he left office and I think did not attend ...
The last time a sitting president had not attended the swearing-in ceremony of the incoming president was in 1869 when AndrewJohnson refused to attend the inauguration of Ulysses S. Grant.