He said he went to work even though he was staycation