That might be a sign that your typical workweek is too stressful. For most jobs I've had, it took zero or one day to wind me down. My most stressful job (as a middle school teacher) took me two days to wind down.