Feelings of depression when having a day off work?

I was wondering if anyone else has this, whenever I have a day off work Ifeel empty/depressed or something. Just the feeling of not doing anything, and having nothing to do is so strange to me that I feel sad for some reason. I work in construction so I have pretty long days and I work 5-7 days a week.