The biggest reason to knock off working on vacation or after hours is that it creates a false expectation on the the workload. If you can't get it done during regular office hours, than that means your company needs more people or a process improvement.
If you are working these extra untracked hours, you are the problem. If you get rewarded for doing so, your company is toxic and will only expect more as you move up the ladder.