One possibility is the story that years back in the days when the well off had servants the master would swap places on the day after christmas in order to give them a taste of the good life and the process of swapping was referred to as boxing.
