If a teacher has too much free time on their hands it brings into question their own dedication and comitment. It can then be countered that they are not rewrded sufficiently so why put in the extra yards.
Pay them well and then perhaps the competition for good teachers will ensure a better standard in the class room as well as the extra curricular activities.
Work to the highest common denominator not the lowest.
