I think it's more about a bit of confusion by onlookers where they think bigger must mean more dangerous.
Where in fact there are far more knockouts in the lighter devisions due to the speed of the punches.
I personally get bored watching heavy weight bouts.
