"I am not talking about people with major disabilities, like spinal paralysis, but minor ones like a dodgy back"
I am assuming you have not had nerve pain associated with a "dodgy back". I've got degenerative disc disease and had a serious disc issue a few years ago requiring opiates for a few months. It was extremely debillitating and painful and no way could I have worked. Was unemployed at the time anyway. MRI scan shows damage to the disc but some people can be symptom free (as I currently mostly am) or in agony. The challenge is that if someone turns up at the doctors with pain, real or claimed, there is no objective test of pain so hard to tell if someone is faking or not.
Ate there bludgers? Of course, but weeding them out is not so easy.