You're thinking about it the wrong way. Selling yourself short just to get public housing is short sighted. Free housing is one thing, but you still need income to live. Unless you are willing to spend the rest of your life on the poverty line, you will need a strategy for the future. In round figures, retirees seeking a 'moderate' lifestyle need approximately $59,000 pa per couple to live on. Assuming you retire at 65 and live to 80, you will need a lump sum of around $300,000 if you assume that earnings are at 4%pa. (i.e. low risk) and you and your spouse receive the full age pension. That also assumes you are debt free.
Ultimately, you might think he lives in a better dwelling, bu you also have to look at overall living standard.