Add to that what is your monthly loan repayment? There is a big difference between repayments on a $250K mortgage that has only 5 or 6 years left and a 30 year $450,000 mortgage that has only just been taken out.
I would suggest your young neighbours are probably making more money than you, paying less tax as it is spread across two sets of individual tax rates (I'm assuming you are effectively taking all the income out of your company as salary and therefore being taxed at personal rather than corporate rates) and if they have no kids there is a huge saving there.