What do you mean "we should get to keep the lot"? There is no 'you' to keep anything after you die - your estate pays the tax.