why not convert the whole thing to an allocated pension benefit being no tax on earnings. Minimum must be taken (again no tax) but no maximum so you could access the $500 when you need it.
You can then do the same to access an annuity when rates go up.
my thoughts only - you should go and have a chat to a financial planner.
