Speaking for myself, I am far more likely to sell my shares and pay off the line of credit I used to buy them. I am very unlikely to sell my houses for the exact reasons you have outlined.
Also the investment housing loans are being met by my tenants. Sure, if interest rates went up dramatically and rents did not keep up I could find I have to tighten my belt but experience teaches me that the rents catch up to bridge the gap.
In any case, I am still forecasting interest rate drops by the end of this year.
