Sorry Scotty it is safe because of the time factor - in 30 years the house is likely to be there and fully paid off from its own rent. You can't say that about most speccy stocks - they will either have long gone or if you bought and held you would likely be on a financial gold mine (but those would be few and far between). Both investments are different beasts though as you wouldn't generally hold any stock that long continuously.
Investing blindly in anything is just plain dumb, but thinking about your investment strategy and using time is smart - you may not make a killing but it is a great way and a proven way to build wealth using inflation alone.