Too many examples re inforce your approach. More wealth has been created by average Aussies than any other way. That is without even trying. If values drop it still is home and the longer you are in the better as you well know.
Things that create risk are there but is generally one of the safest ways to accelerate wealth. Generally failed business, low doc loans, margin lending, divorce, unemployment etc create the risk. Risk is a part of life , need to manage it as best as possible however. Early stages worst and gets better as you are obviously aware.