yes you usually become a tax resident of the country you are living in though most places in the world are way less arduous than Australia for tax and the cost of living is usually significantly cheaper.
A lot of south east asian and central asian nations for example do "deals" with organisations that exempts foreign workers from tax in that nation.
Earning western wages and living somewhere that costs a married couple 300 bucks a month to live means you save almost two complete wages. even with 15 income tax you are so far ahead in this circumstance.