I don't pay tax in Aus at all - cgt or income tax. every year I submit a tax return through my accountant - a "null return" to draw a line under the year. the information sits with the accountant and the ATO is happy.
The country of residency is really only concerned with income earned within the country - nothing outside the borders, just the job you are sent there to do.
And usually lower down the development scale, the less care there is with what expats do.
as for living in a dive..... in central asia i have a full time driver, housekeeper and gardner, have a really big house i don't pay for, get holiday flights paid for and overall it is better than living in Aust. Though i do love australia, it i hard to resit a call like this....
