You wouldn't be on Japanese land because you wouldn't exist in the first place. Secondly, Japan went to war to protect their oil supply from the US navy so they could continue their war in China mainland. Australia was useless to their war objective other than the fact it hosted US warships in Darwin which threatened their Southern assets.
