"the 'pub test' - I've seen for decades - is more often than not based on false beliefs, old wives' tales, ignorance and speculation"
Possibly change the pub you go to? Especially if you've been going there for decades. Most places is Australia with a mixed clientele have a very good grasp of what's acceptable to all and what pushes the boundaries.
The political parties are very aware of how far they can go and stay within limits.
Australia has massive net immigration for a reason, it's a very nice place to live.