best little fishing village in australia?

A challenge, as we have such a wide demographic here.

I'm looking for the type of little fishing village you might expect to find in the Mediterranean (or even the Cornish coast of UK).
Fishing boats, old fishermen fixing their nets.
Nice little harbour, great ambience, not too many tourists!
Small population, pleasant climate preferential, though of course our coastline means beggars can't be choosers.
I want it to be "Far From the MAdding Crowd", though maddening may be more understandable!
Doesn't have to be the mainland, can be Tassie, as that's one of the places I could possibly find the winner.

Look forward to your ideas, and thanks in advance.