This particular agent is trying to play the fear game 'property has peaked' to a well informed investor and its backfired on him. He is trying to mentally prepare you to take a lower offer down the track for a quick sale.
Agents should only be there to show the property and submit the offers, not forecast where prices are heading in the future. I personally wouldn't use this agent in question.
