It could be that the Nearmap 3d product isn't great.
Aerometrex: We provide regular three dimensional DTM datasets by classifying and filtering vegetation, man-made and other above ground features. A true representation of the bare earth surface is depicted once non-ground points are removed from the dataset.
Nearmap does not provide filtered bare earth DTM data. At least not yet.