He doesn't need to refuse or give a false answer. As it's unrelated to Rugby he could've said that he has an opinion on that but he wishes to keep it to himself. Instead he came out with a controversial comment ( that he has a right to, along the same lines as Deveny has a right to her opinions. )
When asked about it again on a later date he doubled down on his view.
Really the pair of them should just keep their views to themselves and save all this discussion.