No you're not, but if you refuse to distance yourself from what they said then it usually means you agree with them.