It doesn't have to be free from influence to negate free will, that is the failure of compatibilism to include the means of production into account for their own definition of free will, which in turn is not the same as the Libertarian idea of free will or the common perception of it.
