They would probably only lose the votes of the few squirrely enough to actually have gold bullion in their possession. Not that many.
In fact, in such circumstances, those holding the gold are likely to be seen as evil speculators profiteering on the misery of others; that must be punished.
"No fair. No fair. What about me? The government must save me"
We are a socialist country, don't forget, and that mentality of entitlement is now deeply ingrained.