You might think silver's worth much more - the rest of the entire planet doesn't.
Banks have been fined for doing all kinds of things, the notion that it's 'rigged' and 'unfair' is crap. It's because you've bet on a lousy investment, there's plenty of silver out there, and new technology can dig the stuff up faster than ever.
If the price is 'rigged', why on Earth are you buying it?