Ask him to refund you the difference, and if he doesn't then sue him. Off course that depends on how much money we are talking about. If its only a couple of hundred dollars, then it won't be worth your while, as it would cost more to recover the money. Get another broker!
