If you really do not want the car and you want him to return your deposit , tell him you are going to contact NCAT (Goggle it), that will do it.
I just had him there and I am sure NO dealer wants NCAT involved.
Consumers Affair have NO REAL muscle but can get a result at times but only if the seller wants to settle to save their good name, NCAT has the power to make a decision and once they rule and the dealer does not comply they can have their license suspended.
I think most dealers talk crap, some more than others=EL