There is a difference between rules for the sake of rules, and rules to stop people doing things which are downright dangerous, and kill people.
People driving like idiots/racing/drifting on the street IS downright dangerous, and it DOES KILL PEOPLE. IF EVERYONE STARTED TO REALISE THIS, AND TOOK IT TO THE TRACK, MAYBE THERE WOULDNT HAVE TO BE SO MANY STUPID 'NANNY' ROAD RULES.
The OP asked about "Driving Fast" and "Racing" which are things that should definitely be kept to the track. It doesnt cost that much, is a hell of a lot safer and also a hell of a lot more fun.
If you want to cut a few circles in an industrial estate in the middle of the night, well thats slightly less on the dangerous side, but it's still highly illegal and we don't want to hear about it on the forums, and you certainly shouldn't be encouraging others to do the same.