Exactly. And unless the engine and turbos are totally unmateched, use the gears! That's what they're for. As long as you have a spread of solid average power from shift points the car is going to be fast if you know how to change gears.
My car with -5s makes 300+awkw (dyno depending) from 5 - 7+k RPM. It's making very decent boost from 3k RPM (that's 3rd gear at 60km/h) and over 200awkw from 4k RPM. The car is very quick in 3rd from 80km/h to very illegal speeds. First and second are geared so low the torque multiplier takes hold and it just hauls. I just don't get how that's perceived as unresponsive... It's making far, far more than a stock one makes at peak from 4 - 8000RPM. That's a fair spread of power for now, with scope for a lot more when I do cams, cam gears, more fuel and freer flowing exhaust.
It comes down to priorities.