Sounds like you are not using the gears in the same manner the other members are......
I think people were saying that 2nd or 3rd were their favorite gears, because if you 'use' 2nd properly, it's good for any 'downtown' driving, and 3rd will cover the rest, right up to semi-legal speeds.
The secret is to get the revs up.
If you drive it like a Corolla, shifting at 2700rpms, then yes, you will be passed by VW TDIs, but try 35mph at 7000 revs, it's just delicious! :D