Passengers have that feeling more than drivers. The passenger is not in control, and more than likely is not paying enough attention to other vehicles that are moving with the traffic. You are seeing the background of trees and buildings while the driver is paying full attention to the road and its traffic.

So it is not surprising that you can adjust your speed feeling by looking at other cars that are traveling at speeds close to yours.