A modern HTTP server running on somewhat recent hardware is capable of servicing a huge number of requests with very low latency. Here's a plot showing requests per second vs. number of concurrent connections for the default index.html page included with nginx 1.0.14.

With this particular hardware & software combination the server quickly reaches over 500,000 requests/sec and sustains that with gradually increasing latency.