The thundering herd problem for Web servers and the like can be solved with a "wake one" methodology. Under a "wake one" regime, when an event (such as a TCP connection) occurs, only one of the processes blocking on that event is awoken by the kernel and given the event to process.

Wake-one semantics have apparently been available for TCP connections in the Linux kernel for some time now.