Tinker Load balancing

by Samy (Kondasamy Jayaraman) · drawn with Colorfigures by April Zhu

No run yet.

Birch slows down as the sale starts.Ash 0 waiting · Birch 0 waiting · Cedar 0 waiting · Dogwood 0 waiting

Chapter 3 of 7

The least busy

Mid-sale, Birch slows down: a backup job is eating its time. Round robin keeps sending it every fourth request.

This chapter: How can a balancer steer around a server that has slowed down?

About this chapter

You will learn

  • Least outstanding picks the server with the fewest waiting requests
  • Power of two choices compares just two, at random
  • Why counting waiting requests beats taking turns here

Words you’ll meet

Outstanding request
A request sent to a server and not yet answered.
Least outstanding
Sending each request to the server with the fewest outstanding requests.
Power of two choices
Picking two servers at random and sending the request to the one with fewer outstanding.

Step 1 of 5

From one second in, Birch is 5 times slower. Round robin still sends it every fourth request.

Run the sale.