Scaling
Power of Two Choices
Sample two backends at random and send to the less loaded one.
Why interviewers ask about it
Reduces maximum load from O(log n / log log n) to O(log log n) with no coordination - near-optimal balancing, which is why service meshes use it.
This term is part of the free System Design interview preparation module - browse the full glossary for every definition.