Fundamentals
Throughput
Completed requests per unit time, usually requests per second (QPS/RPS).
Why interviewers ask about it
Not the inverse of latency. Batching raises throughput while raising per-item latency - being able to say that separates you from candidates who treat them as one dial.
Related terms
This term is part of the free System Design interview preparation module - browse the full glossary for every definition.