Experimentation
Statistical Power
The probability of detecting a true effect of a given size. Sample size n ≈ 16·p(1−p)/δ² per arm at 80% power, α = 0.05.
Why interviewers ask about it
Halving the minimum detectable effect quadruples the required sample. That quadratic is why small model gains are so expensive to validate.
Related terms
This term is part of the free AI/ML Engineer interview preparation module - browse the full glossary for every definition.