Deep Learning
LayerNorm
Normalisation across the feature dimension within each sample, independent of batch composition.
Why interviewers ask about it
Batch-independence is why transformers use it: variable sequence lengths and single-token autoregressive decoding make BatchNorm unusable.
Related terms
This term is part of the free AI/ML Engineer interview preparation module - browse the full glossary for every definition.