Transformers
RoPE (Rotary Position Embedding)
Rotating Q and K by position-proportional angles so the attention score depends only on the relative offset (m − n).
Why interviewers ask about it
Applies to Q and K only, never V. Extendable beyond the trained length via position interpolation, NTK-aware scaling or YaRN.
This term is part of the free AI/ML Engineer interview preparation module - browse the full glossary for every definition.