Paper Explainers
video42 MIN PREMIUM

Attention Is All You Need

Vaswani, Shazeer, Parmar, Uszkoreit, Jones, Gomez, Kaiser, Polosukhin · 2017 · DOI 10.48550/arXiv.1706.03762
Read original paper
SUMMARY

The paper that introduced the Transformer architecture — covering scaled dot-product attention, multi-head attention, positional encodings, and the original encoder-decoder design.

Unlock the full explainer

Premium subscribers get the full video, transcript, and code repository.

View pricing plans

Made with Emergent