01 / Understand
Attention Is All You Need
Vaswani et al. · 2017 · arXiv:1706.03762
- The question
- Can attention alone support a strong sequence-to-sequence model?
- The main idea
- The Transformer replaces recurrence and convolution with attention. The paper evaluates it on translation tasks.
- A point to check
- Results on these benchmarks do not establish performance on every language or task.
Editorial reading example based on the abstract. Read the source ↗
Open a ready-to-read AI summary →