A korrentour readingWhat is a korrent?
Self-attention can yield more interpretable models.
Drawn from what Illia Polosukhin, Łukasz Kaiser and 6 others said
What this subject means
transformers The architecture that dropped recurrence in favour of attention, and that almost every large model since is built on.