korrents

Our readingWhat is a korrent?

Self-attention can yield more interpretable models.

Drawn from what Illia Polosukhin, Łukasz Kaiser and 6 others said

Subjectstransformersneural networks
What these subjects mean

transformers The architecture that dropped recurrence in favour of attention, and that almost every large model since is built on.

neural networks The architecture almost all modern machine learning is built on, and what changes when it gets deeper.

What they actually said

  1. Illia Polosukhin One of the eight authors of the 2017 transformer paper… As side benefit, self-attention could yield more interpretable models. Attention is all you needarxiv.org · 12 Jun 2017All 24 korrents from this piece
    Their wordsAs side benefit, self-attention could yield more interpretable models.

    Where this was said

    ↗Attention is all you needarxiv.org

    12 Jun 2017

    All 24 korrents from this piecethis one is 24th

  2. Łukasz Kaiser One of the eight authors of the 2017 transformer paper… As side benefit, self-attention could yield more interpretable models. Attention is all you needarxiv.org · 12 Jun 2017All 24 korrents from this piece
    Their wordsAs side benefit, self-attention could yield more interpretable models.

    Where this was said

    ↗Attention is all you needarxiv.org

    12 Jun 2017

    All 24 korrents from this piecethis one is 23rd

  3. Aidan N. Gomez One of the eight authors of the 2017 transformer paper… As side benefit, self-attention could yield more interpretable models. Attention is all you needarxiv.org · 12 Jun 2017All 24 korrents from this piece
    Their wordsAs side benefit, self-attention could yield more interpretable models.

    Where this was said

    ↗Attention is all you needarxiv.org

    12 Jun 2017

    All 24 korrents from this piecethis one is 22nd

  4. Llion Jones One of the eight authors of the 2017 transformer paper… As side benefit, self-attention could yield more interpretable models. Attention is all you needarxiv.org · 12 Jun 2017All 24 korrents from this piece
    Their wordsAs side benefit, self-attention could yield more interpretable models.

    Where this was said

    ↗Attention is all you needarxiv.org

    12 Jun 2017

    All 24 korrents from this piecethis one is 21st

  5. Jakob Uszkoreit One of the eight authors of the 2017 transformer paper… As side benefit, self-attention could yield more interpretable models. Attention is all you needarxiv.org · 12 Jun 2017All 24 korrents from this piece
    Their wordsAs side benefit, self-attention could yield more interpretable models.

    Where this was said

    ↗Attention is all you needarxiv.org

    12 Jun 2017

    All 24 korrents from this piecethis one is 20th

  6. Niki Parmar One of the eight authors of the 2017 transformer paper… As side benefit, self-attention could yield more interpretable models. Attention is all you needarxiv.org · 12 Jun 2017All 24 korrents from this piece
    Their wordsAs side benefit, self-attention could yield more interpretable models.

    Where this was said

    ↗Attention is all you needarxiv.org

    12 Jun 2017

    All 24 korrents from this piecethis one is 19th

  7. Noam Shazeer One of the eight authors of the 2017 transformer paper… As side benefit, self-attention could yield more interpretable models. Attention is all you needarxiv.org · 12 Jun 2017All 24 korrents from this piece
    Their wordsAs side benefit, self-attention could yield more interpretable models.

    Where this was said

    ↗Attention is all you needarxiv.org

    12 Jun 2017

    All 24 korrents from this piecethis one is 18th

  8. Ashish Vaswani One of the eight authors of the 2017 transformer paper… As side benefit, self-attention could yield more interpretable models. Attention is all you needarxiv.org · 12 Jun 2017All 24 korrents from this piece
    Their wordsAs side benefit, self-attention could yield more interpretable models.

    Where this was said

    ↗Attention is all you needarxiv.org

    12 Jun 2017

    All 24 korrents from this piecethis one is 17th

Added to korrents 9 Sept 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map