korrents

Our readingWhat is a korrent?

A transduction model can rely entirely on self-attention for input and output representations without sequence-aligned RNNs or convolution.

Drawn from what Illia Polosukhin, Łukasz Kaiser and 6 others said

Subjectstransformersneural networks
What these subjects mean

transformers The architecture that dropped recurrence in favour of attention, and that almost every large model since is built on.

neural networks The architecture almost all modern machine learning is built on, and what changes when it gets deeper.

What they actually said

  1. Illia Polosukhin One of the eight authors of the 2017 transformer paper… To the best of our knowledge, however, the Transformer is the first transduction model relying entirely on self-attention to compute representations of its input and output without using sequence-aligned RNNs or convolution. Attention is all you needarxiv.org · 12 Jun 2017All 24 korrents from this piece
    Their wordsTo the best of our knowledge, however, the Transformer is the first transduction model relying entirely on self-attention to compute representations of its input and output without using sequence-aligned RNNs or convolution.

    Where this was said

    ↗Attention is all you needarxiv.org

    12 Jun 2017

    All 24 korrents from this piecethis one is 16th

  2. Łukasz Kaiser One of the eight authors of the 2017 transformer paper… To the best of our knowledge, however, the Transformer is the first transduction model relying entirely on self-attention to compute representations of its input and output without using sequence-aligned RNNs or convolution. Attention is all you needarxiv.org · 12 Jun 2017All 24 korrents from this piece
    Their wordsTo the best of our knowledge, however, the Transformer is the first transduction model relying entirely on self-attention to compute representations of its input and output without using sequence-aligned RNNs or convolution.

    Where this was said

    ↗Attention is all you needarxiv.org

    12 Jun 2017

    All 24 korrents from this piecethis one is 15th

  3. Aidan N. Gomez One of the eight authors of the 2017 transformer paper… To the best of our knowledge, however, the Transformer is the first transduction model relying entirely on self-attention to compute representations of its input and output without using sequence-aligned RNNs or convolution. Attention is all you needarxiv.org · 12 Jun 2017All 24 korrents from this piece
    Their wordsTo the best of our knowledge, however, the Transformer is the first transduction model relying entirely on self-attention to compute representations of its input and output without using sequence-aligned RNNs or convolution.

    Where this was said

    ↗Attention is all you needarxiv.org

    12 Jun 2017

    All 24 korrents from this piecethis one is 14th

  4. Llion Jones One of the eight authors of the 2017 transformer paper… To the best of our knowledge, however, the Transformer is the first transduction model relying entirely on self-attention to compute representations of its input and output without using sequence-aligned RNNs or convolution. Attention is all you needarxiv.org · 12 Jun 2017All 24 korrents from this piece
    Their wordsTo the best of our knowledge, however, the Transformer is the first transduction model relying entirely on self-attention to compute representations of its input and output without using sequence-aligned RNNs or convolution.

    Where this was said

    ↗Attention is all you needarxiv.org

    12 Jun 2017

    All 24 korrents from this piecethis one is 13th

  5. Jakob Uszkoreit One of the eight authors of the 2017 transformer paper… To the best of our knowledge, however, the Transformer is the first transduction model relying entirely on self-attention to compute representations of its input and output without using sequence-aligned RNNs or convolution. Attention is all you needarxiv.org · 12 Jun 2017All 24 korrents from this piece
    Their wordsTo the best of our knowledge, however, the Transformer is the first transduction model relying entirely on self-attention to compute representations of its input and output without using sequence-aligned RNNs or convolution.

    Where this was said

    ↗Attention is all you needarxiv.org

    12 Jun 2017

    All 24 korrents from this piecethis one is 12th

  6. Niki Parmar One of the eight authors of the 2017 transformer paper… To the best of our knowledge, however, the Transformer is the first transduction model relying entirely on self-attention to compute representations of its input and output without using sequence-aligned RNNs or convolution. Attention is all you needarxiv.org · 12 Jun 2017All 24 korrents from this piece
    Their wordsTo the best of our knowledge, however, the Transformer is the first transduction model relying entirely on self-attention to compute representations of its input and output without using sequence-aligned RNNs or convolution.

    Where this was said

    ↗Attention is all you needarxiv.org

    12 Jun 2017

    All 24 korrents from this piecethis one is 11th

  7. Noam Shazeer One of the eight authors of the 2017 transformer paper… To the best of our knowledge, however, the Transformer is the first transduction model relying entirely on self-attention to compute representations of its input and output without using sequence-aligned RNNs or convolution. Attention is all you needarxiv.org · 12 Jun 2017All 24 korrents from this piece
    Their wordsTo the best of our knowledge, however, the Transformer is the first transduction model relying entirely on self-attention to compute representations of its input and output without using sequence-aligned RNNs or convolution.

    Where this was said

    ↗Attention is all you needarxiv.org

    12 Jun 2017

    All 24 korrents from this piecethis one is 10th

  8. Ashish Vaswani One of the eight authors of the 2017 transformer paper… To the best of our knowledge, however, the Transformer is the first transduction model relying entirely on self-attention to compute representations of its input and output without using sequence-aligned RNNs or convolution. Attention is all you needarxiv.org · 12 Jun 2017All 24 korrents from this piece
    Their wordsTo the best of our knowledge, however, the Transformer is the first transduction model relying entirely on self-attention to compute representations of its input and output without using sequence-aligned RNNs or convolution.

    Where this was said

    ↗Attention is all you needarxiv.org

    12 Jun 2017

    All 24 korrents from this piecethis one is 9th

Added to korrents 9 Sept 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map