korrents

Our readingWhat is a korrent?

A deep bidirectional model is strictly more powerful than a left-to-right model or a shallow concatenation of unidirectional models.

Drawn from what Kristina Toutanova, Kenton Lee and 2 others said

SubjectsLLMsneural networks
What this subject means

neural networks The architecture almost all modern machine learning is built on, and what changes when it gets deeper.

What they actually said

  1. Kristina Toutanova One of the four authors of the 2018 paper "BERT:… Intuitively, it is reasonable to believe that a deep bidirectional model is strictly more powerful than either a left-to-right model or the shallow concatenation of a left-to-right and a right-to-left model. BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingarxiv.org · 11 Oct 2018All 16 korrents from this piece
    Their wordsIntuitively, it is reasonable to believe that a deep bidirectional model is strictly more powerful than either a left-to-right model or the shallow concatenation of a left-to-right and a right-to-left model.

    Where this was said

    ↗BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingarxiv.org

    11 Oct 2018

    All 16 korrents from this piecethis one is 16th

  2. Kenton Lee One of the four authors of the 2018 paper "BERT:… Intuitively, it is reasonable to believe that a deep bidirectional model is strictly more powerful than either a left-to-right model or the shallow concatenation of a left-to-right and a right-to-left model. BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingarxiv.org · 11 Oct 2018All 16 korrents from this piece
    Their wordsIntuitively, it is reasonable to believe that a deep bidirectional model is strictly more powerful than either a left-to-right model or the shallow concatenation of a left-to-right and a right-to-left model.

    Where this was said

    ↗BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingarxiv.org

    11 Oct 2018

    All 16 korrents from this piecethis one is 15th

  3. Ming-Wei Chang One of the four authors of the 2018 paper "BERT:… Intuitively, it is reasonable to believe that a deep bidirectional model is strictly more powerful than either a left-to-right model or the shallow concatenation of a left-to-right and a right-to-left model. BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingarxiv.org · 11 Oct 2018All 16 korrents from this piece
    Their wordsIntuitively, it is reasonable to believe that a deep bidirectional model is strictly more powerful than either a left-to-right model or the shallow concatenation of a left-to-right and a right-to-left model.

    Where this was said

    ↗BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingarxiv.org

    11 Oct 2018

    All 16 korrents from this piecethis one is 14th

  4. Jacob Devlin One of the four authors of the 2018 paper "BERT:… Intuitively, it is reasonable to believe that a deep bidirectional model is strictly more powerful than either a left-to-right model or the shallow concatenation of a left-to-right and a right-to-left model. BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingarxiv.org · 11 Oct 2018All 16 korrents from this piece
    Their wordsIntuitively, it is reasonable to believe that a deep bidirectional model is strictly more powerful than either a left-to-right model or the shallow concatenation of a left-to-right and a right-to-left model.

    Where this was said

    ↗BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingarxiv.org

    11 Oct 2018

    All 16 korrents from this piecethis one is 13th

Added to korrents 9 Sept 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map