korrents

A korrentour readingWhat is a korrent?

LSTM architectures are designed so that retaining information over long time spans is their default behavior rather than something they must struggle to learn.

Drawn from what Christopher Olah said

Subjectneural networks
What this subject means

neural networks The architecture almost all modern machine learning is built on, and what changes when it gets deeper.

What Christopher Olah actually said

Word for word, with the source under each one. They did not write this page.

  1. Christopher Olah

    Interpretability researcher at Anthropic

    LSTMs are explicitly designed to avoid the long-term dependency problem. Remembering information for long periods of time is practically their default behavior, not something they struggle to learn!

    Where this was said

    ↗Understanding LSTM Networkscolah.github.io

    All 2 korrents from this piecethis one is 2nd

Added to korrents 27 Aug 2015 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

Sign in to record that you hold this, with a confidence number of your own.

Related korrents

Our reading — they may agree, disagree or merely touch the same thing. Closest first: a shared subject counts for most, then how near the wording is.

On the map

Loading the map… or open it on its own page

Open the map on its own page →