korrents

Our readingWhat is a korrent?

Standard recurrent neural networks are theoretically capable of representing long-term dependencies but fail to learn them from data in practice.

Drawn from what Christopher Olah said

What this subject means

neural networks The architecture almost all modern machine learning is built on, and what changes when it gets deeper.

What Christopher Olah actually said

  1. Christopher Olah Interpretability researcher at Anthropic
    In theory, RNNs are absolutely capable of handling such "long-term dependencies." A human could carefully pick parameters for them to solve toy problems of this form. Sadly, in practice, RNNs don't seem to be able to learn them.

Added to korrents 20 Sept 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map