korrents

Our readingWhat is a korrent?

An optimizer that is invariant to rescaling the gradients and cheap in memory is what makes very large models practical to train.

Drawn from what Jimmy Ba and Diederik P. Kingma said

Subjectoptimizers
What this subject means

optimizers The algorithms that actually move a model's weights during training, and the trade-offs between them.

What they actually said

  1. Jimmy Ba Associate professor at the University of Toronto The method is straightforward to implement, is computationally efficient, has little memory requirements, is invariant to diagonal rescaling of the gradients, and is well suited for problems that are large in terms of data and/or parameters. Kingma & Ba, "Adam: A Method for Stochastic Optimization" (arXiv)arxiv.org · 22 Dec 2014All 8 korrents from this piece
    Their wordsThe method is straightforward to implement, is computationally efficient, has little memory requirements, is invariant to diagonal rescaling of the gradients, and is well suited for problems that are large in terms of data and/or parameters.

    Where this was said

    ↗Kingma & Ba, "Adam: A Method for Stochastic Optimization" (arXiv)arxiv.org

    22 Dec 2014

    All 8 korrents from this piecethis one is 4th

  2. Diederik P. Kingma Machine learning researcher The method is straightforward to implement, is computationally efficient, has little memory requirements, is invariant to diagonal rescaling of the gradients, and is well suited for problems that are large in terms of data and/or parameters. Kingma & Ba, "Adam: A Method for Stochastic Optimization" (arXiv)arxiv.org · 22 Dec 2014All 8 korrents from this piece
    Their wordsThe method is straightforward to implement, is computationally efficient, has little memory requirements, is invariant to diagonal rescaling of the gradients, and is well suited for problems that are large in terms of data and/or parameters.

    Where this was said

    ↗Kingma & Ba, "Adam: A Method for Stochastic Optimization" (arXiv)arxiv.org

    22 Dec 2014

    All 8 korrents from this piecethis one is 3rd

Added to korrents 9 Sept 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map