korrents

Our readingWhat is a korrent?

An optimizer's hyper-parameters should mean something a practitioner can reason about, and should rarely need tuning.

Drawn from what Jimmy Ba and Diederik P. Kingma said

Subjectoptimizers
What this subject means

optimizers The algorithms that actually move a model's weights during training, and the trade-offs between them.

What they actually said

  1. Jimmy Ba Associate professor at the University of Toronto The hyper-parameters have intuitive interpretations and typically require little tuning. Kingma & Ba, "Adam: A Method for Stochastic Optimization" (arXiv)arxiv.org · 22 Dec 2014All 8 korrents from this piece
    Their wordsThe hyper-parameters have intuitive interpretations and typically require little tuning.

    Where this was said

    ↗Kingma & Ba, "Adam: A Method for Stochastic Optimization" (arXiv)arxiv.org

    22 Dec 2014

    All 8 korrents from this piecethis one is 8th

  2. Diederik P. Kingma Machine learning researcher The hyper-parameters have intuitive interpretations and typically require little tuning. Kingma & Ba, "Adam: A Method for Stochastic Optimization" (arXiv)arxiv.org · 22 Dec 2014All 8 korrents from this piece
    Their wordsThe hyper-parameters have intuitive interpretations and typically require little tuning.

    Where this was said

    ↗Kingma & Ba, "Adam: A Method for Stochastic Optimization" (arXiv)arxiv.org

    22 Dec 2014

    All 8 korrents from this piecethis one is 7th

Added to korrents 9 Sept 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map