korrents

A korrentour readingWhat is a korrent?

An optimizer's hyper-parameters should mean something a practitioner can reason about, and should rarely need tuning.

Drawn from what Jimmy Ba and Diederik P. Kingma said

Subjectoptimizers
What this subject means

optimizers The algorithms that actually move a model's weights during training, and the trade-offs between them.

Interesting
A private bookmark. Not a position, and never counted.

What they actually said

Word for word, with the source under each one. They did not write this page.

  1. Jimmy Ba The hyper-parameters have intuitive interpretations and typically require little tuning. arxiv.org

    Associate professor at the University of Toronto

    Their wordsThe hyper-parameters have intuitive interpretations and typically require little tuning.

    Where this was said

    ↗Kingma & Ba, "Adam: A Method for Stochastic Optimization" (arXiv)arxiv.org

    All 8 korrents from this piecethis one is 8th

  2. Diederik P. Kingma The hyper-parameters have intuitive interpretations and typically require little tuning. arxiv.org

    Machine learning researcher

    Their wordsThe hyper-parameters have intuitive interpretations and typically require little tuning.

    Where this was said

    ↗Kingma & Ba, "Adam: A Method for Stochastic Optimization" (arXiv)arxiv.org

    All 8 korrents from this piecethis one is 7th

Added to korrents 22 Dec 2014 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

Sign in to record that you hold this, with a confidence number of your own.

Related korrents

Our reading — they may agree, disagree or merely touch the same thing. Closest first: a shared subject counts for most, then how near the wording is.

On the map

Loading the map… or open it on its own page

Open the map on its own page →