korrents

Our readingWhat is a korrent?

Which learning rate schedule is most effective for training these networks is an active area of research.

Drawn from what Andrej Karpathy said

What this subject means

neural networks The architecture almost all modern machine learning is built on, and what changes when it gets deeper.

What Andrej Karpathy actually said

  1. Andrej Karpathy Founding member of OpenAI and former director of AI at Tesla
    people have come up with all kinds of uh other learning rate schedules um and this is kind of like an active area of uh research as to which one is the most effective at train these networks

    Watch from 2:26:10 plays here

    ↗Let's reproduce GPT-2 (124M)youtube.com

    9 Jun 2024 · video · 4h 01m · spoken · machine transcript

    All 14 korrents from this recordingthis one is 8th

Added to korrents 9 Nov 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Nothing near enough to show. As of the last pass () this claim had been compared with the other 26461 claims in the archive and none was close enough in subject or wording to put here. That can change as the archive grows — it is not a judgement that this claim stands alone.