korrents

Our readingWhat is a korrent?

Language models should be thought of as somewhat out of date, because pre-training is too expensive to repeat often.

Drawn from what Andrej Karpathy said

What this subject means

scaling laws Whether more compute keeps buying more capability, and where the curve now bends -- pre-training, post-training, test-time.

What Andrej Karpathy actually said

  1. Andrej Karpathy Founding member of OpenAI and former director of AI at Tesla
    roughly speaking you should think of these uh models is kind of like a little bit out of date because pre- training is way too expensive and happens infrequently

    Watch from 0:10:12 plays here

    ↗How I use LLMsyoutube.com

    27 Feb 2025 · video · 2h 11m · spoken · machine transcript

    All 17 korrents from this recordingthis one is 2nd

Added to korrents 8 Nov 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map