korrents

Our readingWhat is a korrent?

Humans are not well placed to write the token sequences a model should reason with; the model needs to discover what works for it.

Drawn from what Andrej Karpathy said

LLMs

What Andrej Karpathy actually said

  1. Andrej Karpathy Founding member of OpenAI and former director of AI at Tesla
    long story short we are not in a good position to create these uh token sequences for the LM and they're useful by imitation to initialize the system but we really want the llm to discover the token sequences that work for it

    Watch from 2:19:45 plays here

    ↗Deep Dive into LLMs like ChatGPTyoutube.com

    5 Feb 2025 · video · 3h 31m · spoken · machine transcript

    All 25 korrents from this recordingthis one is 11th

Added to korrents 8 Nov 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map