korrents

Our readingWhat is a korrent?

The knowledge a model soaks up in pre-training is holding it back; what we actually want is the intelligence with the knowledge stripped out.

Drawn from what Andrej Karpathy said

SubjectsLLMsscaling lawsneural networks
What these subjects mean

scaling laws Whether more compute keeps buying more capability, and where the curve now bends -- pre-training, post-training, test-time.

neural networks The architecture almost all modern machine learning is built on, and what changes when it gets deeper.

What Andrej Karpathy actually said

  1. Andrej Karpathy Founding member of OpenAI and former director of AI at Tesla
    And actually, you don't actually need or want the knowledge. I actually think that's probably actually holding back the neural networks overall because it's actually like getting them to rely on the knowledge a little too much sometimes.

    Where this was said

    Watch from 0:13:57 plays here

    ↗Andrej Karpathy — “We’re summoning ghosts, not building animals”youtube.com

    17 Oct 2025 · video · 2h 26m · spoken · machine transcript

    All 30 korrents from this recordingthis one is 6th

Added to korrents 7 Sept 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map