korrents

A korrentour readingWhat is a korrent?

The knowledge a model soaks up in pre-training is holding it back; what we actually want is the intelligence with the knowledge stripped out.

Drawn from what Andrej Karpathy said

What this subject means

scaling laws Whether more compute keeps buying more capability, and where the curve now bends -- pre-training, post-training, test-time.

A private bookmark. Not a position, and never counted.

What Andrej Karpathy actually said

Word for word, with the source under each one. They did not write this page.

  1. Andrej Karpathy

    Founding member of OpenAI and former director of AI at Tesla

    And actually, you don't actually need or want the knowledge. I actually think that's probably actually holding back the neural networks overall because it's actually like getting them to rely on the knowledge a little too much sometimes.

Added to korrents 17 Oct 2025 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

Sign in to record that you hold this, with a confidence number of your own.

Related korrents

Our reading — they may agree, disagree or merely touch the same thing. Closest first: a shared subject counts for most, then how near the wording is.

On the map

Loading the map… or open it on its own page

Open the map on its own page →