Our readingWhat is a korrent?
Language models have no equivalent of sleep: nothing takes the day's context, thinks it over, and distils it back into the weights.
Drawn from what Andrej Karpathy said
SubjectLLMs
Our readingWhat is a korrent?
Drawn from what Andrej Karpathy said
These models don't really have this distillation phase um of taking what happened, analyzing it, obsessively thinking through it, um basically doing some kind of a synthetic data generation process and distilling it back back into the weights
Where this was said
Watch from 0:23:36 plays here↗Andrej Karpathy — “We’re summoning ghosts, not building animals”youtube.com
All 30 korrents from this recordingthis one is 8th
Added to korrents 7 Sept 2026 · How quotes work · Something wrong? Tell us
Do you hold this korrent?Do you also believe this?
I hold this tooShared subject first, then similar wording. They may agree or disagree.