Our readingWhat is a korrent?
What is in a model's weights is a hazy recollection of things it read a year ago; what is in its context window is working memory.
Drawn from what Andrej Karpathy said
SubjectLLMs
Our readingWhat is a korrent?
Drawn from what Andrej Karpathy said
anything that's in the weights it's kind of like a hazy recollection of what you read a year ago anything that you give it as a context uh at test time is directly in the working memory
Where this was said
Watch from 0:19:29 plays here↗Andrej Karpathy — “We’re summoning ghosts, not building animals”youtube.com
All 30 korrents from this recordingthis one is 7th
Added to korrents 7 Sept 2026 · How quotes work · Something wrong? Tell us
Do you hold this korrent?Do you also believe this?
I hold this tooShared subject first, then similar wording. They may agree or disagree.