Our readingWhat is a korrent?
Models hallucinate because in their training data questions like "who is X" are always answered confidently, so they imitate that confident style.
Drawn from what Andrej Karpathy said
SubjectLLMs
Our readingWhat is a korrent?
Drawn from what Andrej Karpathy said
the model statistically imitates is training set in the training set the questions of the form who is blah are confidently answered with the correct answer and so it's going to take on the style of the answer and it's going to do its best
Where this was said
Watch from 1:22:40 plays here↗Deep Dive into LLMs like ChatGPTyoutube.com
All 25 korrents from this recordingthis one is 3rd
Added to korrents 8 Nov 2026 · How quotes work · Something wrong? Tell us
Do you hold this korrent?Do you also believe this?
I hold this tooShared subject first, then similar wording. They may agree or disagree.