Our readingWhat is a korrent?
Math, code and multilingual data in GPT-2's training set may have taken capacity away from English performance.
Drawn from what Andrej Karpathy said
SubjectLLMs
Our readingWhat is a korrent?
Drawn from what Andrej Karpathy said
fine web edu is all English it's not multilingual and there's not that much math and code um and so math and code and multilingual could have been stealing capacity from the original gpt2 model
Where this was said
Watch from 3:45:32 plays here↗Let's reproduce GPT-2 (124M)youtube.com
All 14 korrents from this recordingthis one is 14th
Added to korrents 9 Nov 2026 · How quotes work · Something wrong? Tell us
Do you hold this korrent?Do you also believe this?
I hold this tooShared subject first, then similar wording. They may agree or disagree.