Our readingWhat is a korrent?
Common Crawl on its own is not a high-quality dataset: it is extremely noisy, much worse than you think.
Drawn from what Andrej Karpathy said
SubjectLLMs
Our readingWhat is a korrent?
Drawn from what Andrej Karpathy said
basically it's not a very high quality data set all by itself because it is extremely noisy this is a completely random subset of the internet and it's much worse than you think
Where this was said
Watch from 3:11:11 plays here↗Let's reproduce GPT-2 (124M)youtube.com
All 14 korrents from this recordingthis one is 11th
Added to korrents 9 Nov 2026 · How quotes work · Something wrong? Tell us
Do you hold this korrent?Do you also believe this?
I hold this tooShared subject first, then similar wording. They may agree or disagree.