Our readingWhat is a korrent?
Models are enormous only because the internet is bad: most of that capacity does memory work, and a better dataset would need far less of it.
Drawn from what Andrej Karpathy said
What this subject means
scaling laws Whether more compute keeps buying more capability, and where the curve now bends -- pre-training, post-training, test-time.