Our readingWhat is a korrent?
There is no human analogue to pre-training — neither childhood nor evolution is the same thing as it.
Drawn from what Ilya Sutskever said
Subjectscaling laws
What this subject means
scaling laws Whether more compute keeps buying more capability, and where the curve now bends -- pre-training, post-training, test-time.