Our readingWhat is a korrent?
It is not clear that pretraining has hit a wall, though it probably has relatively diminished returns.
Drawn from what Ryan Greenblatt said
Subjectscaling laws
What this subject means
scaling laws Whether more compute keeps buying more capability, and where the curve now bends -- pre-training, post-training, test-time.