Our readingWhat is a korrent?
Language models should be thought of as somewhat out of date, because pre-training is too expensive to repeat often.
Drawn from what Andrej Karpathy said
What this subject means
scaling laws Whether more compute keeps buying more capability, and where the curve now bends -- pre-training, post-training, test-time.