Our readingWhat is a korrent?
As models keep growing, AI is running out of enough high-quality unique training tokens to keep up.
Drawn from what Lilian Weng said
What these subjects mean
scaling laws Whether more compute keeps buying more capability, and where the curve now bends -- pre-training, post-training, test-time.
neural networks The architecture almost all modern machine learning is built on, and what changes when it gets deeper.
Mental modelBottlenecks