Our readingWhat is a korrent?
Making context windows longer will not by itself scale to long-running multimodal tasks; new ideas are needed.
Drawn from what Andrej Karpathy said
What this subject means
scaling laws Whether more compute keeps buying more capability, and where the curve now bends -- pre-training, post-training, test-time.