Read the piece on dwarkesh.com ↗
Every claim below was made in this piece, quoted word for word and numbered in the order the piece makes them, so you can read it there rather than take our word for it. The sentence above each quote is our reading of the claim, not their wording. Each quote was checked against a stored copy of the page at build time; where the two differ, the quote is the fact.
Our reading
Training AIs on millions of verifiable tasks in diverse RL environments will lead to AGI.
Their wordsif we train AIs to accomplish millions of verifiable tasks across thousands of diverse RL environments, then we'll basically have built AGI.
Their wordsunless you can build a very replayable training target for a domain, the models will struggle to make much progress.
Their wordsBy this point, the main way that AI gets better is not through the training received before the model is released to the public. Rather, it's from all this experience that they are accumulating from being broadly deployed through the world and engaging in so many different kinds of tasks.
Keep reading