Emergent abilities come from generalisation turning compositional, not merely from a training set containing a lot of stuff.
Sergey Levine Professor of computer science at UC Berkeley Yeah. So there's a subtlety here. Emerging capabilities don't just come from the fact that internet data has a lot of stuff in it. They also come from the fact that generalization once it reaches a certain level becomes compositional. Fully autonomous robots are much closer than you think – Sergey Levineyoutube.com · 12 Sept 2025 · 0:39:23 into the videoAll korrents from this video
Their wordsYeah. So there's a subtlety here. Emerging capabilities don't just come from the fact that internet data has a lot of stuff in it. They also come from the fact that generalization once it reaches a certain level becomes compositional.