world models
Internal representations of an environment that an agent builds and revises, and whether machines can build them fast.
FilterEveryone, all time
- FL
Fei-Fei Li quoted
Their wordsI think three of us have total conviction about the scaling law. That that I think we do. I do think the exact architecture choices and data mixtures is where the the devils are in the details.
↗Why Fei-Fei Li Is Betting on Spatial Intelligenceyoutube.com 7th of 13 in this recording
- 4 weeks earlier
- FC
François Chollet quoted
Their wordsCoding isn't yet another application domain -- it's the meta-skill required for AI to automatically develop its own training material, via symbolic world models. That's how the RSI loop actually kicks off.
- 13 months earlier
- FC
François Chollet quoted
Their wordsWe argue that this profound adaptability is fundamentally linked to the efficient construction and refinement of internal representations of the environment, commonly referred to as world models, and we refer to this adaptation mechanism as world model induction.
↗Assessing Adaptive World Models in Machines with Novel Games (with 13 co-authors)arxiv.org 1st of 5 in this piece
- FC
François Chollet quoted
Their wordsHowever, current understanding and evaluation of world models in artificial intelligence (AI) remains narrow, often focusing on static representations learned from training on massive corpora of data, instead of the efficiency and efficacy in learning these representations through interaction and exploration within a novel environment.
↗Assessing Adaptive World Models in Machines with Novel Games (with 13 co-authors)arxiv.org 2nd of 5 in this piece
- FC
François Chollet quoted
Their wordsWe expect that building and evaluating AI systems capable of this kind of rapid world model induction will be critical for achieving robust, general AI capable of functioning effectively in the complex and fast-changing real world, and especially in human worlds - the environments that human beings have evolved in, created, and are continually changing and re-creating.
↗Assessing Adaptive World Models in Machines with Novel Games (with 13 co-authors)arxiv.org 3rd of 5 in this piece
- FC
François Chollet quoted
Their wordsFor adaptation to complex and changing environments, an agent's world models cannot be static representations learned once and fixed.
↗Assessing Adaptive World Models in Machines with Novel Games (with 13 co-authors)arxiv.org 4th of 5 in this piece
- FC
François Chollet quoted
Their wordsWe contend that games provide particularly rich and controlled environments uniquely well-suited for systematically evaluating rapid model adaptation and the process of world model induction.
↗Assessing Adaptive World Models in Machines with Novel Games (with 13 co-authors)arxiv.org 5th of 5 in this piece