korrents
François Chollet

What François Chollet thinks about OpenAI

@francois-chollet · 12 positions · 2 changes of mind

Creator of the Keras deep-learning library and the ARC-AGI benchmark.

Everything they publish, on ppll ↗

François Chollet did not write this page.

We collected these quotes from things they published elsewhere, and every quote links to where it was said. They have no account here and have not endorsed this site. Quotes are word for word; the short line under each one is our own restatement, not their wording. Their own site. Is this you? Claim it or ask us to remove it. Or tell us what is wrong here.

3 dated positions, 2024, in their own words. Our reading of what François Chollet has said — not written or endorsed by them.

3 positions so far — this page is not yet offered to search engines.

  1. Our readingThe memorize-fetch-apply paradigm behind LLMs can reach arbitrary skill given training data, but it cannot adapt to novelty or acquire new skills on the fly.

    Their wordsThis "memorize, fetch, apply" paradigm can achieve arbitrary levels of skills at arbitrary tasks given appropriate training data, but it cannot adapt to novelty or pick up new skills on the fly (which is to say that there is no fluid intelligence at play here.)

    ↗OpenAI o3 Breakthrough High Score on ARC-AGI-Pubarcprize.org

    LLMs

    Interesting

  3. Our readingScaling the 2019-2023 recipe — same architecture, bigger model, more data — is not enough; further progress depends on new architectural ideas.

    Their wordso3's improvement over the GPT series proves that architecture is everything. You couldn't throw more compute at GPT-4 and get these results. Simply scaling up the things we were doing from 2019 to 2023 -- take the same architecture, train a bigger version on more data -- is not enough.

    ↗OpenAI o3 Breakthrough High Score on ARC-AGI-Pubarcprize.org

    Interesting

  5. Our reading · no longer heldThe memorize-fetch-apply paradigm behind LLMs can reach arbitrary skill given training data, but it cannot adapt to novelty or acquire new skills on the fly.

    No longer holdsOpenAI's new o3 model represents a significant leap forward in AI's ability to adapt to novel tasks. This is not merely incremental improvement, but a genuine breakthrough, marking a qualitative shift in AI capabilities compared to the prior limitations of LLMs.

    SaidOpenAI's new o3 model represents a significant leap forward in AI's ability to adapt to novel tasks. This is not merely incremental improvement, but a genuine breakthrough, marking a qualitative shift in AI capabilities compared to the prior limitations of LLMs.

    ↗OpenAI o3 Breakthrough High Score on ARC-AGI-Pubarcprize.org

    LLMs

    Interesting