A korrentour reading

Scaling the 2019-2023 recipe — same architecture, bigger model, more data — is not enough; further progress depends on new architectural ideas.

What is a korrent?

A korrent — “current”, with a K — is our reading of what someone said: one sentence, drawn from their own words below. People put the same thought in different words; a korrent tries to name the thought they share, so that what several people mean can be set side by side, and followed as it changes.

It is an approximation, and it is ours. The quotes are theirs, word for word, and where the two differ, the quote is the fact. Read more →

What François Chollet actually said

Word for word, from things they published elsewhere, each linked to where it was said. They did not write this page.

FC
François Chollet 20 Dec 2024

o3's improvement over the GPT series proves that architecture is everything. You couldn't throw more compute at GPT-4 and get these results. Simply scaling up the things we were doing from 2019 to 2023 -- take the same architecture, train a bigger version on more data -- is not enough.

↗OpenAI o3 Breakthrough High Score on ARC-AGI-Pubarcprize.org

First recorded here 20 Dec 2024 · How quotes work

Do you hold this korrent?