korrents

Our readingWhat is a korrent?

Performance gains from scaling on exam-style benchmarks are orthogonal to intelligence, because those benchmarks can be hacked by memorizing in advance.

Drawn from what François Chollet said

What this subject means

measuring intelligence What it would mean to measure intelligence in a machine, as opposed to measuring how well it does one task it was trained for.

What François Chollet actually said

  1. François Chollet Creator of the Keras deep-learning library and the ARC-AGI benchmark
    And my take is that this performance increase that you're observing, it is actually orthogonal to intelligence. You are not really measuring intelligence because your benchmark can be hacked purely by preparing for it, by memorizing things in advance.

    Watch from 0:04:32 plays here

    ↗Pattern Recognition vs True Intelligence — François Cholletyoutube.com

    6 Nov 2024 · video · 2h 42m · spoken · machine transcript

    All 30 korrents from this recordingthis one is 1st

Added to korrents 9 Nov 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map