korrents

Our readingWhat is a korrent?

Model comparisons understate real progress, because benchmark tables do not control for how much test-time compute each answer used.

Drawn from what Noam Brown said

Subjectsbenchmarksscaling laws
What this subject means

scaling laws Whether more compute keeps buying more capability, and where the curve now bends -- pre-training, post-training, test-time.

What Noam Brown actually said

  1. Noam Brown Research scientist at OpenAI
    I think the reason why it doesn't show up as so much better on the benchmarks is because the benchmarks are being presented, the benchmark results are being presented in the wrong way. They're not controlling for the amount of test time compute that is being used on that benchmark question.

    Where this was said

    Watch from 2:27 plays here

    ↗Really Big Test-Time Compute in AI Changes Benchmarks, Safety and Research with OpenAI's Noam Brownyoutube.com

    26 Jun 2026 · video · 36m · spoken · machine transcript

    All 18 korrents from this recordingthis one is 2nd

Added to korrents 7 Sept 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map