korrents

Our readingWhat is a korrent?

Running a model five times and keeping the best answer buys a higher benchmark score without buying a better model.

Drawn from what Noam Brown said

What this subject means

scaling laws Whether more compute keeps buying more capability, and where the curve now bends -- pre-training, post-training, test-time.

When a measure becomes a target

What Noam Brown actually said

  1. Noam Brown Research scientist at OpenAI
    Um so if you say okay well we're going to instead of just running this model once we're going to run it five times and take the best of the five responses or like ask a judge which one it thinks is best then you can get much higher scores than that model. And so it's really easy to make something that looks a lot better on paper but is actually not better once you control for the amount of test time compute.

Added to korrents 7 Sept 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map