korrents

Our readingWhat is a korrent?

Benchmark scores do not tell you whether a new model is better at your own work.

Drawn from what Aman Khan said

benchmarks

What Aman Khan actually said

  1. Aman Khan Product leader; director of product at Arize AI in 2024
    Once a benchmark becomes a target, it can pull optimization toward the test itself. That’s the concern behind Goodhart’s Law, and it’s a reason to check more than the headline score. None of that tells you whether the new model is better at reviewing your product spec or catching the bug in your pull request.

Added to korrents 31 Oct 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map