Our readingWhat is a korrent?
Benchmark scores do not tell you whether a new model is better at your own work.
Drawn from what Aman Khan said
Subjectbenchmarks
Our readingWhat is a korrent?
Drawn from what Aman Khan said
Once a benchmark becomes a target, it can pull optimization toward the test itself. That’s the concern behind Goodhart’s Law, and it’s a reason to check more than the headline score. None of that tells you whether the new model is better at reviewing your product spec or catching the bug in your pull request.
Where this was said
↗Build your own vibe check in an afternoonamankhan1.substack.com
All 3 korrents from this piecethis one is 1st
Added to korrents 31 Oct 2026 · How quotes work · Something wrong? Tell us
Do you hold this korrent?Do you also believe this?
I hold this tooShared subject first, then similar wording. They may agree or disagree.