Our readingWhat is a korrent?
Long-context evaluation benchmarks are likely contaminated by model training data, making them unreliable as a sole evaluation method
Drawn from what Eugene Yan said
What Eugene Yan actually said
- Eugene Yan Member of technical staff at Anthropic
Since these datasets are likely already part of model training data, we shouldn't rely solely on them to evaluate our Q&A system.
Where this was said
↗Evaluating Long-Context Question & Answer Systemseugeneyan.com
All 3 korrents from this piecethis one is 3rd
Added to korrents 20 Sept 2026 · How quotes work · Something wrong? Tell us
Do you hold this korrent?Do you also believe this?
I hold this tooRelated korrents
Shared subject first, then similar wording. They may agree or disagree.