What Edwin Chen thinks about benchmarks
Founder and CEO of the AI data company Surge AI; earlier a machine-learning engineer at Twitter, Google and Facebook.
Edwin Chen did not write this page.
We collected these quotes from things they published elsewhere, and every quote links to where it was said. They have no account here and have not endorsed this site. Quotes are word for word; the short line under each one is our own restatement, not their wording. Their own site. Is this you? Claim it or ask us to remove it. Or tell us what is wrong here.
Filter benchmarks · Newest first
Only Edwin Chen on benchmarks. See everyone on benchmarks
1 dated position, 2026, in their own words. Our reading of what Edwin Chen has said — not written or endorsed by them.
-
Their wordstoo many benchmarks are too sanitized. they test if models can solve well-defined problems when you tell them exactly what problem is.