What Dex Horthy thinks about benchmarks

@dex-horthy · 26 positions · On ppll ↗

Founder of the agent company HumanLayer, author of the 12-factor agents principles, and the engineer who put the name "context engineering" on the practice.

Dex Horthy did not write this page.

We collected these quotes from things they published elsewhere, and every quote links to where it was said. They have no account here and have not endorsed this site. Quotes are word for word; the short line under each one is our own restatement, not their wording. Their own site. Is this you? Claim it or ask us to remove it. Or tell us what is wrong here.

Filter benchmarks · Newest first

Topic

All 26 coding agents 13 LLMs 9 software quality 6 design 3 vibe coding 3 developer tools 2 Anthropic 1 benchmarks 1 code generation 1

6 more topics

documentation 1 hiring 1 infrastructure 1 reinforcement learning 1 transformers 1 writing 1

Sort

Newest Oldest

Only Dex Horthy on benchmarks. See everyone on benchmarks

1 dated position, 2026, in their own words. Our reading of what Dex Horthy has said — not written or endorsed by them.

1 position so far — this page is not yet offered to search engines.

15 Jul 2026

Our readingModels will not learn to write maintainable code from today’s benchmarks, because the cost of bad architecture cannot be measured by running the unit tests — it arrives three to six months later.

design writing software quality

Their wordsthe problem with training models on maintainability is like the cost function of bad architecture and bad program design can't be evaluated by running the unit test because it hits you 3 to 6 months later

↗Context engineering with Dex Horthyyoutube.com 11th of 26 in this recording