What Hamel Husain thinks about software quality
Machine learning engineer and independent AI consultant; writes about LLM evaluation and tooling at hamel.dev.
Hamel Husain did not write this page.
We collected these quotes from things they published elsewhere, and every quote links to where it was said. They have no account here and have not endorsed this site. Quotes are word for word; the short line under each one is our own restatement, not their wording. Their own site. Is this you? Claim it or ask us to remove it. Or tell us what is wrong here.
Filter software quality · Newest first
Only Hamel Husain on software quality. See everyone on software quality
4 dated positions, 2026, in their own words. Our reading of what Hamel Husain has said — not written or endorsed by them.
-
Our readingEvaluation and error analysis will remain necessary practices even if AI models become near-perfect.
Their wordsEven with perfect models, you still need to verify they're solving the right problem. The need for systematic error analysis, domain-specific testing, and monitoring will still be important.
↗AI Evals: Everything You Need to Knowhamel.dev 1st of 2 in this piece
- 3 months earlier
-
Our readingAn artifact that is hard for its builder to verify is usually also hard for its users to verify.
Their wordsArtifacts that are hard for you to verify are often hard for users too.
↗“It’s Hard to Eval” Is a Product Smellhamel.dev 1st of 3 in this piece
-
Their wordsMore importantly, designing your product for ease of verification should come before building evals.
↗“It’s Hard to Eval” Is a Product Smellhamel.dev 2nd of 3 in this piece
-
Their wordsBefore AI, verification often happened incidentally during the process of creating work product. With AI, verification is the bottleneck.
↗“It’s Hard to Eval” Is a Product Smellhamel.dev 3rd of 3 in this piece