What Scott Hanselman thinks about benchmarks

@scott-hanselman · 8 positions · On ppll ↗

Programmer, teacher and speaker; long-time Microsoft developer-community figure, host of the Hanselminutes podcast and author of the hanselman.com blog.

Scott Hanselman did not write this page.

We collected these quotes from things they published elsewhere, and every quote links to where it was said. They have no account here and have not endorsed this site. Quotes are word for word; the short line under each one is our own restatement, not their wording. Their own site. Is this you? Claim it or ask us to remove it. Or tell us what is wrong here.

Filter benchmarks · Newest first

Topic

All 8code generation 2LLMs 2software performance 2AI and jobs 1AI slop 1benchmarks 1coding agents 1compilers 1data centers 1

6 more topics

developer tools 1humility 1ideas vs execution 1software quality 1taste 1writing 1

Sort

NewestOldest

Only Scott Hanselman on benchmarks. See everyone on benchmarks

1 dated position, 2026, in their own words. Our reading of what Scott Hanselman has said — not written or endorsed by them.

1 position so far — this page is not yet offered to search engines.

1. 4 Feb 2026

   Our readingImpressive one-shot AI coding demos are not a good way to judge AI coding ability.

   Their wordsPeople should not be judging AI-augmented coding by "1 shots."

   ↗The danger of glamourizing one shotsfeeds.hanselman.com 1st of 3 in this piece