korrents

On the map

Tap a claim on the ring to put it at the centre.

← AI model routing and evals are the same problem expressed in different ways.

17 connected korrents · 15 moments from 28 Feb 2024 to 21 Oct 2026.

Everything filed under LLMs LLMs Everything filed under developer tools developer tools Everything filed under OpenAI OpenAI Everything filed under design design Everything filed under benchmarks benchmarks Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: AI model routing and evals are the same problem expressed in different ways. AI model routing and evals are the sameproblem expressed in different ways. Last stated 2 months ago 2 Sept 2026 AO Ayo Omojola — holds since 2026-09-02 — tap for who they are Same subject: Different AI models are not perfectly interchangeable for coding agents, which makes routing hard. — tap to centre the map on it Different AI models are notperfectly interchangeable for codingagents, which makes routing hard. Last stated 4 months ago 29 Jun 2026 SW Scott Wu — holds since 2026-06-29 — tap for who they are Same subject: As more AI models are developed with varying capabilities and costs, routing between them carries real economic value. — tap to centre the map on it As more AI models are developed withvarying capabilities and costs,routing between them carries realeconomic value. Last stated 3 years ago 28 Feb 2024 CH Chip Huyen — holds since 2024-02-28 — tap for who they are Same subject: A visual eval lets designers who are not in the code build complex tooling and autonomous runs they can still shape and control the way they are used to. — tap to centre the map on it A visual eval lets designers who arenot in the code build complextooling and autonomous runs they canstill shape and control the way theyare used to. Last stated 3 months ago 11 Aug 2026 KZ Kyle Zantos — holds since 2026-08-11 — tap for who they are Same subject: A project that only shows the models are not ready yet is a win if it leaves behind an eval to retry with later models. — tap to centre the map on it A project that only shows the modelsare not ready yet is a win if itleaves behind an eval to retry withlater models. Last stated 2 months ago 10 Sept 2026 MK Mike Krieger — holds since 2026-09-10 — tap for who they are Same subject: Safely routing AI tasks to cheaper models requires accumulated observation of many prior task outcomes. — tap to centre the map on it Safely routing AI tasks to cheapermodels requires accumulatedobservation of many prior taskoutcomes. Last stated 2 months ago 17 Sept 2026 TT Tomasz Tunguz — holds since 2026-09-17 — tap for who they are Same subject: Routing prompts to different AI models can improve response quality while lowering cost and latency. — tap to centre the map on it Routing prompts to different AImodels can improve response qualitywhile lowering cost and latency. Last stated 3 years ago 28 Feb 2024 CH Chip Huyen — holds since 2024-02-28 — tap for who they are Same subject: Models look far better on evals than they are in the world because researchers, inadvertently, take inspiration from the evals when they build RL environments. — tap to centre the map on it Models look far better on evals thanthey are in the world becauseresearchers, inadvertently, takeinspiration from the evals when theybuild RL environments. Last stated 11 months ago 25 Nov 2025 IS Ilya Sutskever — holds since 2025-11-25 — tap for who they are Same subject: Using open models is the approach offering the biggest AI cost savings, followed by smart model routing. — tap to centre the map on it Using open models is the approachoffering the biggest AI costsavings, followed by smart modelrouting. Last stated 2 months ago 10 Sept 2026 GO Gergely Orosz — holds since 2026-09-10 — tap for who they are Same subject: A coding AI that integrates only with its own vendor's tools will be very limited compared with one that draws on all the tools you use. — tap to centre the map on it A coding AI that integrates onlywith its own vendor's tools will bevery limited compared with one thatdraws on all the tools you use. Last stated 3 years ago 16 Mar 2024 QS Quinn Slack — holds since 2024-03-16 — tap for who they are Same subject: A compiler that also serves an IDE has to be lazy and deferred throughout — a different way of building compilers from the one the textbooks teach. — tap to centre the map on it A compiler that also serves an IDEhas to be lazy and deferredthroughout — a different way ofbuilding compilers from the one thetextbooks teach. Last stated 6 months ago 13 May 2026 AH Anders Hejlsberg — holds since 2026-05-13 — tap for who they are Same subject: A developer using AI coding tools remains responsible for reviewing the code they ship. — tap to centre the map on it A developer using AI coding toolsremains responsible for reviewingthe code they ship. Last stated 8 months ago 10 Mar 2026 JS Jon Seager — holds since 2026-03-10 — tap for who they are Same subject: A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. — tap to centre the map on it A PHP vulnerability found withGPT-5.6 Sol will cause havoc thisweek. Last stated 2 weeks ago 21 Oct 2026 PS Peter Steinberger — holds since 2026-10-21 — tap for who they are Same subject: A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. — tap to centre the map on it A startup should not begin life as anonprofit and bolt a for-profit armon later, whatever OpenAI's ownhistory suggests. Last stated 3 years ago 18 Mar 2024 SA Sam Altman — holds since 2024-03-18 — tap for who they are Same subject: Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. — tap to centre the map on it Advertising was a necessary phasefor the internet but a momentaryindustry, and an AI people pay foris better because they know theanswers are not influenced byadvertisers. Last stated 3 years ago 18 Mar 2024 SA Sam Altman — holds since 2024-03-18 — tap for who they are Same subject: A years-old unfixed default in GitHub Actions is the root cause of a wave of software supply-chain attacks. — tap to centre the map on it A years-old unfixed default inGitHub Actions is the root cause ofa wave of software supply-chainattacks. Last stated 5 months ago 22 May 2026 TC Tyler Cipriani — holds since 2026-05-22 — tap for who they are Same subject: Git's own built-in support for large files will eventually make Git LFS unnecessary. — tap to centre the map on it Git's own built-in support for largefiles will eventually make Git LFSunnecessary. Last stated a year ago 15 Aug 2025 TC Tyler Cipriani — holds since 2025-08-15 — tap for who they are Same subject: GitHub's pull request review tooling has always lagged behind its quality as a code host. — tap to centre the map on it GitHub's pull request review toolinghas always lagged behind its qualityas a code host. Last stated 2 years ago 13 Apr 2025 TC Tyler Cipriani — holds since 2025-04-13 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre AI model routing and evals are the same problem expressed in different ways. Last stated 2 Sept 2026 · 2 months ago Holds Ayo Omojola Read this korrent →