Chip Huyen
Engineer and writer on machine-learning systems; author of Designing Machine Learning Systems and AI Engineering.
Chip Huyen did not write this page.
We collected these quotes from things they published elsewhere, and every quote links to where it was said. They have no account here and have not endorsed this site. Quotes are word for word; the short line under each one is our own restatement, not their wording. Their own site. Is this you? Claim it or ask us to remove it. Or tell us what is wrong here.
Filter All topics · Newest first
-
Their wordsI feel like now I can build anything I want. But at the same time, anyone can build anything I want. So, what is the incentive structure for me to do anything?
↗Chip Huyen: Building when it feels like there's nothing left to build - The Pragmatic Summityoutube.com 1st of 14 in this recording
-
Their wordsif you can describe a style, AI can generate it. And the same with software. If you can describe a software, then AI can build it for you.
↗Chip Huyen: Building when it feels like there's nothing left to build - The Pragmatic Summityoutube.com 2nd of 14 in this recording
-
Their wordsAnd the more you build, right? The more you put things out there, you remove the need for imagination. You can say, "Okay, now I like that website. Do that for me."
↗Chip Huyen: Building when it feels like there's nothing left to build - The Pragmatic Summityoutube.com 3rd of 14 in this recording
-
Their wordsThe product you build is just solving a problem. So, is that like is the more you do that, the better you become at problem solving. And one thing I do believe that it will never change that there will always be problems to solve.
↗Chip Huyen: Building when it feels like there's nothing left to build - The Pragmatic Summityoutube.com 4th of 14 in this recording
-
Their wordsSo, I think of them as the top of the long long tail long tail problem. Like, something very common issues that a lot of people experience. AI will get really good at it. And over time AI will cover more more edge cases, but the edge cases will never go away.
↗Chip Huyen: Building when it feels like there's nothing left to build - The Pragmatic Summityoutube.com 5th of 14 in this recording
-
Their wordsLike if it's a big problem, like everyone can see, then all these big companies will get into it. But whereas it's like there are a lot of problems that's like smaller, then maybe OpenAI won't be motivated to solve it, but maybe I can like all a lot of people can.
↗Chip Huyen: Building when it feels like there's nothing left to build - The Pragmatic Summityoutube.com 6th of 14 in this recording
-
Their wordsI don't think that human preference is just an equation that people can just like package nicely and like, "Hey, ask people like which which of these two answers people would prefer?" It's very very personal, very culturally dependent, geographically dependent, age dependent.
↗Chip Huyen: Building when it feels like there's nothing left to build - The Pragmatic Summityoutube.com 7th of 14 in this recording
-
Their wordsBut in Vietnam and also in a lot of other Asian countries, people are on the move all the time. Like people are on the motorbike all the time. So, they actually really don't like typing. So, the voice like a lot of the companies in Vietnam actually deploy voice bots before they do uh do chatbot.
↗Chip Huyen: Building when it feels like there's nothing left to build - The Pragmatic Summityoutube.com 8th of 14 in this recording
-
Their wordsSo, I I think there's a lot of things we still try to imagine. What would be an AI-driven world look like, right? I think people are trying to like retrofit what already exists to fit what they think is a new workflow.
↗Chip Huyen: Building when it feels like there's nothing left to build - The Pragmatic Summityoutube.com 9th of 14 in this recording
-
Their wordsSo, I think that the whole workflow of like reviewing code is very outdated. Like, I don't think the I think that the senior member, instead of like giving feedback on the code, they should be giving feedback on like how you give instruction to AI to produce better.
↗Chip Huyen: Building when it feels like there's nothing left to build - The Pragmatic Summityoutube.com 10th of 14 in this recording
-
Their wordsYou cannot just reverse that, right? It's just not working. So, I do think that we need to build out the whole guardrails for the reversibility of actions because that actually where things get really really scary.
↗Chip Huyen: Building when it feels like there's nothing left to build - The Pragmatic Summityoutube.com 11th of 14 in this recording
-
Their wordsLike I I write books and as much I wish that books as a format will be like will survive. I do think that people don't read books the same way anymore.
↗Chip Huyen: Building when it feels like there's nothing left to build - The Pragmatic Summityoutube.com 12th of 14 in this recording
-
Their wordsAnd I feel like it's a very human way of doing web search, right? Because we enter things in the Google and we see all the like citations, the quotations part. But like why would we limit AI to that? If AI already visit a page, why don't just pull the entire page out?
↗Chip Huyen: Building when it feels like there's nothing left to build - The Pragmatic Summityoutube.com 13th of 14 in this recording
-
Their wordsAnd the question nowadays is less about like how to build because if you can describe the problem in the solution you want, usually AI can do it. Maybe not today, but maybe like two or three years from now on they can do a lot of those. The question is like what to build because we talk about like yes, if something exists, right? AI can replicate it.
↗Chip Huyen: Building when it feels like there's nothing left to build - The Pragmatic Summityoutube.com 14th of 14 in this recording
- 14 months earlier
-
Their wordsBecause everyone uses the same models nowadays, the AI components of AI products are similar, and the differentiation is product.
↗Common pitfalls when building generative AI applicationshuyenchip.com 1st of 3 in this piece
-
Our reading
Building a working AI demo is far easier than turning it into a reliable production product.
Their wordsThis is perhaps one of the first painful lessons anyone who has built an AI product quickly learns. It's easy to build a demo, but hard to build a product.
↗Common pitfalls when building generative AI applicationshuyenchip.com 2nd of 3 in this piece
-
Their wordsAI judges must be evaluated and iterated over time, just like all other AI applications.
↗Common pitfalls when building generative AI applicationshuyenchip.com 3rd of 3 in this piece
- 9 days earlier
-
Their wordsPersonally, I would trust a self-driving car more than the average stranger to give me a lift.
-
Our reading
Most real-world AI agent systems are actually multi-agent systems made of multiple components.
Their wordsBecause most agentic workflows are sufficiently complex to involve multiple components, most agents are multi-agent.
-
Our reading
Planning is fundamentally a search problem: explore paths, predict outcomes, and pick the best one.
AI agentsreinforcement learning
Their wordsPlanning, at its core, is a search problem. You search among different paths towards the goal, predict the outcome (reward) of each path, and pick the path with the most promising outcome.
- 5 months earlier
-
Their wordsContext construction for foundation models is equivalent to feature engineering for classical ML models.
↗Building A Generative AI Platformhuyenchip.com 1st of 3 in this piece
-
Their wordsIn-context learning, learning from the context, is a form of continual learning.
↗Building A Generative AI Platformhuyenchip.com 2nd of 3 in this piece
-
Their wordsAI models are probabilistic, making their outputs unreliable.
↗Building A Generative AI Platformhuyenchip.com 3rd of 3 in this piece
- 3 months earlier
-
Their wordsI have this theory that life has a circadian rhythm. Every 3-6 years, you become a different person.
↗Measuring personal growthhuyenchip.com 1st of 3 in this piece
-
Our reading
Growing older tends to expand rather than shrink the number of achievable dreams and options.
Their wordsAs I grow older, I have more dreams. I now know many things that I didn't know before, and I have access to more resources than I ever did.
↗Measuring personal growthhuyenchip.com 2nd of 3 in this piece
-
Their wordsIn the face of uncertainty, I lean towards the decision that would give me the most future options.
↗Measuring personal growthhuyenchip.com 3rd of 3 in this piece
- 5 weeks earlier
-
Their wordsthe lower we go in the stack, the harder it is for individuals to build.
↗What I learned from looking at 900 most popular open source AI toolshuyenchip.com 1st of 2 in this piece
-
Their wordsSeveral people have speculated that we'll see many very valuable one-person companies (see Sam Altman's interview and Reddit discussion). I think they might be right.
↗What I learned from looking at 900 most popular open source AI toolshuyenchip.com 2nd of 2 in this piece
- 2 weeks earlier
-
Our reading
Routing prompts to different AI models can improve response quality while lowering cost and latency.
Their wordsModel routing has the potential to increase response quality while reducing costs and latency.
↗Predictive Human Preference: From Model Ranking to Model Routinghuyenchip.com 1st of 3 in this piece
-
Their wordsOne pattern is that for simple prompts, weak models can do (nearly) as well as strong models. For more challenging prompts, however, users are much more likely to prefer stronger models.
↗Predictive Human Preference: From Model Ranking to Model Routinghuyenchip.com 2nd of 3 in this piece