Founder and chief executive of SemiAnalysis, the research firm that tracks the semiconductor and AI data-centre supply chain.
Dylan Patel did not write this page.
We collected these quotes from things they published elsewhere, and every quote links to where it was said. They have no account here and have not endorsed this site. Quotes are word for word; the short line under each one is our own restatement, not their wording.
Their own site.
Is this you? Claim it or ask us to remove it.Or tell us what is wrong here.
Their wordsInteresting thing is certain regions of the US transmitting power cost more than actually generating it because the grid is so slow to build. And the demand for power, and the ability to build power, and re-ramping on a natural gas plant or even a coal plant is easy enough to do, but transmitting the power's really hard.
Their wordsSo, space data centers effectively are not li limited by, you know, hey, we have this energy advantage. It's actually just limited by the same contended resource. We can only make 200 gawatts of chips a year by the end of the decade.
Their wordsoh 50 gigawatts of economic you know sort of capex in in the data center and what gets built on top of that in terms of tokens is even larger right it might be hundred billion dollars worth of AI value into the supply chain is held up by this $1.2 two billion dollars worth of tooling that simply just cannot expand its supply chain quickly.
Their wordsChina, if they wanted to build the largest data center in the world, if they had access to the chips, could. So it's just a question of when, not if.
Their wordsSo to scale compute further right there's some different bottlenecks this year next year uh but ultimately by 2829 the bottleneck falls to the lowest rung on the supply chain which is ASML right ASML makes the world's most complicated machine i.e. an EUV tool.
Their wordsYeah, I think the biggest bottleneck is compute and for that the longest lead time supply chains are not power or data centers. They're actually the semiconductor supply chain themselves, right? It switches back from being power and data center uh as a major bottleneck to chips.
Their wordsThe important thing about, hey, is cost a limiting factor here? My view is that we'll have really awesome intelligence, like AGI, before we have it permeate throughout the economy.
Their wordsum humanoid robots maybe start to or robotics at least start to but the main factor is going to be for reducing the number of people is modularizing things and making them in factories in Asia
Their wordsUh, Micron bought a fab from a company in Taiwan that makes lagging edge chips, right? Um, Heinix and Samsung are doing, you know, some pretty crazy things to try and expand capacity at their existing fabs, uh, that also have like very large knock-on effects in the economy. And so, hey, why can't we build more capacity is like there's nowhere to put the tools, right?
Their wordsAnd they're decent, their hardware is better in many ways than in NVIDIA's. The problem is their software is really bad and I think they're getting better, right? They're getting better, faster, but the gulf is so large and they don't spend enough resources on it or haven't historically, right?
Their wordsBut the funniest thing I think that comes out of this is Jevons paradox is true. AWS pricing for H100s has gone up over the last couple of weeks, since a little bit after Christmas, since V3 was launched, AWS H100 pricing has gone up.
Their wordsThey could release claw slow mode and have an increase in tokens per dollar by a significant amount. Um they could probably like reduce the price of Opus 46 by you know 4x 5x and reduce the speed by another by maybe just like 2x like the curve on inference throughput versus speed is there already just on hm um and yet they don't um because no one actually wants to use a slow model
Their wordsBut really the software engineering agents I think can be done faster sooner than any other agent because it is a verifiable domain. You can always unit test or compile, and there's many different regions of it can inspect the whole code base at once, which no engineer really can.
Their wordsSo there is an angle of, the US' actions, from the angle of the expert controls, have been so inflammatory at slowing down China's progress on the leading edge that they've turned around and have accelerated their progress elsewhere because they know that this is so important.