korrents

korrents · piece

Ajeya Cotra on transformative AI crunch time (80,000 Hours)

Ajeya Cotra · 17 Feb 2026

Read the piece on 80000hours.org ↗

24 korrents from this piece ↓

Ajeya Cotra did not write this page.

Every claim below was made in this piece, quoted word for word and numbered in the order the piece makes them, so you can read it there rather than take our word for it. The sentence above each quote is our reading of the claim, not their wording. Each quote was checked against a stored copy of the page at build time; where the two differ, the quote is the fact.

  1. I think that probably in the early 2030s we are going to see what Ryan Greenblatt calls top-human-expert-dominating AI, which is an AI system that can do tasks that you can do remotely from a computer better than any human expert.
  2. whenever I check in on the field of robotics, I actually feel like robotics is progressing pretty quickly. And it’s taking off for the same reasons that cognitive AI is taking off: large models, lots of data, imitation, large scale is helping robotics a lot.
  3. I think we should be monitoring the degree of AI adoption, self-reported AI acceleration, RCTs, anything we can get our hands on for the entire stack — because I think the moment when the AI futurists think things are likely to be going much faster coincides with when AI has fully automated the process of making more AI.
  4. everyone agrees benchmarks have major weaknesses and consistently overestimate real-world performance because benchmarks are sort of clean and contained and the real world is messy and open-ended.
  5. I think honestly having people make subjective predictions, explain how those predictions are connected to their longer-run worldviews, and then check over time who’s right might be the most flexible tool we have.
  6. I think that releasing this information publicly is probably a lot better than releasing it just to a government body — basically because we’re building the plane of AI safety research as we’re flying it
  7. I still think that information that leaks in the form of rumours in San Francisco, like tech bro parties, doesn’t have the ability to impact policy and decision making all the way in DC or London or Brussels in the same way as information that is just clearly unrefuted and very salient and sort of official.
  8. I think that what we want to do as a society, if we gain confidence that we’re at the starting point of this intelligence explosion, is to redirect as much of that AI labour as we can from further AI R&D to things that could help protect us from future generations of AIs
  9. I don’t think that it necessarily bites harder for getting the AIs to do alignment research than for getting the AIs to do anything else helpful — because if they have it out for you, they don’t necessarily want to help you shore up your civilisation’s defences.
  10. I think that the further afield you go from work that looks like doing ML research and software engineering, the greater a penalty there will probably be.
  11. I think that in general, you should expect AIs to be much better at things that there are tighter feedback loops on, where you can recognise success after a short period of time.
  12. so too in a few years it might be the case that AIs are better than most of our human grantees, and our money should mostly be going to buying API credits or renting GPU time to get the AIs to do a similar distribution of activities.
  13. I think that the plan I described is compatible with pausing right at the brink of an intelligence explosion. In fact, I would hope that we do that, because I think by default, having 12 months to get everything in order is just not enough time.
  14. then I would vote for, at that time, shifting that trajectory to be 10 times longer or even longer than that, and trying to make that transition as a society in 10 years instead of one year, or 20 years instead of one year.
  15. I think that if it fails, it’s probably most likely to fail because they just didn’t actually do a big redirection from using AIs for further AI capabilities to putting a lot of energy towards using them for AI safety.
  16. But I’m actually reasonably bullish about control techniques getting early AIs that are not super galaxy-brained superintelligences to be helpful for a range of stuff that they’re good at.
  17. We absolutely shouldn’t be waiting until crunch time to do anything at all; it’s just the prediction that crunch time is the point when a lot of things that were hard to automate before become easier to automate.
  18. at least at the beginning part of crunch time, when the AIs are just starting to automate a lot of AI R&D, my bet is that things will at that point be relatively commercial, relatively open.
  19. So basically, the more things look like an efficient competitive market with very little slack, the more the leading company will be sort of forced to provide access to the rest of us.
  20. Just building up an enormous AI lead over everyone else, and then sort of bursting onto the scene with an incredible amount of power and the ability to challenge like the US government or nation-states might be attractive to some people. I think that would be a very evil strategy to pursue, but it’s definitely in the water.
  21. And I think we might end up in a situation where the regulatees — the industry people — have fast cars, and the regulators have horses and buggies because of this differential adoption gap.
  22. your extremely local environment, the literal person you’re reporting to, matters a huge amount; and the two or three people you’re going to be talking to most in your job, or just features like how much are you talking to people in your job versus working on your own, can just make a transformative difference.
  23. My take is that it’s correct and good that you don’t need to buy into the whole EA package with all of its baggage to worry about misaligned AI taking over the world and to do technical AI safety research to prevent that
  24. You can imagine AIs getting way better at creating a curated information bubble for each individual person that allows them to continue believing whatever it is they started believing, with superintelligent help preventing them from changing their mind.

Keep reading

The other pieces are the ones whose claims are worded most like this one's. That measures language, not agreement: they may argue the opposite.