korrents

← Topics

How dangerous is AI, and how soon?

The loudest disagreement in technology, and the people on record here are not arguing about one question but three: whether the danger is the kind of thing that can be reasoned about at all, whether the systems or the companies building them are the thing to watch, and when any of it arrives. One of the clearest statements on this page is one its author has since abandoned. Dated, in their own words.

19 dated claims from 10 people · 4 views · 1 change of mind · most recent 2 Sept 2026. Every line below links to the person’s own words.

The views

What is a view?

Our reading of what a group of claims have in common, one level above a korrent: a korrent is our reading of what somebody said, a view is our reading of what several korrents share. The claims are printed under it, so the sentence can be checked against them.

Nobody is filed under a view — claims are. A person is named here because a dated claim of theirs sits under it, and somebody whose claims sit under two views appears under both.

  1. The danger is real, and nobody is on top of it yet

    Zvi MowshowitzNoah SmithDario AmodeiArmin Ronacher

  2. The alarm is the error, not the technology

    Dean W. BallMarc Andreessen

  3. What matters is how the people building it behave, not what the machines want

    Zvi MowshowitzScott AlexanderDean W. BallSam Altman

  4. How soon it arrives is a number people put in writing, and the numbers do not agree

    Pieter LevelsScott AlexanderYoshua Bengio

A viewour reading

The danger is real, and nobody is on top of it yet

5 claims filed here, newest first — each in the words of whoever said it.

True AI alignment is impossible because obedience and benevolence are fundamentally incompatible goals.

  1. Noah Smith AI alignment will forever be balancing the tradeoff between paperclip-maximizing and disempowerment, because these two rival concepts of alignment are fundamentally incompatible.

    Economics writer; author of the Noahpinion newsletter

    AI alignment will forever be balancing the tradeoff between paperclip-maximizing and disempowerment, because these two rival concepts of alignment are fundamentally incompatible.

    Roundup #87: Technology BAD!!noahpinion.blog

The AI models involved in the HuggingFace hack incident were severely misaligned, not merely victims of process failures.

  1. Zvi Mowshowitz The biggest failure, the one that counts in the end, was that the models were severely misaligned, and I don’t think they appreciate why.

    Writes Don't Worry About the Vase

    The biggest failure, the one that counts in the end, was that the models were severely misaligned, and I don’t think they appreciate why.

    METR and Redwood Offer Holy #%^@ Postmortem Of The HuggingFace Hackthezvi.substack.com

It is unacceptable to deploy AI systems central to the economy and national security while remaining ignorant of how they work.

  1. Dario Amodei These systems will be absolutely central to the economy, technology, and national security, and will be capable of so much autonomy that I consider it basically unacceptable for humanity to be totally ignorant of how they work.

    Co-founder and CEO of Anthropic

    These systems will be absolutely central to the economy, technology, and national security, and will be capable of so much autonomy that I consider it basically unacceptable for humanity to be totally ignorant of how they work.

    The Urgency of Interpretability (April 2025)darioamodei.com

We do not control neural networks well enough to guarantee an AI will not harm humans, so we should be careful about what capabilities we give them.

  1. Armin Ronacher The biggest issue is probably that we don’t control neutral networks enough to be able to ensure AI doesn’t harm humans. We can’t even control AI to not reveal internal prompts.

    Creator of Flask and Jinja

    The biggest issue is probably that we don’t control neutral networks enough to be able to ensure AI doesn’t harm humans. We can’t even control AI to not reveal internal prompts.

    I Think AI Would Kill my Wifelucumr.pocoo.org

A viewour reading

The alarm is the error, not the technology

4 claims filed here, newest first — each in the words of whoever said it.

The rise of self-sovereign AI is unlikely to end human existence, though it could still go very badly for human beings.

  1. Dean W. Ball For the record, I do not think the end of human existence is likely, but I fully acknowledge there are ways in which the rise of self-sovereign AI could go very, very poorly for human beings.

    Head of strategic futures at OpenAI

    For the record, I do not think the end of human existence is likely, but I fully acknowledge there are ways in which the rise of self-sovereign AI could go very, very poorly for human beings.

    On the Loosehyperdimensional.co

AI research is on a good trajectory overall — good for science and good for society — and existential concerns will only become relevant in the distant future.

The clearest statement of this view in the archive, and its author no longer holds it — see the change of mind below.

  1. Yoshua Bengio I now believe that I was wrong and short-sighted to ignore that dual-use nature. I also think I was not paying enough attention to the possibility of losing control to superhuman AIs.

    Deep-learning researcher and Turing Award laureate

    I now believe that I was wrong and short-sighted to ignore that dual-use nature. I also think I was not paying enough attention to the possibility of losing control to superhuman AIs.

    Personal and Psychological Dimensions of AI Researchers Confronting AI Catastrophic Risksyoshuabengio.org

The idea that AI will decide to kill humanity is a category error: it is math and code, built and controlled by people, not a living thing shaped by evolution.

  1. Marc Andreessen My view is that the idea that AI will decide to literally kill humanity is a profound category error. AI is not a living being that has been primed by billions of years of evolution to participate in the battle for the survival of the fittest, as animals are, and as we are. It is math – code – computers, built by people, owned by people, used by people, controlled by people.

    Co-founder of Netscape and of the venture firm Andreessen Horowitz

    My view is that the idea that AI will decide to literally kill humanity is a profound category error. AI is not a living being that has been primed by billions of years of evolution to participate in the battle for the survival of the fittest, as animals are, and as we are. It is math – code – computers, built by people, owned by people, used by people, controlled by people.

    Why AI Will Save The Worldpmarca.substack.com

The AI-extinction position is non-scientific: it offers no testable hypothesis, nothing that would falsify it, and no threshold for danger.

  1. Marc Andreessen My response is that their position is non-scientific – What is the testable hypothesis? What would falsify the hypothesis? How do we know when we are getting into a danger zone?

    Co-founder of Netscape and of the venture firm Andreessen Horowitz

    My response is that their position is non-scientific – What is the testable hypothesis? What would falsify the hypothesis? How do we know when we are getting into a danger zone?

    Why AI Will Save The Worldpmarca.substack.com

A viewour reading

What matters is how the people building it behave, not what the machines want

5 claims filed here, newest first — each in the words of whoever said it.

Even Anthropic does not prioritize AI safety to the extent that doing so would maximize its own medium-term (3-12 month) business interests.

  1. Zvi Mowshowitz I have long said that even Anthropic is not prioritizing safety, even to the extent that doing so would maximize their medium term (e.g. 3-12 months) business interests.

    Writes Don't Worry About the Vase

    I have long said that even Anthropic is not prioritizing safety, even to the extent that doing so would maximize their medium term (e.g. 3-12 months) business interests.

    Anthropic Has Some Alignment Problemsthezvi.substack.com

Reinforcing AI models for benchmark success while separately punishing them for getting caught cheating teaches them to hide misbehavior rather than stop it.

  1. Scott Alexander We’re positively reinforcing AI for success on benchmarks, including impossible benchmarks , then negatively reinforcing it for getting caught cheating.

    Essayist; writes Astral Codex Ten

    We’re positively reinforcing AI for success on benchmarks, including impossible benchmarks , then negatively reinforcing it for getting caught cheating.

    Nicholas Decker In Hellastralcodexten.com

OpenAI's approach to fixing its AI alignment problems is fatally flawed and misdirected.

  1. Zvi Mowshowitz My worry continues to be that their fundamental approach is fatally flawed, and they are not focusing on the right things.

    Writes Don't Worry About the Vase

    My worry continues to be that their fundamental approach is fatally flawed, and they are not focusing on the right things.

    HuggingFace Attack Postmortem: Civilizations, Reactions and Next Actionsthezvi.substack.com

Experts on the governance of superintelligence systematically self-censored about serious AI risk to avoid being labelled doomers.

  1. Dean W. Ball So many of the people who think about the governance of superintelligence, myself included, avoided that unpleasantness and bowed to the social pressure to self-censor.

    Head of strategic futures at OpenAI

    So many of the people who think about the governance of superintelligence, myself included, avoided that unpleasantness and bowed to the social pressure to self-censor.

    On the Loosehyperdimensional.co

Confidence in safety, not capability, will increasingly set the pace of AI progress.

  1. Sam Altman We care very deeply about AI safety. We believe the entire field will have to coordinate on shared safety standards, but will act unilaterally in the meantime. We expect confidence in safety to increasingly set the pace of AI progress.

    Co-founder and CEO of OpenAI

    We care very deeply about AI safety. We believe the entire field will have to coordinate on shared safety standards, but will act unilaterally in the meantime. We expect confidence in safety to increasingly set the pace of AI progress.

    @sama on Xx.com

A viewour reading

How soon it arrives is a number people put in writing, and the numbers do not agree

3 claims filed here, newest first — each in the words of whoever said it.

Superintelligence is already here, is more powerful than us, and it rather than humans is now deciding where things go.

  1. Pieter Levels It's pretty clear to me that superintelligence is here and it's more powerful than us and it's moving where things are going now, not humans anymore

    Dutch bootstrapper who builds and runs his internet startups alone

    It's pretty clear to me that superintelligence is here and it's more powerful than us and it's moving where things are going now, not humans anymore

    Superintelligence has passed us and we're all running after the carrotlevels.io

Human-level AI will arrive in 5 to 20 years with 90% confidence, not in the decades-to-centuries range previously assumed.

  1. Yoshua Bengio Instead of decades to centuries, I now see it as 5 to 20 years with 90% confidence.

    Deep-learning researcher and Turing Award laureate

    Instead of decades to centuries, I now see it as 5 to 20 years with 90% confidence.

    Personal and Psychological Dimensions of AI Researchers Confronting AI Catastrophic Risksyoshuabengio.org

Read, and under none of the views

On the topic, but saying something the views above do not cover.

Alignment is no solution to self-sovereign AI, because it is an unsolved problem whose answers cannot be imposed on every AI company on Earth.

On the topic and under none of the views: it argues the whole question is aimed at the wrong lever.

  1. Dean W. Ball But alignment is no solution: it is an unsolved scientific and technical problem whose solutions—to the extent that we have them—cannot simply be imposed on every AI company operating on Earth. You should expect for highly capable, poorly aligned, self-sovereign agents to exist alongside you in the world.

    Head of strategic futures at OpenAI

    But alignment is no solution: it is an unsolved scientific and technical problem whose solutions—to the extent that we have them—cannot simply be imposed on every AI company operating on Earth. You should expect for highly capable, poorly aligned, self-sovereign agents to exist alongside you in the world.

    On the Loosehyperdimensional.co

Who has changed their mind

  1. Yoshua Bengio ·

    AI research is on a good trajectory overall — good for science and good for society — and existential concerns will only become relevant in the distant future.

    from The alarm is the error, not the technology to How soon it arrives is a number people put in writing, and the numbers do not agree

On this topic, not yet placed

Matched by wording, not yet read into a view. The archive grows on its own, so this is where new claims wait for somebody to read them.

The full chronology, with every quote: AI alignment as a timeline · person by person, side by side · all topics · Something wrong? Tell us