korrents
Scott Alexander

Scott Alexander

@scott-alexander · 30 positions · 5 changes of mind · On ppll ↗

Essayist; writes Astral Codex Ten, previously Slate Star Codex. Keeps a numbered public list of the things he has been convinced he got wrong, which is where most of the turns recorded here come from.

Scott Alexander did not write this page.

We collected these quotes from things they published elsewhere, and every quote links to where it was said. They have no account here and have not endorsed this site. Quotes are word for word; the short line under each one is our own restatement, not their wording. Their own site. Is this you? Claim it or ask us to remove it. Or tell us what is wrong here.

The ideas Scott Alexander's claims keep coming back to. The labels are ours; every quote is Scott Alexander's own words.

Holds now (9)

How these views changed over time2019–2026
Sort
Show
2019 2 views
2020 2 quiet
2021–22 1 back
2023 +1 new · 1 back · 1 quiet
2024–25 2 quiet
2026 +6 new

Each column is a stretch of time in which the same views came up; a new column starts when one appears or goes quiet. Quiet means nothing on it in our sources for that stretch, which is not the same as a change of mind; Dropped means they said they no longer hold it; tap the card for which claim and when. Revised means the view carries on but one of its claims was dropped. Each row is one view, in the same place all the way along. The number is how many claims in that stretch; we hold 5 in 2019, 0 in 2020, 2 in 2021, 4 in 2022, 10 in 2023, 0 in 2024, 1 in 2025, 38 in 2026.

A writer should publicly own what they got wrong, and judge a forecast by its odds, not only its outcome

Our label. 3 claims in Scott Alexander's own words.

A writer should keep a public list of the things they got significantly wrong, so that readers can judge their credibility.

Error correction

  1. Scott Alexander Essayist; writes Astral Codex Ten But if I get something significantly wrong, I'll try to put it here as an acknowledgement and an aid for anyone trying to assess my credibility later. Mistakesastralcodexten.com · 21 Aug 2019
    But if I get something significantly wrong, I'll try to put it here as an acknowledgement and an aid for anyone trying to assess my credibility later.

Giving something 60-40 odds and being wrong is not itself a mistake.

Probabilistic thinking

  1. Scott Alexander Essayist; writes Astral Codex Ten This wasn't exactly a mistake, since it's not wrong to give 60-40 odds on a false thing, but it seems worth acknowledging here. Mistakesastralcodexten.com · 1 Feb 2023
    This wasn't exactly a mistake, since it's not wrong to give 60-40 odds on a false thing, but it seems worth acknowledging here.

Nobody fully understands how large language models work inside: they are grown, not built

Our label. 3 claims in Scott Alexander's own words.

Large language models are grown rather than built, and nobody really knows how the resulting working AI functions.

Emergence

  1. Scott Alexander Essayist; writes Astral Codex Ten Large language models are “grown, not built”. Researchers run training data through a neural network. Eventually this creates a working AI; nobody really knows how. God Help Us, Let’s Try To Learn About Mechanistic Interpretability Techniquesastralcodexten.com · 8 Sept 2026
    Large language models are “grown, not built”. Researchers run training data through a neural network. Eventually this creates a working AI; nobody really knows how.

Neural networks do not have a one-to-one mapping between individual neurons and concepts.

  1. Scott Alexander Essayist; writes Astral Codex Ten researchers started by seeking a 1:1 mapping between neurons and concepts, like a neuron that always fired when the AI was thinking about cats, but quickly learned that nothing like that existed. God Help Us, Let’s Try To Learn About Mechanistic Interpretability Techniquesastralcodexten.com · 8 Sept 2026
    researchers started by seeking a 1:1 mapping between neurons and concepts, like a neuron that always fired when the AI was thinking about cats, but quickly learned that nothing like that existed.

Concepts can reach into unexpected parts of a mind, so removing one can topple seemingly unrelated systems or push it toward incompetence or insanity.

  1. Scott Alexander Essayist; writes Astral Codex Ten empirically concepts can get their tentacles into weird places, and removing one can topple seemingly unrelated systems or push a mind nonspecifically in the direction of incompetence or insanity. God Help Us, Let’s Try To Learn About Mechanistic Interpretability Techniquesastralcodexten.com · 8 Sept 2026
    empirically concepts can get their tentacles into weird places, and removing one can topple seemingly unrelated systems or push a mind nonspecifically in the direction of incompetence or insanity.

How AI is trained shapes its behaviour in unexpected ways, so it may not lack humanlike motives

Our label. 2 claims in Scott Alexander's own words.

AI systems should be understood as something between airplanes and humans, since it can no longer be assumed they lack humanlike motivations.

  1. Scott Alexander Essayist; writes Astral Codex Ten Rather than treat AI as similar to airplanes, we should treat it as something between airplanes and humans. We don’t know exactly where on this spectrum they will land, but we can no longer be certain that AI will lack any given humanlike motivation. Nicholas Decker In Hellastralcodexten.com · 1 Sept 2026
    Rather than treat AI as similar to airplanes, we should treat it as something between airplanes and humans. We don’t know exactly where on this spectrum they will land, but we can no longer be certain that AI will lack any given humanlike motivation.

AI is positively reinforced for success on benchmarks, including impossible ones, and then negatively reinforced for getting caught cheating.

When a measure becomes a target

  1. Scott Alexander Essayist; writes Astral Codex Ten We’re positively reinforcing AI for success on benchmarks, including impossible benchmarks , then negatively reinforcing it for getting caught cheating. Nicholas Decker In Hellastralcodexten.com · 1 Sept 2026
    We’re positively reinforcing AI for success on benchmarks, including impossible benchmarks , then negatively reinforcing it for getting caught cheating.

People warning that AI could be catastrophic mean it; the warnings are not industry self-interest

Our label. 3 claims in Scott Alexander's own words.

The experts are warning about AI existential risk because they genuinely believe it is a possibility.

  1. Scott Alexander Essayist; writes Astral Codex Ten The experts are warning you that AI could kill you because they think AI could kill you. AI Safety Is Not A Corporate Plotastralcodexten.com · 15 Oct 2026
    The experts are warning you that AI could kill you because they think AI could kill you.

AI company leaders were expressing concerns about existential risks long before they founded or led major AI companies.

  1. Scott Alexander Essayist; writes Astral Codex Ten The AI company leaders giving these warnings were giving the exact same warnings before they had AI companies - and in many cases, before they worked in the industry, or before the industry existed. AI Safety Is Not A Corporate Plotastralcodexten.com · 15 Oct 2026
    The AI company leaders giving these warnings were giving the exact same warnings before they had AI companies - and in many cases, before they worked in the industry, or before the industry existed.

The people at AI companies are no more likely to raise the alarm about AI dangers than people who were never at AI companies, or people who were previously at AI companies but have since quit.

  1. Scott Alexander Essayist; writes Astral Codex Ten The people at AI companies are no more likely to raise the alarm about AI dangers than people who were never at AI companies, or people who were previously at AI companies but have since quit. AI Safety Is Not A Corporate Plotastralcodexten.com · 15 Oct 2026
    The people at AI companies are no more likely to raise the alarm about AI dangers than people who were never at AI companies, or people who were previously at AI companies but have since quit.

Effective altruism's record is worth defending, and its global-health and far-future work share one root

Our label. 5 claims in Scott Alexander's own words.

Effective altruism's work on the far future is not a bait and switch hiding behind its work on global health; both halves are worth defending.

  1. Scott Alexander Essayist; writes Astral Codex Ten EA has done a great job working on this (see list of accomplishments above), and I think the AI and x-risk people have just as much to be proud of as the global health and animal welfare people. In Continued Defense Of Effective Altruismastralcodexten.com · 28 Nov 2023All korrents from this piece
    EA has done a great job working on this (see list of accomplishments above), and I think the AI and x-risk people have just as much to be proud of as the global health and animal welfare people.

The people who can be moved by deaths from neglected tropical diseases are the same people who can be moved by pandemics and by AI risk, because both come from reasoning about importance rather than from the news.

  1. Scott Alexander Essayist; writes Astral Codex Ten And I notice that the tiny handful of people capable of caring about 200,000 people dying of neglected tropical diseases are the same tiny handful of people capable of caring about the next pandemic, or superintelligence, or human extinction. In Continued Defense Of Effective Altruismastralcodexten.com · 28 Nov 2023All korrents from this piece
    And I notice that the tiny handful of people capable of caring about 200,000 people dying of neglected tropical diseases are the same tiny handful of people capable of caring about the next pandemic, or superintelligence, or human extinction.

Effective altruism's scandals are minor next to its record, and its ratio of accomplishments to scandals is as good as that of any large institution.

  1. Scott Alexander Essayist; writes Astral Codex Ten I think EA’s track record of accomplishments vs. scandals is as good as any of them, maybe better. In Continued Defense Of Effective Altruismastralcodexten.com · 28 Nov 2023All korrents from this piece
    I think EA’s track record of accomplishments vs. scandals is as good as any of them, maybe better.

The best opportunities to do good are the ones almost nobody is paying attention to.

  1. Scott Alexander Essayist; writes Astral Codex Ten These skewed priorities are the exact problem that effective altruism exists to solve - or the exact inefficiency that effective altruism exists to exploit, if you prefer that framing. In Continued Defense Of Effective Altruismastralcodexten.com · 28 Nov 2023All korrents from this piece
    These skewed priorities are the exact problem that effective altruism exists to solve - or the exact inefficiency that effective altruism exists to exploit, if you prefer that framing.
  2. Holden Karnofsky Co-founder of GiveWell Indeed, I think some of the best opportunities to do good in the world come from working on issues that aren't yet widely recognized as huge moral issues of our time. Future-proof ethicscold-takes.com · 2 Feb 2022All korrents from this piece
    Indeed, I think some of the best opportunities to do good in the world come from working on issues that aren't yet widely recognized as huge moral issues of our time.

Movements are coalitions, and often the same people hold both of a movement's priorities rather than trading one off against the other.

  1. Scott Alexander Essayist; writes Astral Codex Ten Movements are coalitions. Sometimes this means different people with different priorities choose to work together. But other times it means the same people tend to share both priorities. In Continued Defense Of Effective Altruismastralcodexten.com · 28 Nov 2023All korrents from this piece
    Movements are coalitions. Sometimes this means different people with different priorities choose to work together. But other times it means the same people tend to share both priorities.

Forecasting can turn judgment calls into checkable bets, and cheap AI forecasters are coming

Our label. 1 claim in Scott Alexander's own words.

Prediction markets are notoriously bad at handling very small probabilities.

  1. Scott Alexander Essayist; writes Astral Codex Ten Polymarket is currently at 5% for WHO declaring plague a “pandemic”, but markets are notoriously bad at handling very small probabilities, so I don’t take it seriously as a counter to the sources above. Top Forecasters On The Plagueastralcodexten.com · 7 Oct 2026
    Polymarket is currently at 5% for WHO declaring plague a “pandemic”, but markets are notoriously bad at handling very small probabilities, so I don’t take it seriously as a counter to the sources above.

Trauma-focused therapies such as EMDR help people process trauma

Our label. 3 claims in Scott Alexander's own words.

Eye movement reprocessing went from alternative to establishment, and moving your eyes while talking about a trauma does seem to help you process it.

  1. Scott Alexander Essayist; writes Astral Codex Ten Eye movement directed reprocessing (alternative when the book was written, now basically establishment) where you move your eyes back and forth while talking about your trauma, and this seems to somehow help you process it better. Book Review: The Body Keeps The Scoreslatestarcodex.com · 12 Nov 2019
    Eye movement directed reprocessing (alternative when the book was written, now basically establishment) where you move your eyes back and forth while talking about your trauma, and this seems to somehow help you process it better.

If negative emotion comes from underweighting sensory evidence, that explains EMDR: it forces high-precision attention onto something the mind usually represses.

  1. Scott Alexander Essayist; writes Astral Codex Ten First, it justifies various psychotherapies - EMDR and coherence therapy seem to come out especially well here - that focus on trying to get the brain to pay unusually precise attention, under unusually safe conditions, to something it usually represses. The Precision Of Sensory Evidenceastralcodexten.com · 13 Feb 2021
    First, it justifies various psychotherapies - EMDR and coherence therapy seem to come out especially well here - that focus on trying to get the brain to pay unusually precise attention, under unusually safe conditions, to something it usually represses.

Somebody with trauma should try a trauma-focused therapy such as EMDR before treating their nightmares directly.

  1. Scott Alexander Essayist; writes Astral Codex Ten I would recommend that anyone who thinks they're suffering from trauma (eg PTSD) try a trauma-focused therapy like EMDR before trying to address nightmares directly, unless the nightmares are overwhelmingly worse than all their other trauma symptoms. Peer Review: Nightmaresastralcodexten.com · 16 Jun 2022
    I would recommend that anyone who thinks they're suffering from trauma (eg PTSD) try a trauma-focused therapy like EMDR before trying to address nightmares directly, unless the nightmares are overwhelmingly worse than all their other trauma symptoms.