korrents
Miles Brundage

What Miles Brundage thinks about AI alignment

@miles-brundage · 33 positions · 1 change of mind · On ppll ↗

Independent AI policy researcher. Was head of policy research and then senior adviser for AGI readiness at OpenAI until October 2024, and now writes about AI governance from outside the labs.

Miles Brundage did not write this page.

We collected these quotes from things they published elsewhere, and every quote links to where it was said. They have no account here and have not endorsed this site. Quotes are word for word; the short line under each one is our own restatement, not their wording. Their own site. Is this you? Claim it or ask us to remove it. Or tell us what is wrong here.

Filter AI alignment · Newest first
Topic
All 33AI alignment 14AGI 8LLMs 8behavioural science 3cybersecurity 3AI writing 2AI and jobs 1America 1attitude change 1
12 more topics
capitalism 1China 1data centers 1education 1government 1innovation 1investing 1management 1OpenAI 1politics 1scaling laws 1semiconductors 1
Sort
NewestOldest

Only Miles Brundage on AI alignment. See everyone on AI alignment

14 dated positions, 2024 to 2026, in their own words. Our reading of what Miles Brundage has said — not written or endorsed by them.

  1. Our readingCompetitive pressure among AI developers could cause loss of control even without anyone intending it

    Their wordsBut in a climate of rushed decisions and fierce competition, we could lose control over AI even if almost no one wants that outcome.

    ↗My speech at Borgo Laudato Si’milesbrundage.substack.com 1st of 3 in this piece

  3. Our readingAI loss-of-control risk could materialize within years, not decades

    Their wordsLoss of control is a risk for the next few years, not the next few decades as many experts once thought.

    ↗My speech at Borgo Laudato Si’milesbrundage.substack.com 3rd of 3 in this piece

  4. 5 months earlier

  5. Our readingGiven the current pace of AI capabilities relative to governance, society will at best avoid only the worst-case outcomes, not the merely very bad ones.

    Their wordsWe need to accept that at best, we will just barely avoid some of the worst case scenarios (e.g., an AI-enabled biological weapon that kills billions, a rogue AI takeover, or stable global totalitarianism enabled by AI), given the current pace of AI capabilities relative to the pace of governance.

    ↗We're in Triage Mode for AI Policymilesbrundage.substack.com 1st of 3 in this piece

  6. 5 months earlier

  7. Our readingWithout agreed rules of the road, AI companies and states will tend to cut corners on safety and compliance commitments.

    Their wordsCompanies and countries are tempted to cut corners by default and would benefit from some rules of the road, at least if they're sure others will follow those rules.

    ↗Some Recent Stuff I Wrotemilesbrundage.substack.com 1st of 3 in this piece

  9. Our readingAI capabilities will keep advancing rapidly, creating serious risks by default that can still be mitigated through deliberate foresight and action.

    Their wordsthe perspective I outline is very bullish on AI capabilities and very concerned about the risks which may arise by default, but also hopeful that, through foresight and vigorous action, we can mitigate the worst of these risks.

    ↗Some Recent Stuff I Wrotemilesbrundage.substack.com 2nd of 3 in this piece

  10. 2 months earlier

  11. Our readingToday's approach to frontier AI assessment is superficial last-minute product testing rather than real auditing, threatening safety, stability, and commercial adoption of AI

    Their wordsThe state-of-the-art today can be more accurately described as "last-minute, black-box product testing" rather than auditing, and I think this situation threatens public safety, international stability, and sustainable commercial adoption of AI.

    ↗AI Auditing 2027milesbrundage.substack.com

  12. 4 weeks earlier

  13. Our readingEffective governance of frontier AI requires three things together: agreed safety standards, incentives for developers to follow them, and evidence that they are being followed.

    Their wordsgoverning frontier AI requires standards for safety and security, incentives for the leading AI developers to follow those standards, and evidence that the standards are being followed.

    ↗Standards, Incentives, and Evidence: The Frontier AI Governance Triadmilesbrundage.substack.com 1st of 3 in this piece

  15. Our readingAs AI systems become more capable, the danger of false or unverifiable safety claims grows, pushing competing companies toward cutting corners.

    Their wordsAs AI gets more capable, the risks associated with mistaken claims, fraudulent claims, or too-vague-to-be-verified claims will increase, and a cloud of suspicion between competitors could drive corner-cutting (indeed, this is happening already and could get worse).

    ↗Standards, Incentives, and Evidence: The Frontier AI Governance Triadmilesbrundage.substack.com 2nd of 3 in this piece

  16. 1 day earlier

  17. Our readingAn international AI safety body modeled on the IAEA would not by itself be enough to prevent AI-related geopolitical crises.

    Their wordsthe current situation in Iran shows that even if an "IAEA for AI" is necessary for some purposes, it won't be sufficient for resolving the tricky geopolitical issues raised by AI.

    ↗Iran and the opportunities and limits of an “IAEA for AI”milesbrundage.substack.com 2nd of 3 in this piece

  19. Our readingThe time between deciding to cross a dangerous AI capability threshold and actually crossing it could be extremely short, even seconds.

    Their wordsWith AI, breakout times could conceivably be very short - it could be hours, minutes, or even seconds for some very specific but important change to occur.

    ↗Iran and the opportunities and limits of an “IAEA for AI”milesbrundage.substack.com 3rd of 3 in this piece

  20. 4 months earlier

  21. Our readingCompanies do not have sufficient incentives to mitigate the major risks of AI, and competition between them is driving corner-cutting.

    Their wordsContrary to some people’s beliefs, companies do not in fact have sufficient incentives to mitigate all major risks, and competition is driving corner-cutting that needs to be reined in somehow.

    ↗Some Very Important Things (That I Won't Be Working On This Year)milesbrundage.substack.com 2nd of 2 in this piece

  22. 5 weeks earlier

  23. Our readingSecuring model weights against theft is a more urgent policy priority than safety research, because security is built out of atoms and takes calendar time that safety does not.

    Their wordsIncreasing the incentive and technical ability of AI companies to have good security is a very high priority, and in my view even more urgent than safety (though that’s also very important).

    ↗Why Security Comes Firstmilesbrundage.substack.com 2nd of 2 in this piece

  24. 3 weeks earlier

  25. Our readingAdvanced AI is close enough that the preparations which take years have to be started now, whichever end of the expert range you believe.

    Their wordsIf there are ways that you can help improve the governance of AI in these and other countries, you should be doing it now or in the next few months, not planning for ways to have an impact several years from now.

    ↗Time's Up for AI Policymilesbrundage.substack.com 2nd of 4 in this piece

  27. Our readingOnce model weights leave their owner's control the loss is irreversible, which is why securing them is the precondition for governing AI at all.

    Their wordsIf you can’t control where AI weights go (i.e., prevent leaking or theft), you can’t govern the technology.

    ↗Time's Up for AI Policymilesbrundage.substack.com 4th of 4 in this piece