korrents
Miles Brundage

Miles Brundage

@miles-brundage · 33 positions · On ppll ↗

Independent AI policy researcher. Was head of policy research and then senior adviser for AGI readiness at OpenAI until October 2024, and now writes about AI governance from outside the labs.

Miles Brundage did not write this page.

We collected these quotes from things they published elsewhere, and every quote links to where it was said. They have no account here and have not endorsed this site. Quotes are word for word; the short line under each one is our own restatement, not their wording. Their own site. Is this you? Claim it or ask us to remove it. Or tell us what is wrong here.

4 of Miles Brundage's claims fit 3 mental models. Most often: Collective action problems, Incentives, Skin in the game.

Models they name

Their own words name the idea.

Incentives

Look at what people are rewarded for; it explains more behaviour than what they say, your own included.

Used by 85 others

Companies do not have sufficient incentives to mitigate the major risks of AI, and competition between them is driving corner-cutting.

  1. Miles Brundage Independent AI policy researcher Contrary to some people’s beliefs, companies do not in fact have sufficient incentives to mitigate all major risks, and competition is driving corner-cutting that needs to be reined in somehow. Some Very Important Things (That I Won't Be Working On This Year)milesbrundage.substack.com · 15 Feb 2025All korrents from this piece
    Contrary to some people’s beliefs, companies do not in fact have sufficient incentives to mitigate all major risks, and competition is driving corner-cutting that needs to be reined in somehow.

AI companies will not fix their own security without outside pressure, because they bear the cost of investing and everyone else bears the cost of their not investing.

Skin in the game

  1. Miles Brundage Independent AI policy researcher And while the costs of investing in security are largely borne by the company, the costs of under-investing are borne by a much larger set of actors, e.g. perhaps the country or world as a whole. Why Security Comes Firstmilesbrundage.substack.com · 10 Jan 2025All korrents from this piece
    And while the costs of investing in security are largely borne by the company, the costs of under-investing are borne by a much larger set of actors, e.g. perhaps the country or world as a whole.

Models we see in what they say

Our reading: their claim applies the idea without naming it. The claim is theirs; filing it here is ours.

Collective action problems

What everyone would gain from, nobody provides alone, so shared goods need someone or something to hold people together.

Used by 21 others

Without agreed rules of the road, AI companies and states will tend to cut corners on safety and compliance commitments.

  1. Miles Brundage Independent AI policy researcher Companies and countries are tempted to cut corners by default and would benefit from some rules of the road, at least if they're sure others will follow those rules. Some Recent Stuff I Wrotemilesbrundage.substack.com · 25 Sept 2025All korrents from this piece
    Companies and countries are tempted to cut corners by default and would benefit from some rules of the road, at least if they're sure others will follow those rules.

Effective governance of frontier AI requires three things together: agreed safety standards, incentives for developers to follow them, and evidence that they are being followed.

  1. Miles Brundage Independent AI policy researcher governing frontier AI requires standards for safety and security, incentives for the leading AI developers to follow those standards, and evidence that the standards are being followed. Standards, Incentives, and Evidence: The Frontier AI Governance Triadmilesbrundage.substack.com · 19 Jun 2025All korrents from this piece
    governing frontier AI requires standards for safety and security, incentives for the leading AI developers to follow those standards, and evidence that the standards are being followed.

Skin in the game

Trust the judgment of people who pay for being wrong over people who only comment.

Used by 8 others

AI companies will not fix their own security without outside pressure, because they bear the cost of investing and everyone else bears the cost of their not investing.

Incentives

  1. Miles Brundage Independent AI policy researcher And while the costs of investing in security are largely borne by the company, the costs of under-investing are borne by a much larger set of actors, e.g. perhaps the country or world as a whole. Why Security Comes Firstmilesbrundage.substack.com · 10 Jan 2025All korrents from this piece
    And while the costs of investing in security are largely borne by the company, the costs of under-investing are borne by a much larger set of actors, e.g. perhaps the country or world as a whole.