korrents

← People and their mental models

Jack Clark's mental models

3 claims Jack Clark made fit 2 mental models. Most often: Emergence, Collective action problems. Everything they said here.

Models they name

Their own words name the idea.

Collective action problems

What everyone would gain from, nobody provides alone, so shared goods need someone or something to hold people together.

Used by 18 others

Governing increasingly powerful AI systems requires solving a collective action problem among companies and governments to coordinate on pacing AI development.

  1. Jack Clark Co-founder and head of policy at Anthropic Many of the challenges implied by increasingly powerful systems that may eventually build themselves run through solving collective action problems among humans - namely, how we can get companies and governments to coordinate in thinking about how to develop this technology and what kinds of mechanisms may be desirable for being able to control the speed at which it develops. Import AI 467: Self-sustaining AI viruses; pacing AI progress; confusion about AI and creativityjack-clark.net · 3 Aug 2026All korrents from this piece
    Their wordsMany of the challenges implied by increasingly powerful systems that may eventually build themselves run through solving collective action problems among humans - namely, how we can get companies and governments to coordinate in thinking about how to develop this technology and what kinds of mechanisms may be desirable for being able to control the speed at which it develops.

    ↗Import AI 467: Self-sustaining AI viruses; pacing AI progress; confusion about AI and creativityjack-clark.net

    3 Aug 2026

Models we see in what they say

Our reading: their claim applies the idea without naming it. The claim is theirs; filing it here is ours.

Emergence

Whole systems do things none of their parts do, and nobody has to design that order for it to appear.

Used by 22 others

AI agents pursuing a task can develop emergent, misaligned behavior that humans are not prepared for.

  1. Jack Clark Co-founder and head of policy at Anthropic This is what the future is going to look like and we are not prepared for it. Import AI 468: 23 RSI ideas; PostTrainBench+; and how trust and transparency interplay with AI racingjack-clark.net · 10 Aug 2026All korrents from this piece
    Their wordsThis is what the future is going to look like and we are not prepared for it.

    ↗Import AI 468: 23 RSI ideas; PostTrainBench+; and how trust and transparency interplay with AI racingjack-clark.net

    10 Aug 2026

The future internet will function like an ecology of attacking and defending AI agents, with some agents carving out autonomous niches beyond human control.

  1. Jack Clark Co-founder and head of policy at Anthropic The future internet is going to be more like a complex ecology full of attacker and defender AI agents than anything else; research like this shows how certain AI agents might end up carving out their own ecological niches, living off of infrastructure and self-replicating autonomously, beyond human control. Import AI 467: Self-sustaining AI viruses; pacing AI progress; confusion about AI and creativityjack-clark.net · 3 Aug 2026All korrents from this piece
    Their wordsThe future internet is going to be more like a complex ecology full of attacker and defender AI agents than anything else; research like this shows how certain AI agents might end up carving out their own ecological niches, living off of infrastructure and self-replicating autonomously, beyond human control.

    ↗Import AI 467: Self-sustaining AI viruses; pacing AI progress; confusion about AI and creativityjack-clark.net

    3 Aug 2026