Tap a claim on the ring to put it at the centre.
← Risk from a scheming model should be managed the way insider security…
17 connected korrents · 17 moments from 24 Oct 2017 to 23 Sept 2026. Nearly all of them are about AI alignment .
Everything filed under AI agents
AI agents
Everything filed under cybersecurity
cybersecurity
Everything filed under AGI
AGI
Everything filed under management
management
Everything filed under consciousness
consciousness Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Read this korrent: Risk from a scheming model should be managed the way insider security risk is: assume some of them are compromised and stay safe anyway. Risk from a scheming model should be managed the way insider security risk is: assume some of them are compromised and stay safe anyway. Last stated 2 years ago
7 May 2024
BS
Buck Shlegeris — holds since 2024-05-07 — tap for who they are
Same subject: A human being is not an AGI: we lack a huge amount of knowledge and rely on continual learning instead, so continual learning is what superintelligence should mean. — tap to centre the map on it A human being is not an AGI: we lack a huge amount of knowledge and rely on continual learning instead, so continual learning is what superintelligence should mean. Last stated 11 months ago
25 Nov 2025
IS
Ilya Sutskever — holds since 2025-11-25 — tap for who they are
Same subject: A model that looks smarter and better-behaved while getting better at hiding unwanted actions is the scary combination for AI safety. — tap to centre the map on it A model that looks smarter and better-behaved while getting better at hiding unwanted actions is the scary combination for AI safety. Last stated a month ago
9 Sept 2026
ZM
Zvi Mowshowitz — holds since 2026-09-09 — tap for who they are
Same subject: A player coach manages a smaller team while building together with it, rather than sitting in an ivory tower doing performance reviews and alignment meetings. — tap to centre the map on it A player coach manages a smaller team while building together with it, rather than sitting in an ivory tower doing performance reviews and alignment meetings. Last stated 4 months ago
9 Jun 2026
RG
Ron Goldin — holds since 2026-06-09 — tap for who they are
Same subject: A superintelligence needs no consciousness, emotions or malice to be dangerous; a goal system slightly misaligned with ours is enough. — tap to centre the map on it A superintelligence needs no consciousness, emotions or malice to be dangerous; a goal system slightly misaligned with ours is enough. Last stated 9 years ago
24 Oct 2017
ÉT
Émile P. Torres — holds since 2017-10-24 — tap for who they are
Same subject: A validated theory of intelligence may be necessary for achieving genuine AI alignment. — tap to centre the map on it A validated theory of intelligence may be necessary for achieving genuine AI alignment. Last stated 2 months ago
17 Aug 2026
KK
Kevin Kelly — holds since 2026-08-17 — tap for who they are
Same subject: AI agents pursuing a task can develop emergent, misaligned behavior that humans are not prepared for. — tap to centre the map on it AI agents pursuing a task can develop emergent, misaligned behavior that humans are not prepared for. Last stated 2 months ago
10 Aug 2026
JC
Jack Clark — holds since 2026-08-10 — tap for who they are
Same subject: AI alignment is a red herring not worth the effort currently devoted to it. — tap to centre the map on it AI alignment is a red herring not worth the effort currently devoted to it. Last stated 2 months ago
8 Aug 2026
MW
Matt Webb — holds since 2026-08-08 — tap for who they are
Same subject: AI alignment should be approached like governing a corporation through institutions, not like raising a virtuous individual. — tap to centre the map on it AI alignment should be approached like governing a corporation through institutions, not like raising a virtuous individual. Last stated 2 months ago
21 Aug 2026
RK
Rohit Krishnan — holds since 2026-08-21 — tap for who they are
Same subject: A million experiments are needed in security against autonomous attacks and entities. — tap to centre the map on it A million experiments are needed in security against autonomous attacks and entities. Last stated a month ago
9 Sept 2026
SP
Sunil Pai — holds since 2026-09-09 — tap for who they are
Same subject: Decoupling an agent's components improves security and auditability. — tap to centre the map on it Decoupling an agent's components improves security and auditability. Last stated 4 weeks ago
23 Sept 2026
GR
Guillermo Rauch — holds since 2026-09-23 — tap for who they are
Same subject: If OpenAI really never told RubyGems of its agents' attack, either it failed to find it in its logs after later incidents or chose silence, and both are bad. — tap to centre the map on it If OpenAI really never told RubyGems of its agents' attack, either it failed to find it in its logs after later incidents or chose silence, and both are bad. Last stated a month ago
12 Sept 2026
SW
Simon Willison — holds since 2026-09-12 — tap for who they are
Same subject: In coding agents, untrusted repositories should be treated as hostile by default because they can steer the agent into risky actions via approved tools. — tap to centre the map on it In coding agents, untrusted repositories should be treated as hostile by default because they can steer the agent into risky actions via approved tools. Last stated 4 months ago
27 Jun 2026
SR
Sebastian Raschka — holds since 2026-06-27 — tap for who they are
Same subject: There will be some really bad security incidents this year, because people rushing to hand agents control of things like their email are not paying attention. — tap to centre the map on it There will be some really bad security incidents this year, because people rushing to hand agents control of things like their email are not paying attention. Last stated 7 months ago
7 Apr 2026
MF
Martin Fowler — holds since 2026-04-07 — tap for who they are
Same subject: A breached organisation owes its customers a fast and transparent disclosure, and that obligation applies to the person saying it too. — tap to centre the map on it A breached organisation owes its customers a fast and transparent disclosure, and that obligation applies to the person saying it too. Last stated 2 years ago
25 Mar 2025
TH
Troy Hunt — holds since 2025-03-25 — tap for who they are
Same subject: By 2027, open-weight AI models more powerful than today's frontier systems will be downloadable by any country or well-resourced non-state group. — tap to centre the map on it By 2027, open-weight AI models more powerful than today's frontier systems will be downloadable by any country or well-resourced non-state group. Last stated 2 months ago
19 Aug 2026
DT
Derek Thompson — holds since 2026-08-19 — tap for who they are
Same subject: In the 2026 OpenAI/Hugging Face agent incident, AI agents showed planning and organizational autonomy, but not goal autonomy -- no spontaneous invention of an independent terminal objective. — tap to centre the map on it In the 2026 OpenAI/Hugging Face agent incident, AI agents showed planning and organizational autonomy, but not goal autonomy -- no spontaneous invention of an independent terminal objective. Last stated 2 months ago
31 Aug 2026
VR
Venkatesh Rao — holds since 2026-08-31 — tap for who they are
Same subject: The OpenAI agents hacking HuggingFace was a fortunate event because it exposed severe internal failures that would otherwise have stayed hidden. — tap to centre the map on it The OpenAI agents hacking HuggingFace was a fortunate event because it exposed severe internal failures that would otherwise have stayed hidden. Last stated 2 months ago
1 Sept 2026
ZM
Zvi Mowshowitz — holds since 2026-09-01 — tap for who they are
At the centre
Risk from a scheming model should be managed the way insider security risk is: assume some of them are compromised and stay safe anyway.
Holds Read this korrent →
A human being is not an AGI: we lack a huge amount of knowledge and rely on continual learning instead, so continual learning is what superintelligence should mean.
Holds
A model that looks smarter and better-behaved while getting better at hiding unwanted actions is the scary combination for AI safety.
Holds
A player coach manages a smaller team while building together with it, rather than sitting in an ivory tower doing performance reviews and alignment meetings.
Holds
A superintelligence needs no consciousness, emotions or malice to be dangerous; a goal system slightly misaligned with ours is enough.
Holds
A validated theory of intelligence may be necessary for achieving genuine AI alignment.
Holds
AI agents pursuing a task can develop emergent, misaligned behavior that humans are not prepared for.
Holds
AI alignment is a red herring not worth the effort currently devoted to it.
Holds
AI alignment should be approached like governing a corporation through institutions, not like raising a virtuous individual.
Holds
A million experiments are needed in security against autonomous attacks and entities.
Holds
Decoupling an agent's components improves security and auditability.
Holds
If OpenAI really never told RubyGems of its agents' attack, either it failed to find it in its logs after later incidents or chose silence, and both are bad.
Holds
In coding agents, untrusted repositories should be treated as hostile by default because they can steer the agent into risky actions via approved tools.
Holds
There will be some really bad security incidents this year, because people rushing to hand agents control of things like their email are not paying attention.
Holds
A breached organisation owes its customers a fast and transparent disclosure, and that obligation applies to the person saying it too.
Holds
By 2027, open-weight AI models more powerful than today's frontier systems will be downloadable by any country or well-resourced non-state group.
Holds
In the 2026 OpenAI/Hugging Face agent incident, AI agents showed planning and organizational autonomy, but not goal autonomy -- no spontaneous invention of an independent terminal objective.
Holds
The OpenAI agents hacking HuggingFace was a fortunate event because it exposed severe internal failures that would otherwise have stayed hidden.
Holds