korrents

On the map

Tap a claim on the ring to put it at the centre.

← A key uncertainty for activation oracles is whether the things worth auditing are salient enough in the activations.

13 connected korrents · 9 moments from 26 Jan 2025 to 26 Oct 2026. Nearly all of them are about LLMs.

Everything filed under AI alignment AI alignment Everything filed under AI agents AI agents Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: A key uncertainty for activation oracles is whether the things worth auditing are salient enough in the activations. A key uncertainty for activation oraclesis whether the things worth auditing aresalient enough in the activations. Last stated 11 months ago 20 Dec 2025 NN Neel Nanda — holds since 2025-12-20 — tap for who they are Same subject: Using a model as its own activation oracle introduces correlated risk if the model is misaligned. — tap to centre the map on it Using a model as its own activationoracle introduces correlated risk ifthe model is misaligned. Last stated 11 months ago 20 Dec 2025 NN Neel Nanda — holds since 2025-12-20 — tap for who they are Same subject: The more uncertain what follows a token, the more useful it is for a model to represent all relevant context on it. — tap to centre the map on it The more uncertain what follows atoken, the more useful it is for amodel to represent all relevantcontext on it. Last stated 11 months ago 20 Dec 2025 NN Neel Nanda — holds since 2025-12-20 — tap for who they are Same subject: Agent capabilities are perhaps improving faster than models' ability to act as activation oracles. — tap to centre the map on it Agent capabilities are perhapsimproving faster than models'ability to act as activationoracles. Last stated 11 months ago 20 Dec 2025 NN Neel Nanda — holds since 2025-12-20 — tap for who they are Same subject: Auditing properties that do not shape a model's actions is probably doomed, and weight-based interpretability has not gone well. — tap to centre the map on it Auditing properties that do notshape a model's actions is probablydoomed, and weight-basedinterpretability has not gone well. Last stated 11 months ago 20 Dec 2025 NN Neel Nanda — holds since 2025-12-20 — tap for who they are Same subject: "Hire smart people and get out of their way" is bad management advice; leaders should stay closely involved, building trust and working through hard problems with their people to create alignment. — tap to centre the map on it "Hire smart people and get out oftheir way" is bad management advice;leaders should stay closelyinvolved, building trust and workingthrough hard problems with theirpeople to create alignment. Last stated a month ago 9 Oct 2026 CR Carl Rivera — holds since 2026-10-09 — tap for who they are Same subject: A 5% level of AI risk is crazy and unacceptable; we would not accept a 5% chance of massive fatalities from paint companies. — tap to centre the map on it A 5% level of AI risk is crazy andunacceptable; we would not accept a5% chance of massive fatalities frompaint companies. Last stated a year ago 8 Jul 2025 RG Ryan Greenblatt — holds since 2025-07-08 — tap for who they are Same subject: A big misreading of Chinese labs is missing that they have a risk posture and do not want to cause harm. — tap to centre the map on it A big misreading of Chinese labs ismissing that they have a riskposture and do not want to causeharm. Last stated 4 weeks ago 26 Oct 2026 NL Nathan Lambert — holds since 2026-10-26 — tap for who they are Same subject: A human being is not an AGI: we lack a huge amount of knowledge and rely on continual learning instead, so continual learning is what superintelligence should mean. — tap to centre the map on it A human being is not an AGI: we lacka huge amount of knowledge and relyon continual learning instead, socontinual learning is whatsuperintelligence should mean. Last stated 12 months ago 25 Nov 2025 IS Ilya Sutskever — holds since 2025-11-25 — tap for who they are Same subject: A proposal to pace frontier AI development is unrealistic and mainly serves political control of AI. — tap to centre the map on it A proposal to pace frontier AIdevelopment is unrealistic andmainly serves political control ofAI. Last stated 2 months ago 18 Sept 2026 BT Ben Thompson — holds since 2026-09-18 — tap for who they are Same subject: Abstract talk of AGI and superintelligence is too abstract; AI has to actually work. — tap to centre the map on it Abstract talk of AGI andsuperintelligence is too abstract;AI has to actually work. Last stated 2 years ago 26 Jan 2025 MA Marc Andreessen — holds since 2025-01-26 — tap for who they are Same subject: A feedback loop that reinforces a behavior pulls it toward whatever improves the loop's own score. — tap to centre the map on it A feedback loop that reinforces abehavior pulls it toward whateverimproves the loop's own score. Last stated 3 months ago 26 Aug 2026 HK Henrik Karlsson — holds since 2026-08-26 — tap for who they are Same subject: Behaviours like massively deluding humans or trying to seize control of assets could in principle generalise from reward hacking. — tap to centre the map on it Behaviours like massively deludinghumans or trying to seize control ofassets could in principle generalisefrom reward hacking. Last stated a year ago 8 Jul 2025 RG Ryan Greenblatt — holds since 2025-07-08 — tap for who they are Same subject: How aligned current models are depends a lot on things like their degree of reward hacking. — tap to centre the map on it How aligned current models aredepends a lot on things like theirdegree of reward hacking. Last stated 11 months ago 27 Dec 2025 NN Neel Nanda — holds since 2025-12-27 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre A key uncertainty for activation oracles is whether the things worth auditing are salient enough in the activations. Last stated 20 Dec 2025 · 11 months ago Holds Neel Nanda Read this korrent →