korrents

On the map

Tap a claim on the ring to put it at the centre.

← ML researchers may be underrating how much pressure there will be to…

17 connected korrents · 15 moments from 12 May 2023 to 10 Oct 2026.

Everything filed under AI alignment AI alignment Everything filed under LLMs LLMs Everything filed under reinforcement learning reinforcement learning Everything filed under innovation innovation Everything filed under AI and jobs AI and jobs Everything filed under AGI AGI Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: ML researchers may be underrating how much pressure there will be to move to less safe training strategies once their advantage over safer ones becomes apparent. ML researchers may be underrating how muchpressure there will be to move to lesssafe training strategies once theiradvantage over safer ones becomesapparent. Last stated 4 years ago 12 May 2023 AC Ajeya Cotra — holds since 2023-05-12 — tap for who they are Same subject: The AI safety community's fixation on a model escaping its box has pushed the other significant AI risks out of the discussion, with little progress to show for it. — tap to centre the map on it The AI safety community's fixationon a model escaping its box haspushed the other significant AIrisks out of the discussion, withlittle progress to show for it. Last stated 3 years ago 18 Mar 2024 SA Sam Altman — holds since 2024-03-18 — tap for who they are Same subject: Trying safety methods in practice reveals new ideas and failure modes, and that empirical learning is not as widely understood as it should be. — tap to centre the map on it Trying safety methods in practicereveals new ideas and failure modes,and that empirical learning is notas widely understood as it shouldbe. Last stated 3 years ago 8 Aug 2023 DA Dario Amodei — holds since 2023-08-08 — tap for who they are Same subject: AI help will probably be weaker the further the work is from ML research and software engineering. — tap to centre the map on it AI help will probably be weaker thefurther the work is from ML researchand software engineering. Last stated 9 months ago 17 Feb 2026 AC Ajeya Cotra — holds since 2026-02-17 — tap for who they are Same subject: Once AI starts to feel powerful rather than mistake-prone, every AI company will become far more paranoid about safety than it is today. — tap to centre the map on it Once AI starts to feel powerfulrather than mistake-prone, every AIcompany will become far moreparanoid about safety than it istoday. Last stated 12 months ago 25 Nov 2025 IS Ilya Sutskever — holds since 2025-11-25 — tap for who they are Same subject: AI safety probably gets harder from here, but it will not be solved by disconnecting from reality. — tap to centre the map on it AI safety probably gets harder fromhere, but it will not be solved bydisconnecting from reality. Last stated 3 months ago 23 Aug 2026 SA Sam Altman — holds since 2026-08-23 — tap for who they are Same subject: Once a few AI companies sign on to safety standards and they work, social pressure, and eventually perhaps legal pressure, could be put on holdouts. — tap to centre the map on it Once a few AI companies sign on tosafety standards and they work,social pressure, and eventuallyperhaps legal pressure, could be puton holdouts. Last stated 4 years ago 12 May 2023 AC Ajeya Cotra — holds since 2023-05-12 — tap for who they are Same subject: Relying on AI misbehavior appearing gradually during training to catch misalignment may fail at exactly the most dangerous time. — tap to centre the map on it Relying on AI misbehavior appearinggradually during training to catchmisalignment may fail at exactly themost dangerous time. Last stated 3 months ago 2 Sept 2026 ZM Zvi Mowshowitz — holds since 2026-09-02 — tap for who they are Same subject: Fear of AI's risks leads some people to argue for trading a lot of liberty for safety, and that argument tends to end up justifying power-seeking. — tap to centre the map on it Fear of AI's risks leads some peopleto argue for trading a lot ofliberty for safety, and thatargument tends to end up justifyingpower-seeking. Last stated 3 months ago 23 Aug 2026 SA Sam Altman — holds since 2026-08-23 — tap for who they are Same subject: A country outside the AI supply chain should just buy the index — which works only in the world where AI ends up commoditised rather than concentrated. — tap to centre the map on it A country outside the AI supplychain should just buy the index —which works only in the world whereAI ends up commoditised rather thanconcentrated. Last stated 6 months ago 4 Jun 2026 AI Alex Imas — holds since 2026-06-04 — tap for who they are Same subject: A language model is no substitute for a well-specified conventional algorithm, so it cannot simply be dropped into a complex problem and trusted. — tap to centre the map on it A language model is no substitutefor a well-specified conventionalalgorithm, so it cannot simply bedropped into a complex problem andtrusted. Last stated a year ago 7 Jun 2025 GM Gary Marcus — holds since 2025-06-07 — tap for who they are Same subject: A model that could learn effectively from raw bitstrings or bytestrings would be extremely powerful, able to learn from any data modality — tap to centre the map on it A model that could learn effectivelyfrom raw bitstrings or bytestringswould be extremely powerful, able tolearn from any data modality Last stated 3 years ago 10 Oct 2023 CH Chip Huyen — holds since 2023-10-10 — tap for who they are Same subject: A format reward should only be added when the answer is already correct. — tap to centre the map on it A format reward should only be addedwhen the answer is already correct. Last stated a month ago 10 Oct 2026 SR Sebastian Raschka — holds since 2026-10-10 — tap for who they are Same subject: A model should not be called a reasoning model unless it has been trained with reinforcement learning with verifiable rewards. — tap to centre the map on it A model should not be called areasoning model unless it has beentrained with reinforcement learningwith verifiable rewards. Last stated 2 months ago 3 Oct 2026 SR Sebastian Raschka — holds since 2026-10-03 — tap for who they are Same subject: A model trained with reinforcement learning might discover a language of its own that is better for thinking than English. — tap to centre the map on it A model trained with reinforcementlearning might discover a languageof its own that is better forthinking than English. Last stated 2 years ago 5 Feb 2025 AK Andrej Karpathy — holds since 2025-02-05 — tap for who they are Same subject: "Return on tokens" has the same measurement problems as hours and capacity: it still hinges on a theory of value. — tap to centre the map on it "Return on tokens" has the samemeasurement problems as hours andcapacity: it still hinges on atheory of value. Last stated 3 months ago 17 Aug 2026 JC John Cutler — holds since 2026-08-17 — tap for who they are Same subject: A badly written AI outbound email is evidence of a bad vendor, not of a limit of AI. — tap to centre the map on it A badly written AI outbound email isevidence of a bad vendor, not of alimit of AI. Last stated 11 months ago 1 Jan 2026 JL Jason Lemkin — holds since 2026-01-01 — tap for who they are Same subject: A base model is essentially a very expensive autocomplete that continues text according to the statistics of its training documents. — tap to centre the map on it A base model is essentially a veryexpensive autocomplete thatcontinues text according to thestatistics of its trainingdocuments. Last stated 2 years ago 5 Feb 2025 AK Andrej Karpathy — holds since 2025-02-05 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre ML researchers may be underrating how much pressure there will be to move to less safe training strategies once their advantage over safer ones becomes apparent. Last stated 12 May 2023 · 4 years ago Holds Ajeya Cotra Read this korrent →