korrents

On the map

Tap a claim on the ring to put it at the centre.

← Many people would like to get rid of tokens and use character- or…

17 connected korrents · 14 moments from 18 Mar 2024 to 3 Nov 2026.

Everything filed under LLMs LLMs Everything filed under Anthropic Anthropic Everything filed under open source open source Everything filed under OpenAI OpenAI Everything filed under code generation code generation Everything filed under cybersecurity cybersecurity Everything filed under design design Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: Many people would like to get rid of tokens and use character- or byte-level models, but no one yet knows how to handle the very long sequences that would create. Many people would like to get rid oftokens and use character- or byte-levelmodels, but no one yet knows how to handlethe very long sequences that would create. Last stated 2 years ago 5 Feb 2025 AK Andrej Karpathy — holds since 2025-02-05 — tap for who they are Same subject: Humans are not well placed to write the token sequences a model should reason with; the model needs to discover what works for it. — tap to centre the map on it Humans are not well placed to writethe token sequences a model shouldreason with; the model needs todiscover what works for it. Last stated 2 years ago 5 Feb 2025 AK Andrej Karpathy — holds since 2025-02-05 — tap for who they are Same subject: The case for sweating every line of code was premised on humans doing the modifications, and it now survives only because tokens are scarce. — tap to centre the map on it The case for sweating every line ofcode was premised on humans doingthe modifications, and it nowsurvives only because tokens arescarce. Last stated 3 months ago 26 Aug 2026 DH David Heinemeier Hansson — holds since 2026-08-26 — tap for who they are Same subject: Developers should move the tokens in their .env files, which agents freely use, into a safer place where agents cannot use them however they like. — tap to centre the map on it Developers should move the tokens intheir .env files, which agentsfreely use, into a safer place whereagents cannot use them however theylike. Last stated 2 months ago 15 Sept 2026 KD Kent C. Dodds — holds since 2026-09-15 — tap for who they are Same subject: Using token-level or sequence-level log probabilities is almost a hyperparameter choice, with good reasons for each. — tap to centre the map on it Using token-level or sequence-levellog probabilities is almost ahyperparameter choice, with goodreasons for each. Last stated 2 months ago 3 Oct 2026 SR Sebastian Raschka — holds since 2026-10-03 — tap for who they are Same subject: The smartest models will need fewer tokens because they will not need to check their work; they will just be right. — tap to centre the map on it The smartest models will need fewertokens because they will not need tocheck their work; they will just beright. Last stated 3 weeks ago 3 Nov 2026 TS Thariq Shihipar — holds since 2026-11-03 — tap for who they are Same subject: Language models should be thought of as somewhat out of date, because pre-training is too expensive to repeat often. — tap to centre the map on it Language models should be thought ofas somewhat out of date, becausepre-training is too expensive torepeat often. Last stated 2 years ago 27 Feb 2025 AK Andrej Karpathy — holds since 2025-02-27 — tap for who they are Same subject: A language model is not a person: it has no persistent existence, booting up for a conversation and then shutting off. — tap to centre the map on it A language model is not a person: ithas no persistent existence, bootingup for a conversation and thenshutting off. Last stated 2 years ago 5 Feb 2025 AK Andrej Karpathy — holds since 2025-02-05 — tap for who they are Same subject: Models are enormous only because the internet is bad: most of that capacity does memory work, and a better dataset would need far less of it. — tap to centre the map on it Models are enormous only because theinternet is bad: most of thatcapacity does memory work, and abetter dataset would need far lessof it. Last stated a year ago 17 Oct 2025 AK Andrej Karpathy — holds since 2025-10-17 — tap for who they are Same subject: A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. — tap to centre the map on it A PHP vulnerability found withGPT-5.6 Sol will cause havoc thisweek. Last stated a month ago 21 Oct 2026 PS Peter Steinberger — holds since 2026-10-21 — tap for who they are Same subject: A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. — tap to centre the map on it A startup should not begin life as anonprofit and bolt a for-profit armon later, whatever OpenAI's ownhistory suggests. Last stated 3 years ago 18 Mar 2024 SA Sam Altman — holds since 2024-03-18 — tap for who they are Same subject: Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. — tap to centre the map on it Advertising was a necessary phasefor the internet but a momentaryindustry, and an AI people pay foris better because they know theanswers are not influenced byadvertisers. Last stated 3 years ago 18 Mar 2024 SA Sam Altman — holds since 2024-03-18 — tap for who they are Same subject: A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither. — tap to centre the map on it A business making hundreds ofmillions from an open source projectowes it money or contribution, andcan be refused its trademarks if itgives neither. Last stated 2 years ago 26 Sept 2024 MM Matt Mullenweg — holds since 2024-09-26 — tap for who they are Same subject: A codec does not really exist until everyone can decode it. — tap to centre the map on it A codec does not really exist untileveryone can decode it. Last stated 6 months ago 31 May 2026 JK Jean-Baptiste Kempf — holds since 2026-05-31 — tap for who they are Same subject: A company that will not accept a project’s terms is free to go and use a more permissive project instead. — tap to centre the map on it A company that will not accept aproject’s terms is free to go anduse a more permissive projectinstead. Last stated 2 years ago 26 Sept 2024 MM Matt Mullenweg — holds since 2024-09-26 — tap for who they are Same subject: "I don't know" becomes a kind of superpower when you can work with Claude Code to figure things out. — tap to centre the map on it "I don't know" becomes a kind ofsuperpower when you can work withClaude Code to figure things out. Last stated 8 months ago 19 Mar 2026 KP Kris Puckett — holds since 2026-03-19 — tap for who they are Same subject: A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year. — tap to centre the map on it A benchmark that ranks Claude Codelast while it stays first in use ismeasuring the wrong thing, and hasbeen for a year. Last stated 3 months ago 3 Sept 2026 DR Dax Raad — holds since 2026-09-03 — tap for who they are Same subject: A large share of Anthropic's revenue being consumption-based rather than subscriptions raises the question of how resilient that revenue is. — tap to centre the map on it A large share of Anthropic's revenuebeing consumption-based rather thansubscriptions raises the question ofhow resilient that revenue is. Last stated 3 weeks ago 2 Nov 2026 AA Azeem Azhar — holds since 2026-11-02 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre Many people would like to get rid of tokens and use character- or byte-level models, but no one yet knows how to handle the very long sequences that would create. Last stated 5 Feb 2025 · 2 years ago Holds Andrej Karpathy Read this korrent →