Training is no longer limited by data but by compute, because most of the data models learn from is now synthetic.

Added to korrents 23 Mar 2026 · How quotes work · Something wrong? Tell us

Related korrents

Our reading — they may agree, disagree or merely touch the same thing.

• Scaling laws are still working, but the models people actually use run a few months behind the maximum capability Google can deliver, because the biggest model is too slow and expensive to serve. SPSundar Pichai5 Jun 2025similar wording
  Interesting
• Large language models could still plateau, and that possibility should be held open even though no evidence of it has appeared. DHDavid Heinemeier Hansson26 Aug 2026similar wording
  Interesting
• Current AI struggles even to rediscover old laws of physics from data, and when it does, contamination from training is the first suspect. TTTerence Tao14 Jun 2025similar wording
  Interesting
• If nobody creates content any more because everyone just asks an AI, there is nothing left for AI to train on. PLPieter Levels8 Aug 2026similar wording
  Interesting
• The cost of compute is the only intrinsic limit on AI self-replication; every other constraint on agents will have to be built by humans. DBDean W. Ball1 Sept 2026similar wording
  Interesting

See this on the map →