What Sebastian Raschka thinks about scaling laws

@sebastian-raschka · 16 positions · On ppll ↗

AI research engineer working on large language models. He writes the Ahead of AI newsletter and is the author of Build a Large Language Model (From Scratch).

Sebastian Raschka did not write this page.

We collected these quotes from things they published elsewhere, and every quote links to where it was said. They have no account here and have not endorsed this site. Quotes are word for word; the short line under each one is our own restatement, not their wording. Their own site. Is this you? Claim it or ask us to remove it. Or tell us what is wrong here.

Filter scaling laws · Newest first

Topic

All 16 LLMs 13 AI agents 2 coding agents 2 scaling laws 2 transformers 2 AI writing 1 cybersecurity 1 developer tools 1 neural networks 1

2 more topics

open source 1 reinforcement learning 1

Sort

Newest Oldest

Only Sebastian Raschka on scaling laws. See everyone on scaling laws

2 dated positions, 2026, in their own words. Our reading of what Sebastian Raschka has said — not written or endorsed by them.

2 positions so far — this page is not yet offered to search engines.

24 Oct 2026, 11:14 UTC

Our readingReasoning models are an upgrade from conventional LLMs achieved by adding post-training via reinforcement learning and optionally inference scaling.

LLMs reinforcement learning

Their wordsA reasoning model is essentially an upgrade from a conventional LLM, that is, adding more post-training via reinforcement learning with verifiable rewards (and optionally inference scaling techniques) to make it more capable of solving more challenging problems.

↗Building Reasoning Models from the Ground Up: A Video Coursemagazine.sebastianraschka.com
3 months earlier
18 Jul 2026

Our readingRaising inference-time reasoning effort on a smaller model can match the performance of a larger model run at lower effort.

Their wordsa smaller model at a higher reasoning effort can sometimes reach a similar score as a larger model at a lower reasoning effort

↗Controlling Reasoning Effort in LLMsmagazine.sebastianraschka.com 3rd of 3 in this piece