korrents

korrents · piece

The Illustrated GPT-OSS

Jay Alammar · 19 Aug 2025

Read the piece on newsletter.languagemodels.co ↗

2 korrents from this piece ↓

Jay Alammar did not write this page.

Every claim below was made in this piece, quoted word for word and numbered in the order the piece makes them, so you can read it there rather than take our word for it. The sentence above each quote is our reading of the claim, not their wording. Each quote was checked against a stored copy of the page at build time; where the two differ, the quote is the fact.

  1. Our reading

    Open source AI models today largely share similar architectural approaches, with little genuinely novel architecture left to introduce.

    Their wordsNote that little of these architectural details is particularly novel. They're generally similar in the latest SoTA open source MoE models.

  2. Our reading

    More reasoning gives a language model more time and compute to solve harder problems, but increases latency and compute cost.

    Their wordsOn the one hand, more reasoning allows the model more time and compute to reason about a problem which helps it tackle more difficult problems. On the other hand, that comes at a cost of latency and compute.

Keep reading