korrents

korrents · piece

Distributing LLM inference in DwarfStar

Salvatore Sanfilippo · 25 May 2026

Read the piece on antirez.com ↗

2 korrents from this piece ↓

Salvatore Sanfilippo did not write this page.

Every claim below was made in this piece, quoted word for word and numbered in the order the piece makes them, so you can read it there rather than take our word for it. The sentence above each quote is our reading of the claim, not their wording. Each quote was checked against a stored copy of the page at build time; where the two differ, the quote is the fact.

  1. There is almost zero hope that NVIDIA setups will get less expensive, and even a small company can't afford to easily purchase and handle a small data center for local inference.
  2. Open weights models are now in a golden age, we have plenty and many are very powerful.

Keep reading

The other pieces are the ones whose claims are worded most like this one's. That measures language, not agreement: they may argue the opposite.