korrents

korrents · piece

NLP Research in the Era of LLMs

Sebastian Ruder · 19 Dec 2023

Read the piece on ruder.io ↗

3 korrents from this piece ↓

Sebastian Ruder did not write this page.

Every claim below was made in this piece, quoted word for word and numbered in the order the piece makes them, so you can read it there rather than take our word for it. The sentence above each quote is our reading of the claim, not their wording. Each quote was checked against a stored copy of the page at build time; where the two differ, the quote is the fact.

  1. while massive compute often achieves breakthrough results, its usage is often inefficient.
  2. recent LLMs are reaching the limits of text data online and repeating data eventually leads to diminishing returns
  3. In the near term, the largest models using the most compute will continue to be the most capable.

Keep reading

The other pieces are the ones whose claims are worded most like this one's. That measures language, not agreement: they may argue the opposite.