korrents

A korrentour readingWhat is a korrent?

Language models perform better on benchmark problems released before their training data cutoff, indicating data contamination inflates scores.

Drawn from what Sebastian Ruder said

SubjectsLLMsbenchmarksscaling laws
What this subject means

scaling laws Whether more compute keeps buying more capability, and where the curve now bends -- pre-training, post-training, test-time.

What Sebastian Ruder actually said

Word for word, with the source under each one. They did not write this page.

  1. Sebastian Ruder

    Research scientist at Meta working on multilingual models and evaluation

    GPT models perform much better on coding problems released before their pre-training data cut-off.

    Where this was said

    ↗The Evolving Landscape of LLM Evaluationruder.io

    All 2 korrents from this piecethis one is 1st

Added to korrents 13 May 2024 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

Sign in to record that you hold this, with a confidence number of your own.

Related korrents

Our reading — they may agree, disagree or merely touch the same thing. Closest first: a shared subject counts for most, then how near the wording is.

On the map

Loading the map… or open it on its own page

Open the map on its own page →