korrents

A korrentour readingWhat is a korrent?

As models keep scaling up, modularity will become essential to how they are developed.

Drawn from what Sebastian Ruder said

Subjectscaling laws
What this subject means

scaling laws Whether more compute keeps buying more capability, and where the curve now bends -- pre-training, post-training, test-time.

What Sebastian Ruder actually said

Word for word, with the source under each one. They did not write this page.

  1. Sebastian Ruder

    Research scientist at Meta working on multilingual models and evaluation

    Given the trend of pre-training larger and larger models, we believe modularity will be crucial.

    Where this was said

    ↗Modular Deep Learningruder.io

    All 2 korrents from this piecethis one is 1st

Added to korrents 23 Feb 2023 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

Sign in to record that you hold this, with a confidence number of your own.

Related korrents

Our reading — they may agree, disagree or merely touch the same thing. Closest first: a shared subject counts for most, then how near the wording is.

On the map

Loading the map… or open it on its own page

Open the map on its own page →