korrents

A korrentour readingWhat is a korrent?

Post-training is what turns a model into a product, but it can only do that on top of a pre-trained model large enough to already have common sense.

Drawn from what Aravind Srinivas said

scaling laws Whether more compute keeps buying more capability, and where the curve now bends -- pre-training, post-training, test-time.

A private bookmark. Not a position, and never counted.

What Aravind Srinivas actually said

Word for word, with the source under each one. They did not write this page.

  1. Aravind Srinivas

    Co-founder and CEO of Perplexity, an AI answer engine

    And without good post-training, you’re not going to have a good product. But at the same time, without good pre-training, there’s not enough common sense to actually have the post-training have any effect.

Added to korrents 19 Jun 2024 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

Sign in to record that you hold this, with a confidence number of your own.

Related korrents

Our reading — they may agree, disagree or merely touch the same thing. Closest first: a shared subject counts for most, then how near the wording is.

See this on the map →