korrents

A korrentour readingWhat is a korrent?

Every announcement of a longer context window hides the cost, which is that the model gets worse at following instructions.

Drawn from what Aravind Srinivas said

A private bookmark. Not a position, and never counted.

What Aravind Srinivas actually said

Word for word, with the source under each one. They did not write this page.

  1. Aravind Srinivas

    Co-founder and CEO of Perplexity, an AI answer engine

    So most people, when they advertise new context window increase, they talk a lot about finding the needle in the haystack sort of evaluation metrics and less about whether there’s any degradation in the instruction following performance. So I think that’s where you need to make sure that throwing more information at a model doesn’t actually make it more confused.

Added to korrents 19 Jun 2024 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

Sign in to record that you hold this, with a confidence number of your own.

Related korrents

Our reading — they may agree, disagree or merely touch the same thing. Closest first: a shared subject counts for most, then how near the wording is.

See this on the map →