A korrentour readingWhat is a korrent?
Every announcement of a longer context window hides the cost, which is that the model gets worse at following instructions.
Drawn from what Aravind Srinivas said
A korrentour readingWhat is a korrent?
Drawn from what Aravind Srinivas said
Word for word, with the source under each one. They did not write this page.
Co-founder and CEO of Perplexity, an AI answer engine
So most people, when they advertise new context window increase, they talk a lot about finding the needle in the haystack sort of evaluation metrics and less about whether there’s any degradation in the instruction following performance. So I think that’s where you need to make sure that throwing more information at a model doesn’t actually make it more confused.
Added to korrents 19 Jun 2024 · How quotes work · Something wrong? Tell us
Our reading — they may agree, disagree or merely touch the same thing. Closest first: a shared subject counts for most, then how near the wording is.