A korrentour readingWhat is a korrent?
Available online text data is becoming a limiting factor for AI training, and repeating it yields diminishing returns.
Drawn from what Sebastian Ruder said
SubjectLLMs
A korrentour readingWhat is a korrent?
Drawn from what Sebastian Ruder said
Word for word, with the source under each one. They did not write this page.
Research scientist at Meta working on multilingual models and evaluation
recent LLMs are reaching the limits of text data online and repeating data eventually leads to diminishing returns
Where this was said
↗NLP Research in the Era of LLMsruder.io
All 3 korrents from this piecethis one is 2nd
Added to korrents 19 Dec 2023 · How quotes work · Something wrong? Tell us
Our reading — they may agree, disagree or merely touch the same thing. Closest first: a shared subject counts for most, then how near the wording is.