A korrentour readingWhat is a korrent?
As models get better at following instructions, techniques like finetuning and constrained sampling for structured outputs will become less necessary
Drawn from what Chip Huyen said
A korrentour readingWhat is a korrent?
Drawn from what Chip Huyen said
Word for word, with the source under each one. They did not write this page.
Engineer and writer on machine-learning systems
I suspect that in the future, it'll be easier to get models to output exactly what we need with minimal prompting, and these techniques will become less important.
Where this was said
↗Generation configurations: temperature, top-k, top-p, and test time computehuyenchip.com
All 3 korrents from this piecethis one is 3rd
Added to korrents 16 Jan 2024 · How quotes work · Something wrong? Tell us
Our reading — they may agree, disagree or merely touch the same thing. Closest first: a shared subject counts for most, then how near the wording is.