Our readingWhat is a korrent?
For a Qwen-sized vocabulary, a moderate entropy of around one to three is probably good, while zero or the maximum of about 11 would be bad.
Drawn from what Sebastian Raschka said
SubjectLLMs
Our readingWhat is a korrent?
Drawn from what Sebastian Raschka said
So we want maybe in an entropy that is around one, I would say it's good in this case, like zero would be bad. Um, 11 would be certainly also very bad. So like a moderate entropy of like, yeah, one, two, three, something like that.
Added to korrents 9 Nov 2026 · How quotes work · Something wrong? Tell us
Do you hold this korrent?Do you also believe this?
I hold this tooShared subject first, then similar wording. They may agree or disagree.