korrents

Our readingWhat is a korrent?

For a Qwen-sized vocabulary, a moderate entropy of around one to three is probably good, while zero or the maximum of about 11 would be bad.

Drawn from what Sebastian Raschka said

LLMs

What Sebastian Raschka actually said

  1. Sebastian Raschka AI research engineer working on large language models
    So we want maybe in an entropy that is around one, I would say it's good in this case, like zero would be bad. Um, 11 would be certainly also very bad. So like a moderate entropy of like, yeah, one, two, three, something like that.

Added to korrents 9 Nov 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map