korrents

Our readingWhat is a korrent?

Using token-level or sequence-level log probabilities is almost a hyperparameter choice, with good reasons for each.

Drawn from what Sebastian Raschka said

design
What this subject means

design How things should be made and judged: what makes a design good, who should do the designing, and what an interface is for.

What Sebastian Raschka actually said

  1. Sebastian Raschka AI research engineer working on large language models
    Yeah, so if we drop the one over T, the token normalization, if we just have the sum, the sum log probability, that would be the sequence level one. And yeah, it's almost like a hyperparameter. And there are good reasons for each of those.

Added to korrents 9 Nov 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map