korrents

Our readingWhat is a korrent?

When a format reward is simply added to the correctness reward, a model may over-emphasize the easy format reward and neglect correctness.

Drawn from what Sebastian Raschka said

What this subject means

reinforcement learning Training by reward: environments, verifiable tasks, value functions, and whether it works or merely beats what came before.

What Sebastian Raschka actually said

  1. Sebastian Raschka AI research engineer working on large language models
    And so what's likely happening here is that the model overemphasizes the format reward, so it's trying to get the think tags right, but then the real reward, the correctness reward gets neglected.

Added to korrents 9 Nov 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map