korrents

Our readingWhat is a korrent?

Directly optimizing prompt embeddings (prefix-tuning) yields better performance than even a single optimized text prompt.

Drawn from what Gwern said

What this subject means

transformers The architecture that dropped recurrence in favour of attention, and that almost every large model since is built on.

What Gwern actually said

  1. Gwern Pseudonymous essayist
    The fact that the prefix-tuning, by directly optimizing the prompt embeddings, yields better performance than even single optimized text prompts, suggests so.

Added to korrents 25 Sept 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map