Our readingWhat is a korrent?
Directly optimizing prompt embeddings (prefix-tuning) yields better performance than even a single optimized text prompt.
Drawn from what Gwern said
What this subject means
transformers The architecture that dropped recurrence in favour of attention, and that almost every large model since is built on.