A korrentour reading
LLM memory as currently built is a distraction to the model: one old question keeps resurfacing as if it were a lasting interest.
Drawn from what Andrej Karpathy said
In the currentLLMs
What is a korrent?
A korrent — “current”, with a K — is our reading of what someone said: one sentence, drawn from their own words below. People put the same thought in different words; a korrent tries to name the thought they share, so that what several people mean can be set side by side, and followed as it changes.
It is an approximation, and it is ours. The quotes are theirs, word for word, and where the two differ, the quote is the fact. Read more →