korrents

Our readingWhat is a korrent?

Linear probes are very strong classifiers, and attention-head probes are even stronger.

Drawn from what Neel Nanda said

What these subjects mean

transformers The architecture that dropped recurrence in favour of attention, and that almost every large model since is built on.

neural networks The architecture almost all modern machine learning is built on, and what changes when it gets deeper.

What Neel Nanda actually said

  1. Neel Nanda Runs the mechanistic interpretability team at Google DeepMind
    Linear probing is OP. Um and attention head probes are even more OP, but whatever.

Added to korrents 9 Nov 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map