What Dex Horthy thinks about transformers

@dex-horthy · 26 positions · On ppll ↗

Founder of the agent company HumanLayer, author of the 12-factor agents principles, and the engineer who put the name "context engineering" on the practice.

Dex Horthy did not write this page.

We collected these quotes from things they published elsewhere, and every quote links to where it was said. They have no account here and have not endorsed this site. Quotes are word for word; the short line under each one is our own restatement, not their wording. Their own site. Is this you? Claim it or ask us to remove it. Or tell us what is wrong here.

Filter transformers · Newest first

Topic

All 26 transformers 1 coding agents 13 LLMs 9 software quality 6 design 3 vibe coding 3 developer tools 2 Anthropic 1 benchmarks 1

6 more topics

code generation 1 documentation 1 hiring 1 infrastructure 1 reinforcement learning 1 writing 1

Sort

Newest Oldest

Only Dex Horthy on transformers. See everyone on transformers

1 dated position, 2026, in their own words. Our reading of what Dex Horthy has said — not written or endorsed by them.

1 position so far — this page is not yet offered to search engines.

15 Jul 2026

Our readingContext engineering has stayed relevant for a year because it is grounded in how transformer attention works, and it will matter to anyone building on AI until post-transformer models arrive.

Their wordsI think context engineering has been so long lived because it's it's grounded in the fundamentals of how transformer attention works and until we have post transformer models or linear attention or whatever it is which who knows when that's going to happen context engineering will be interesting and important to anyone building on AI

↗Context engineering with Dex Horthyyoutube.com 3rd of 26 in this recording