the polysemanticity of polysemanticity in language models

·LessWrong··

Polysemanticity is one of the most important concepts when it comes to mechanistic interpretability, basically, studying the internal representations of neural networks. For some reason, the concept of polysemanticity seems really, really fascinating to me, mostly due to how it kind of relates to superposition in quantum computing.I think polysemanticity is a concept best expressed through visualisation and this is my attempt at sort of presenting a simplified, illustrated overview of polysemant...

Read full article →

Related Articles

Top researchers leave USA for the Netherlands (in Dutch)
28304283409234 · Hacker News · 17h ago
Chat Control 1.0 and 2.0 Explained
gasull · Hacker News · 13h ago
GLM 5.2 and the coming AI margin collapse
martinald · Hacker News · 1d ago
GAO: DOE Is Prematurely Excluding Less Expensive Options for Nuclear Cleanup
Jimmc414 · Hacker News · 5h ago
OpenWrt One – Open Hardware Router
peter_d_sherman · Hacker News · 1d ago