the polysemanticity of polysemanticity in language models

·LessWrong··

Polysemanticity is one of the most important concepts when it comes to mechanistic interpretability, basically, studying the internal representations of neural networks. For some reason, the concept of polysemanticity seems really, really fascinating to me, mostly due to how it kind of relates to superposition in quantum computing.I think polysemanticity is a concept best expressed through visualisation and this is my attempt at sort of presenting a simplified, illustrated overview of polysemant...

Read full article →

Related Articles

There's no reason for software to be slow anymore
Jach · Hacker News · 4h ago
Kobo can run apps now
thepoet · Hacker News · 13h ago
Malicious Rust crate Arrayref runs a build-time payload
abhisek · Hacker News · 1d ago
Japan tried to build an operating system for the world, the US intervened
rdmuser · Hacker News · 1d ago
AliExpress runs silent WebAudio fingerprinting that breaks Bluetooth multipoint
emctech · Hacker News · 1d ago