Content-based privilege: transformer residual streams stratify by proximity to the model's own prediction

·LessWrong··

The directions nearest a model's prediction decide what kind of answer you get. The next ones out decide where it goes — about five tokens later.Preprint: https://arxiv.org/abs/2608.12447; Supplementary materials; Code. What do we mean when we say that a transformer model has privileged geometry? I honestly wasn't sure about that when I started down this rabbit hole, because that wasn't the initial point of the work. If you want to jump right to the most unexpected finding, scroll down to #8 whe...

Read full article →

Related Articles

Why there are still no non-WebKit browsers on iOS
lapcat · Hacker News · 9h ago
OpenSSL: Buffer overflow in EVP_EncodeBlock() (CVE-2026-121481, CVSS 9.8)
JacobHenner · Hacker News · 22h ago
Unauthenticated remote code execution in Nginx
speedping · Hacker News · 2d ago
GIMP now has UI tests
qtqtqt · Hacker News · 20h ago
Pancreatic cancer halted by virus injection in three patients
cybermango · Hacker News · 1d ago