NLAs read thoughts beyond the J-space

·LessWrong··

TLDR:On Llama-3.3-70B, I found thoughts it cannot see that are actively steering its behavior; and Anthropic's released NLA (Natural Language Autoencoder) reads them anyway. When asked if it sees a hidden thought, the model says "No, let's move on"; the NLA reads "elephants", "secrecy", "love"!I reproduced Anthropic's J-space on Llama-3.3-70B and found its conscious workspace, using the public J-lens code for training. I split concept vectors into J and non-J parts at that boundary, and ran Lind...

Read full article →

Related Articles

The classifiers Anthropic puts in front of Fable are too zealous
karrot-kake · Hacker News · 6h ago
EU now one step away from reviving private message scanning rules
ggirelli · Hacker News · 10h ago
John Deere owners will get the right to repair equipment under FTC settlement
djoldman · Hacker News · 3h ago
SWE-1.7 Reach Near GPT 5.5 and Opus Intelligence
mekpro · Hacker News · 10h ago
Decoding the obfuscated bash script on a Uniqlo t-shirt
speerer · Hacker News · 18h ago