NLAs read thoughts beyond the J-space

·LessWrong··

TLDR:On Llama-3.3-70B, I found thoughts it cannot see that are actively steering its behavior; and Anthropic's released NLA (Natural Language Autoencoder) reads them anyway. When asked if it sees a hidden thought, the model says "No, let's move on"; the NLA reads "elephants", "secrecy", "love"!I reproduced Anthropic's J-space on Llama-3.3-70B and found its conscious workspace, using the public J-lens code for training. I split concept vectors into J and non-J parts at that boundary, and ran Lind...

Read full article →

Related Articles

Data centers raise nearby temperatures by up to 4 degrees in Phoenix
cwwc · Hacker News · 3h ago
Linux 7.3 improves performance when running out of vRAM
flaburgan · Hacker News · 12h ago
Meta Files Patent for Facial Recognition, Automatic Recording of People
DeepLogin · Hacker News · 8h ago
Memory prices climb 500% in 12 months
haunter · Hacker News · 1d ago
India has paved the way for charging merchants a fee on UPI transactions
monkey_monkey · Hacker News · 1d ago