J-space auditing might be unreliable

·LessWrong··

Across these preliminary experiments, decoded J-space did not seem particularly informative about reward-hacking behaviour. The readouts remained substantially similar across checkpoints and monitoring conditions despite meaningful behavioural differences, and providing J-space to an LLM auditor produced little additional discrimination beyond the information already available from the task or transcript. These results are limited to one model family, one model organism, and one behavioural sett...

Read full article →

Related Articles

Malware uses LLMs to rank victims by how much they're worth
khalidkhair · Hacker News · 4h ago
Backdoor in Claude Code for VS Code extension on the Cursor Marketplace
_chall · Hacker News · 1d ago
French lawmakers approved a tax of €0.055 for every gigabyte of internet traffic
helloplanets · Hacker News · 7h ago
We're releasing the weights of Mistral Large 4
kuberwastaken · Hacker News · 2d ago
Show HN: A working Nintendo in ~1GB of Qwen weights
dbreunig · Hacker News · 1d ago