Emergent introspection does not replicate on Llama-3.1-405B

·LessWrong··

TL;DR: I couldn't replicate Lindsey (2026) (LW post) on Llama-3.1-405B-Instruct (0/400 trials, 0/80 false positives in the canonical sweep; null robust to layer ∈ {70, 84, 90, 100} and to a dense magnitude grid at the suspected crossover). So: how does introspection emerge in models? The optimistic reading of Lindsey's result ("post-trained LLMs at sufficient scale can introspect") doesn't hold up unless Opus is much larger than 405B (Anthropic doesn't disclose its size) or Anthropic's post-trai...

Read full article →

Related Articles

Devices with GrapheneOS support should be available in 2027
exceptione · Hacker News · 8h ago
Moderna reports first positive Phase 3 for mRNA neoantigen therapy in melanoma
heydenberk · Hacker News · 6h ago
Field measurements of neighborhood-scale air temperature impacts of data centers
cwwc · Hacker News · 1d ago
Solo – a .so loader for static Linux binaries
zX41ZdbW · Hacker News · 20h ago
A 3D fruit fly on macOS desktop powered by the real FlyWire connectome
phoenix120 · Hacker News · 22h ago