Fixing rewards for NLA to reduce confabulation

·LessWrong··

Hello,This is my first post on Lesswrong. Hope my contribution makes the world a better and safer place.Note: 1. This post is 100% human-written. 2. Full paper in preparation for ICLR 2027Anthropic's NLA(Natural Language Autoencoder) is mostly confabulated... until I fixed the reward.The NLA(The Natural Language Autoencoder(Anthropic, May 2026) is a huge upgrade for the standard of mechanistic interpretability tool, SAE(Sparse AutoEncoder). It uses two copies of target model: AV(verbalizer) and ...

Read full article →

Related Articles

Every AI model has the same "controversial" take on humans
rakannimer · Hacker News · 7h ago
Jailbreaking the Switch 2
ledoge · Hacker News · 15h ago
Security Disclosure
passenger · Hacker News · 1d ago
The recently proposed o(n log n) integer multiplication algorithm [pdf]
craigcitro · Hacker News · 20h ago
Show HN: Run full iOS 16.5 firmware on Android Devices
aghuang · Hacker News · 7h ago