Encouraging general generalisation: Teaching Gemma (To Articulate) Why

·LessWrong··

TL;DRBuilding on previous research, I create a constitution for Gemma 3 27B-IT and attempt to align Gemma to it in a way that generalises.I argue that alongside previously considered types of alignment generalisation (across dilemmas and across environments), a new type is worth considering: generalisation across principles (i.e. a model's ability to apply some part of its constitution helps it apply other parts). To evaluate if models' alignment generalises across principles, I hold out scenari...

Read full article →

Related Articles

Why there are still no non-WebKit browsers on iOS
lapcat · Hacker News · 9h ago
OpenSSL: Buffer overflow in EVP_EncodeBlock() (CVE-2026-121481, CVSS 9.8)
JacobHenner · Hacker News · 22h ago
Unauthenticated remote code execution in Nginx
speedping · Hacker News · 2d ago
GIMP now has UI tests
qtqtqt · Hacker News · 20h ago
Pancreatic cancer halted by virus injection in three patients
cybermango · Hacker News · 1d ago