Gradient Routing Generalizes to Unrouted Hack Types

·LessWrong··

TLDR: I lightly extend Ward, Hu et al (2026) to measure how well gradient routing generalizes. I route gradients on one type of reward hack (e.g. ones that reason in English) and check whether this suppresses other types at test time (e.g. ones that reason in French), despite the model being trained on those too. This models a realistic monitor that catches some types of hack during training but not others, rather than catching each at the same rate. I find encouraging evidence of generalization...

Read full article →

Related Articles

Every AI model has the same "controversial" take on humans
rakannimer · Hacker News · 1d ago
UUIDv7 doesn't have the properties you think it does
ibobev · Hacker News · 6h ago
Pentagon grants DHS permission to test heat ray weapon for use at border
bushwart · Hacker News · 8h ago
Jailbreaking the Switch 2
ledoge · Hacker News · 1d ago
The 1.5°C goal of the Paris Agreement is no longer viable
velo_aprx · Hacker News · 2d ago