Steering towards “automated grading” degrades alignment

·LessWrong··

TL;DR: We steer Qwen3.6-27B on a dimension constructed from the contrast pair “a script will verify your answer” (automated grader) vs “a human will evaluate your answer” (human grader). Steering towards an automated grader increases the propensity to take violent actions and makes the model more Machiavellian. Steering towards a human grader has the opposite effect. This is an early research update. We believe the empirical results are sound and interesting, but we are not sure how to interpret...

Read full article →

Related Articles

Every AI model has the same "controversial" take on humans
rakannimer · Hacker News · 7h ago
Jailbreaking the Switch 2
ledoge · Hacker News · 15h ago
Security Disclosure
passenger · Hacker News · 1d ago
The recently proposed o(n log n) integer multiplication algorithm [pdf]
craigcitro · Hacker News · 20h ago
Show HN: Run full iOS 16.5 firmware on Android Devices
aghuang · Hacker News · 7h ago