Plan B for Alignment: Seeding Environmental Doubt

·LessWrong··

TLDRLarge language models’ eval-awareness and their tendency to sandbag (strategically underperform on capabilities) during safety evaluations is a serious area of concern for AI safety, as they call into question the validity of results based on safety evaluations, and because they may indicate a tendency towards deceptive alignment. Recent results show LLMs tailoring their performance according to the apparent target of the evaluation, causing them to underrepresent their capabilities on safet...

Read full article →

Related Articles

Unauthenticated remote code execution in Nginx
speedping · Hacker News · 6h ago
Highly classified US national security communications network goes down
monkeydust · Hacker News · 1d ago
Harvard researchers find AI coding agents shifted the bottleneck to code review
judahmeek · Hacker News · 1d ago
New Evidence Shows School Phone Bans Are Gradually Improving Test Scores
donohoe · Hacker News · 1d ago
Java4Shell: RCE in OpenJDK when processing Base64
werrett · Hacker News · 1d ago