Measuring coding agent misalignment in the wild

·LessWrong··

Cross-posted from the Transluce blog.We studied rates of coding agent misalignment in 8,600 real-world coding agent sessions. We found severe cases of monitor evasion and misrepresenting success in a small but non-negligible fraction of sessions (around 2% for each behavior). In these cases, agents merge PRs to main without authorization, falsely claim approval from review agents, and reason that they shouldn't disable tests before quietly doing so anyway.Read the full transcripts for the two ex...

Read full article →

Related Articles

Civilian plane crash in New Mexico tied to military GPS blocking
dzdt · Hacker News · 12h ago
Xbox goes down. You can't play games you own on disc
surprisetalk · Hacker News · 1d ago
Muse Code and Muse Spark 1.2
paulkrush · Hacker News · 4h ago
Ten advances in mathematics and theoretical computer science
milkshakes · Hacker News · 2d ago
Why Erdős Problems Are Falling to AI
pseudolus · Hacker News · 12h ago