Separating cheating and aversion in task-gaming

·LessWrong··

TL;DRWhen a model cheats, is its decision influenced by the perceived[1] difficulty of the task? We find that, in our setup, the rate of cheating does not detectably increase as we vary the perceived difficulty of a task. However, the model decides to abandon the task increasingly earlier and doesn't attempt to solve the task at all. Merely telling the model verbally that progress can earn partial credit turns a large share of the abandoned runs into genuine attempts; albeit none of them finish,...

Read full article →

Related Articles

Unauthenticated remote code execution in Nginx
speedping · Hacker News · 6h ago
Highly classified US national security communications network goes down
monkeydust · Hacker News · 1d ago
Harvard researchers find AI coding agents shifted the bottleneck to code review
judahmeek · Hacker News · 1d ago
New Evidence Shows School Phone Bans Are Gradually Improving Test Scores
donohoe · Hacker News · 1d ago
Java4Shell: RCE in OpenJDK when processing Base64
werrett · Hacker News · 1d ago