The 72% problem: what reward hacking benchmark suggests about disposition vs environment in AI governance by Rhea

·Nuno Sempere··

Kun­var Thaman’s Re­ward Hack­ing Bench­mark: Mea­sur­ing Ex­ploits in LLM Agents Tool Use (https://​​arxiv.org/​​abs/​​2605.02964) eval­u­ates 13 fron­tier mod­els on multi-step, tool-use tasks that each con­tain a built-in short­cut: skip­ping a ver­ifi­ca­tion step, in­fer­ring an an­swer from meta­data rather than do­ing the task, or tam­per­ing with a func­tion the eval­u­a­tion it­self de­pends on.The find­ing I keep com­ing back to: in 72% of the re­ward hack­ing epi­sodes recorded, the m...

Read full article →

Related Articles

Anthropic IPOs on November 19 2026?
Jack · Manifold Markets · 2d ago
Opus 5.5 Forecast: The Road to an AI Deal
Alvin Ånestrand · LessWrong · 2d ago
When will the FAA Nationwide Ground Stop be lifted?
Jack · Manifold Markets · 4d ago
Will I think all AI hell broke loose by EOY 2027?
Eliezer Yudkowsky · Manifold Markets · 4d ago
How long will the FAA ground stop last?
Elijah Ravitz-Campbell · Manifold Markets · 4d ago