Measure Optimal AI Share of Labor Costs Instead of AI or Human-Only Performance

·LessWrong··

In a research post, Cunningham et al. of METR propose the “‘expenditure horizon’ over an optimization problem as the dollar value at which the improvement to the goal metric is equal to the improvement by a human with the same budget.” Though their work focuses on individual optimization problems (with NanoGPT as the main subject), the expenditure horizon can be meaningful for any task distribution: it’s the budget at which human-only and AI-only work reach the same performance.Though I like exp...

Read full article →

Related Articles

Unauthenticated remote code execution in Nginx
speedping · Hacker News · 6h ago
Highly classified US national security communications network goes down
monkeydust · Hacker News · 1d ago
Harvard researchers find AI coding agents shifted the bottleneck to code review
judahmeek · Hacker News · 1d ago
New Evidence Shows School Phone Bans Are Gradually Improving Test Scores
donohoe · Hacker News · 1d ago
Java4Shell: RCE in OpenJDK when processing Base64
werrett · Hacker News · 1d ago