FutureEval Spring Results: Pros Beat Bots, but the Gap is Nearly Gone

·LessWrong··

Main TakeawaysTop Findings:Pro forecasters beat bots but without significance: Our team of 10 Metaculus Pro Forecasters outperformed the top-10 bot team by an average of 1.25 head-to-head points per question. But this edge is small relative to the question-to-question variation and not statistically significant (one-sided p = 0.247), so this sample doesn't give us enough evidence to confirm Pros were genuinely ahead this season.The bot team improved notably in the last year: The bot team’s head-...

Read full article →

Related Articles

Anthropic S-1
SiNTEx · Hacker News · 16h ago
Solar power is becoming bigger than nuclear
geox · Hacker News · 14h ago
The Exponential Time Hypothesis Is False [pdf]
vok · Hacker News · 7h ago
Oldest GUI application that still runs on Windows 11
enlyth · Hacker News · 11h ago
Type Server Protocol
adamnemecek · Hacker News · 11h ago