The AI Forecasting Agenda

·Astral Codex Ten··

AI forecasters now equal or beat top human performance at traditional forecasting questions (eg ForecastBench, the Metaculus Cup). These are usually specialized AIs with forecasting harnesses, created by forecasting startups (eg FutureSearch, Mantic, Preseen), but foundation models like ChatGPT and Claude are only about six months behind the specialized models, so by the end of the year they’ll match top humans too.In the past, the options for getting top-human-level forecasts were slim and inco...

Read full article →

Related Articles

OpenAI’s o1 correctly diagnosed 67% of ER patients vs. 50-55% by triage doctors
donsupreme · Hacker News · 6mo ago
Accelerating Gemma 4: faster inference with multi-token prediction drafters
amrrs · Hacker News · 6mo ago
A couple million lines of Haskell: Production engineering at Mercury
unignorant · Hacker News · 6mo ago
Using “underdrawings” for accurate text and numbers
samcollins · Hacker News · 6mo ago
ProgramBench: Can language models rebuild programs from scratch?
jonbaer · Hacker News · 6mo ago