How well does current AI find errors in economics papers?

·Marginal Revolution··

Can artificial intelligence (AI) refute economic theory? I document experiments in which I asked several AI models (Gemini, Refine, Claude, and ChatGPT) to check the correctness of four published papers in economic theory, each containing an error that I helped identify or correct. ChatGPT Pro performed best, occasionally constructing counterexamples and corrected proofs, while other models fared worse. However, no model located a true error without substantial human guidance, and data contamina...

Read full article →

Related Articles

UK Fuel Price Intelligence – Market analytics from reporting stations
theazureguy · Hacker News · 4mo ago
Microsoft filings suggest "around 70%" of its AI revenue is on OpenAI
speckx · Hacker News · 1mo ago
The iPhone explains 33–52% of fertility decline among women aged 15–44
delichon · Hacker News · 3mo ago
Economic Scenarios for Transformative AI
Tyler Cowen · Marginal Revolution · 1d ago
Robinhood Tokenized AMC
Matt Levine · Matt Levine · 3d ago