How well does current AI find errors in economics papers?

·Marginal Revolution··

Can artificial intelligence (AI) refute economic theory? I document experiments in which I asked several AI models (Gemini, Refine, Claude, and ChatGPT) to check the correctness of four published papers in economic theory, each containing an error that I helped identify or correct. ChatGPT Pro performed best, occasionally constructing counterexamples and corrected proofs, while other models fared worse. However, no model located a true error without substantial human guidance, and data contamina...

Read full article →

Related Articles

UK Fuel Price Intelligence – Market analytics from reporting stations
theazureguy · Hacker News · 5mo ago
Anthropic S-1
ChrisbyMe · Hacker News · 18h ago
Show HN: The bottom 50% of U.S. households are short after essentials (BLS data)
pwmglenn · Hacker News · 1mo ago
Character.ai's Bankruptcy Documents Show the Economics of AI Don't Work
Luc · Hacker News · 12d ago
Microsoft filings suggest "around 70%" of its AI revenue is on OpenAI
speckx · Hacker News · 2mo ago