Real-SWE: Benchmarking AI models on private, real-world, enterprise codebases

·Hacker News··

Real-SWE benchmarks frontier AI models on private production codebases licensed from real companies. Eight model and harness configurations, ten tasks, 640 scored rollouts.

Read full article →

Related Articles

Anthropic S-1
SiNTEx · Hacker News · 1d ago
Police are using AI to pull over drivers for 'suspicious' behavior
gumby · Hacker News · 7h ago
Python's experimental JIT to be removed
f311a · Hacker News · 13h ago
Solar power is becoming bigger than nuclear
geox · Hacker News · 1d ago
The Exponential Time Hypothesis Is False [pdf]
vok · Hacker News · 1d ago