GPT-6.2 Astra scores below chance on TASTE; GPT-6 Astra and Fable 5.2 near chance

·LessWrong··

TASTE was released in Aug 2026, and it aims to evaluate models’ capacity for research taste. Specifically, it measures how much models agree with human researchers when choosing the better of two synthetically generated safety research proposals. [1]In light of recent evidence of AI uplift for AI R&D, I ran this benchmark on newly released models. Astra 6.2 agrees with researchers significantly less often than chance. Neither Astra 6 nor Fable 5.2 performs significantly different from chance.Not...

Read full article →

Related Articles

Unauthenticated remote code execution in Nginx
speedping · Hacker News · 1d ago
Cooling buildings is overtaking heating them as an energy need, IEA says
robtherobber · Hacker News · 8h ago
Ruby2ßhell: Pre-authentication RCE on stock Rails
jdns · Hacker News · 18h ago
Pancreatic cancer halted by virus injection in three patients
cybermango · Hacker News · 5h ago
Highly classified US national security communications network goes down
monkeydust · Hacker News · 2d ago