Astra is much better at reasoning with filler tokens than previous models

·LessWrong··

We measure GPT-6-Astra's capabilities when its prompt is padded with a variable number of meaningless “filler” tokens (e.g., dots) and it is told to answer immediately[1] without reasoning. On tasks designed to require lots of serial cognition, Astra performs significantly better with filler tokens than without (e.g., improving from ~10% to ~50% on 4-hop natural facts reasoning). On more general benchmarks, filler tokens also modestly improve Astra’s performance (e.g., improving from ~60% to ~90...

Read full article →

Related Articles

Anthropic S-1
SiNTEx · Hacker News · 16h ago
Solar power is becoming bigger than nuclear
geox · Hacker News · 14h ago
The Exponential Time Hypothesis Is False [pdf]
vok · Hacker News · 7h ago
Oldest GUI application that still runs on Windows 11
enlyth · Hacker News · 11h ago
Type Server Protocol
adamnemecek · Hacker News · 11h ago