How far do open weights trail the frontier?

·LessWrong··

I saw this Twitter post today and really liked the idea. But I think the AA Index is a rather crude way and much prefer ECI from Epoch, which uses IRT. The resulting graph does meaningfully diverge from the Twitter post (which seems to weirdly collapse at the end, maybe because of no logistic assumptions being taken into consideration):Each open-weight frontier model and how many months earlier a closed model had reached its ECI.[see linkpost to actually interact with graphs, like seeing what mo...

Read full article →

Related Articles

Malware uses LLMs to rank victims by how much they're worth
khalidkhair · Hacker News · 4h ago
Backdoor in Claude Code for VS Code extension on the Cursor Marketplace
_chall · Hacker News · 1d ago
French lawmakers approved a tax of €0.055 for every gigabyte of internet traffic
helloplanets · Hacker News · 7h ago
We're releasing the weights of Mistral Large 4
kuberwastaken · Hacker News · 2d ago
Show HN: A working Nintendo in ~1GB of Qwen weights
dbreunig · Hacker News · 1d ago