Testing LLMs on Undergraduate Music Theory

·LessWrong··

I spent the past week designing a test that I hoped would serve as a benchmark. But LLMs are improving faster than I expected, and my devilishly hard questions turned out to be a cakewalk.Here are the results of testing five modern LLMs on undergraduate music theory:As can be seen, the LLMs performed remarkably well. Each scored a passing grade and GPT 5.6 Sol (the only premium model tested) scored a perfect 100%.With results like these, there’s no point in using this test as a benchmark going f...

Read full article →

Related Articles

Claude Code regularly sends each background agent’s transcript to its model
NikZaal · Hacker News · 6h ago
Anthropic S-1
SiNTEx · Hacker News · 2d ago
Qwenputer: A functioning, deterministic RISC-V CPU inside Qwen3.5
csmantle · Hacker News · 9h ago
Git for the US Code
alansaber · Hacker News · 1d ago
Solar power is becoming bigger than nuclear
geox · Hacker News · 2d ago