Gods of straight lines on graphs strike Starburst. I am shocked and puzzled.
LLM Intelligence, measured by Starburst, has been basically linear over time since that start of the reasoning era.By Chapin Lenthall-Cleary and Cole GaboriaultIn summer 2024, my friend Cole and I started a hobby research program into perceptions of (human) intelligence. We started by creating a bespoke 1-5 intelligence scale[1] and rating people we knew. Our plan was to then make a bunch of tests, give them to the people we rated, and see which tests, if any, correlated with our ratings.One of ...
Read full article →