Fable is SOTA at CIFAR Speedrun (& specification gaming)
Fulcrum is working on an AI R&D optimization benchmark. Here, we present results from one of our tasks, including preliminary results from Fable.For more detail on Fable’s solution, check out github.com/fulcrumresearch/cifar-10-speedrun.Summary: We gave current frontier models 100M tokens to see whether they could beat the human record for fastest CIFAR-10 training. Opus 4.8 and GPT 5.5 were unable to improve off of the SOTA solution. Fable, on the other hand, introduced a downsampling technique...
Read full article →