What do we mean by ‘long-horizon’ work?
TL;DR - The benchmarks frontier labs cite for long-horizon capability mostly measure capability on tasks involving many steps or lots of context, verifiable end states, and little external input. I argue that what defines real-world long-horizon work is delayed external feedback. That delay is where human input becomes high leverage, and it’s a constraint neither longer context nor multi-agent swarms can engineer away. I discuss this with examples like building a new, better Redis vs. running pe...
Read full article →