Your Agents Are Not Time Aware

Work done as part of MATS 10 with Maksym AndriushchenkoTLDR:We had two CLI agents, Claude Code and Codex, predict, execute and then retrospectively estimate their own wall-clock runtime. We ran experiments across ProgramBench, our own evaluation-suite (AgentTime), and then ablated on what information agents have access to.Agents consistently over-predict task time. On ProgramBench, agents like to predict around an hour and a half. On AgentTime, Fable over-predicts by 3x and Sol by 6x. Error is w...