Releasing Benign Trajectories for MonitoringBench

Authors: Can Kucukkurt, Ethan ElaskyPalaestra Research TL;DR: We are releasing MonitoringBenchHonest, a supplement to the original attack trajectory dataset MonitoringBench used by both Anthropic and OpenAI in monitoring settings. Our set is intended for use in more expensive tasks, rather than the cheaper bulk monitoring setting where there is a large acceptable number of false positives. We control for tasks, format, and model, and release 550 benign trajectories alongside 550 paired attack tr...