A Pipeline for Generating Synthetic Sabotage Trajectories to Red-Team Monitors

·LessWrong··

This post describes a proof-of-concept pipeline that turns a dataset of benign Claude Code transcripts into synthetic sabotage trajectories (strajs) for automated red-teaming of monitors. This is an approach control teams at AI companies could implement to stress test and improve their monitors. Third party auditors could also find this useful for accelerating their internal red teaming of AI companies' monitoring infrastructure such as what David Rein at METR recently did.The dataset of Claude ...

Read full article →

Related Articles

A basic case for accelerating conceptual reasoning capabilities
Emery Cooper · Redwood Research · 3h ago
MIT's New Method Flags AI Models Trained on CASM Without Generating It
sdoering · Hacker News · 3mo ago
Red-Teaming OpenAI's Internal Agent Monitoring Systems
Buck Shlegeris · Redwood Research · 4d ago
Monitorability evaluations and policy proposals
evhub · Alignment Forum · 4d ago
Neural nets are exceptionally vulnerable to goal self-hack
Stuart_Armstrong · Alignment Forum · 5d ago