Automating subtle emergent misalignment research

Authors: Oscar Balcells Obeso, Richard Qi, Monte MacDiarmid, Evan HubingerAbstractRed-teaming by humans is a vital part of model safety testing, but it may struggle to keep up as models improve. To test whether automated safety techniques could scale (which would allow us to turn more compute into progressively more safety confidence), we set up a deliberately one-sided game as a first test. We instructed a Claude model to write training data that would make a small research model misaligned whi...