Auditors Struggle to Catch Sabotage in End-to-End Transcripts of AI Safety Research
Authors: Keshav Shenoy, Anthony Zang, Eric Gan, Jacqueline Tay, Amy Ngo, Sebastian Prasanna, Julian Stastny, Vivek Hebbartl;dr. We had a human expert secretly sabotage AI safety research and asked auditors to spot it. Even with the full research log and the ability to run their own experiments, human auditors could barely tell sabotaged research from benign research, and usually couldn't pin down what had been sabotaged. The best frontier models likely do better, but still miss most of the sabot...
Read full article →