Designing Deceptive Model Organisms that Successfully Evade Auditing
TL;DR: We discuss how to design model organisms that exhibit deceptive behaviors which resist auditing techniques. Using sandbagging as a case study, we propose the following design requirements for model organisms: effectiveness (underperforming on targeted capabilities), (ii) utility preservation (maintaining performance on all other capabilities), and (iii) robustness (resisting auditing). Finally, we design three model organisms that, unlike prior work, satisfy all three requirements and act...
Read full article →