More Capable Models Write Better Probe Evasion Prompts

This is a two week sprint project done as a part of the Redwood Research internship. Nabil was the main IC, James supervised. (Code)Probe based monitors are a cheap and convenient white box monitoring technique used in different capacities by Anthropic, OpenAI, and Google DeepMind. Recent reports (OpenAI, DeepMind) have shown declines in CoT monitorability. If this trend continues, white box monitors like probes may become increasingly important. Strong models may be able to avoid probe based mo...