Monitorability evaluations and policy proposals

·Alignment Forum··

There has been a lot of discussion recently of policy proposals around monitorability, such as Redwood's proposal and my counter-proposal. I'd like to say a bit more generally about how I'm thinking about monitorability. Note that nothing here is an official Anthropic position; these are just my personal thoughts. First, a categorization. I currently think about four different types of monitorability: Control Monitorability: the extent to which Control and monitoring techniques would likely catc...

Read full article →

Related Articles

How could the US and China verifiably slow AI?
josefely · LessWrong · 35m ago
Red-Teaming OpenAI's Internal Agent Monitoring Systems
Buck Shlegeris · Redwood Research · 6h ago
MIT's New Method Flags AI Models Trained on CASM Without Generating It
sdoering · Hacker News · 3mo ago
Neural nets are exceptionally vulnerable to goal self-hack
Stuart_Armstrong · Alignment Forum · 1d ago
Why Clean Neurons Are Not Enough
Goutham Nalagatla · LessWrong · 2d ago