A Red Line and Oversight Framework for Government AI Contracts

·Alignment Forum··

My post on leaving Google DeepMind tells a story. In contrast, this Framework is a question of mechanism design and negotiation posture. I quite enjoyed optimizing this Framework against its organizational and practical constraints. The original considerations were:Good red lines: Rule out the questionable use cases (autonomous targeting without human control, untargeted profiling) while allowing trustworthy ones like missile defense. Avoid the weaknesses flagged in legal analysis of Anthropic’s...

Read full article →

Related Articles

How could the US and China verifiably slow AI?
josefely · LessWrong · 37m ago
Red-Teaming OpenAI's Internal Agent Monitoring Systems
Buck Shlegeris · Redwood Research · 6h ago
Monitorability evaluations and policy proposals
evhub · Alignment Forum · 8h ago
MIT's New Method Flags AI Models Trained on CASM Without Generating It
sdoering · Hacker News · 3mo ago
Neural nets are exceptionally vulnerable to goal self-hack
Stuart_Armstrong · Alignment Forum · 1d ago