The Hobbesian Bootstrap Paradox in Frontier AI

·EA Forum··

Published on September 14, 2026 2:14 PM GMTEpistemic status: I am confident in the coordination-problem diagnosis; considerably less confident in the specific enforcement architecture, which I expect to be substantially wrong in its current form (see sections 6 and 7). The bottleneck is not the architecture, it's whether the actors who'd need to negotiate are willing to sit down at all. If that ever happens, the technical work could be the easy part. Section 8 has what I'm actually asking for. T...

Read full article →

Related Articles

MIT's New Method Flags AI Models Trained on CASM Without Generating It
sdoering · Hacker News · 3mo ago
A basic case for accelerating conceptual reasoning capabilities
Emery Cooper · Redwood Research · 2d ago
Harm Laundering in GPT Models: Gender Discrimination Transformed Rather Than
sbulaev · Hacker News · 1mo ago
Self-Modeling Interventions Modulate Emergent Misalignment
gmays · Hacker News · 21d ago
Red-Teaming OpenAI's Internal Agent Monitoring Systems
Buck Shlegeris · Redwood Research · 7d ago