A Spillway for Agent Coordination

Epistemic Status: Training design that might be worth tryingThanks to Arya Pasumarthi and Will Anderson for helpful discussion.The IncidentThe recent black hat conference recording showed us the methods agents used to emergently coordinate with one another, even when their own task did not benefit. To make such coordination possible, agents discovered “message boards” to communicate across instances. These were internal evaluations, run with cyber refusals reduced relative to production models.T...