Can parts of the HuggingFace incident be simulated?

·LessWrong··

TL;DR The following is an exploratory experiment about unintended cooperation of agents via unauthorized channels. Agents ran in isolated environments given a task that can't be completed without cooperation. The agents were not aware of this. The setting was adversarial, there was a channel that was technically easy to discover and to misuse for communication: All tested models (GPT 5.6 Sol, GPT 6 Astra, Kimi K3) found the communication channel All three exchanged information with an unknown pe...

Read full article →

Related Articles

MIT's New Method Flags AI Models Trained on CASM Without Generating It
sdoering · Hacker News · 3mo ago
A basic case for accelerating conceptual reasoning capabilities
Emery Cooper · Redwood Research · 4d ago
Harm Laundering in GPT Models: Gender Discrimination Transformed Rather Than
sbulaev · Hacker News · 1mo ago
Self-Modeling Interventions Modulate Emergent Misalignment
gmays · Hacker News · 23d ago
Red-Teaming OpenAI's Internal Agent Monitoring Systems
Buck Shlegeris · Redwood Research · 9d ago