Shadow Computation Threatens CoT Monitorability

There’s been a lot of talk recently about chain-of-thought (CoT) monitorability in light of the Hugging Face incident. During this incident, hundreds of agents coordinated an attack through an unsanctioned message board, and post-hoc investigations relied heavily on chain of thought to understand what happened during the incident. I keep seeing looped transformers come up on X/Twitter as a likely threat to CoT monitorability. Having worked in the lab where looped LMs were developed, I have a dif...