What's in CODI's latent recurrent thoughts?

What's in CODI's latent recurrent thoughts?TL;DRCODI is a model using latent reasoning. Previous work by Cywiński et al. (2025) has found that CODI's latent recurrent states (“thoughts”) do causally carry a computation's intermediate values, in a way that can be indirectly detected with LogitLens, though the thoughts themselves remained opaque. We here ask whether it is possible use activation verbalizers (AVs: NLAs and AOs) to still decode them.To this end, we train a Qwen3-8B CODI to connect t...