a recurrent llm is quite easy to interpret but complex to steer

TLDR;Ouro-1.4b-thinking is broadly interpretable with logit lenses and linear probes. It's also steerable but does 'clean' foreign concepts out of the residual stream if they're injected before the last loop. This could have nasty implications for safety.Code + data: https://github.com/mild-rgb/ouro-experiments + https://huggingface.co/datasets/mild-rgb/ouro-1.4b-thinking-evalsIf you're not familiar with the Ouro family recurrent models, I recommend taking 5 minutes with your favourite AI agent ...