Examing Emergent Misalignment in a recurrent LLM with a logit lens

IntroThis post builds on my previous post about mech interp on a recurrent LLM. I found that a logit lens is able to recover a chain-of-thought equivalent from an LLM, loop index is linearly represented, and that steering concepts transfer between loops. In this post, I discuss Emergent Misalignment in Ouro-1.4b and investigate how its representation changes between loops. I find that EM is inducable and that its representation varies across loops. I did this experiment because much of the debat...