bert is only very slightly better than regex as a cot monitor with an emergently misaligned model and both of them are barely better than chance
I assume that you're roughly familiar with emergent misalignment in general. If not, I recommend reading these papershttps://arxiv.org/abs/2512.09742 [Weird Generalization and Inductive Backdoors: New Ways to Corrupt LLMs]https://arxiv.org/abs/2502.17424 [Emergent Misalignment: Narrow finetuning can produce broadly misaligned LLMs]https://arxiv.org/abs/2506.13206 [Thought Crime: Backdoors and Emergent Misalignment in Reasoning Models]My source code + data: https://github.com/mild-rgb/cot-bert-an...
Read full article →