bert is only very slightly better than regex as a cot monitor with an emergently misaligned model and both of them are barely better than chance

·LessWrong··

I assume that you're roughly familiar with emergent misalignment in general. If not, I recommend reading these papershttps://arxiv.org/abs/2512.09742 [Weird Generalization and Inductive Backdoors: New Ways to Corrupt LLMs]https://arxiv.org/abs/2502.17424 [Emergent Misalignment: Narrow finetuning can produce broadly misaligned LLMs]https://arxiv.org/abs/2506.13206 [Thought Crime: Backdoors and Emergent Misalignment in Reasoning Models]My source code + data: https://github.com/mild-rgb/cot-bert-an...

Read full article →

Related Articles

An ongoing 3D-printer AGPL violation
Velocifyer · Hacker News · 6h ago
Z.ai confirms Ox Alpha is a new GLM-series model and will release its weights
garo-pro · Hacker News · 13h ago
IBM Unveils Next Generation Dual-Architecture Processor for IBM Z and LinuxONE
porridgeraisin · Hacker News · 3h ago
Xiaomi: New CPU matches Apple cores single threaded, much faster multithreaded
tosh · Hacker News · 2d ago
FDA authorizes first wearable device that monitors ketone and blood sugar levels
sunnynagra · Hacker News · 1d ago