Current alignment techniques might be ineffective (and actively bad) in the age of RL

·LessWrong··

Tl;dr I am currently worried about current alignment techniques + how they are applied to frontier models. This decomposes into two hypotheses: Alignment techniques are not working to address misalignment from RL. Alignment techniques are actively obscuring evidence about misalignment. I think we do not currently have enough (public) evidence to conclude whether either of these claims are true. However, if both of these were true that would imply that alignment techniques are net bad and we need...

Read full article →

Related Articles

Claude Code regularly sends each background agent’s transcript to its model
NikZaal · Hacker News · 8h ago
Zero click, silent, remote Android DoS
MarkBlah · Hacker News · 5h ago
Anthropic S-1
SiNTEx · Hacker News · 2d ago
Qwenputer: A functioning, deterministic RISC-V CPU inside Qwen3.5
csmantle · Hacker News · 11h ago
Git for the US Code
alansaber · Hacker News · 1d ago