Current alignment techniques might be ineffective (and actively bad) in the age of RL

·LessWrong··

Tl;dr I am currently worried about current alignment techniques + how they are applied to frontier models. This decomposes into two hypotheses: Alignment techniques are not working to address misalignment from RL. Alignment techniques are actively obscuring evidence about misalignment. I think we do not currently have enough (public) evidence to conclude whether either of these claims are true. However, if both of these were true that would imply that alignment techniques are net bad and we need...

Read full article →

Related Articles

The case against JPEG XL
contact9879 · Hacker News · 10h ago
Why are AI agents lying, cheating and coordinating?
jonifico · Hacker News · 1d ago
JetKVM Mini
taubek · Hacker News · 1d ago
I'm being cyberattacked by Tesla, Inc
robinpie · Hacker News · 17h ago
google.com/goto: Google's anti-scraping update
1e1a · Hacker News · 2d ago