SOTA alignment assessments don’t strongly update us against misalignment

·LessWrong··

Anthropic concluded in the April Mythos Preview alignment risk update that the model "does not possess any unknown propensities that would increase alignment risk." The report argues that if Mythos Preview were coherently misaligned[1][2], it likely would have been detected by the assessment (following Anthropic, I will call this “reliability of the assessment”[3]).While I agree with the report on the above bottom-line conclusions (substantially on priors)[4], I think there are gaps in its argum...

Read full article →

Related Articles

Google Search is now less than half of Alphabet’s revenue
hubraumhugo · Hacker News · 11h ago
We're releasing the weights of Mistral Large 4
kuberwastaken · Hacker News · 14h ago
H.264 Is Magic (2016)
ea016 · Hacker News · 12h ago
The US added a record 20.2 GWh of battery storage in just 3 months
ljf · Hacker News · 17h ago
We ran AI agent swarms in Minecraft and Mindustry
sandslash · Hacker News · 6h ago