If This Were a Test, How Much Would It Cost?

·LessWrong··

TL;DRA capable, strategic, misaligned AI doesn't need to figure out whether it's in a test or in real deployment. It just needs to ask: "If this were a test, how much would it have cost to create?" If the answer is "more than what the evaluator is able or willing to spend," then the AI can be confident it's in the real world — and act accordingly. We argue that powerful AI will predictably encounter high-stakes opportunities where this applies. Pre-deployment testing, by itself, cannot close thi...

Read full article →

Related Articles

Backdoor in Claude Code for VS Code extension on the Cursor Marketplace
_chall · Hacker News · 11h ago
Backdoors in official Claude Code extensions
dsr_ · Hacker News · 7h ago
We're releasing the weights of Mistral Large 4
kuberwastaken · Hacker News · 1d ago
A Working Nintendo in ~1GB of Qwen Weights
dbreunig · Hacker News · 2h ago
Google Search is now less than half of Alphabet’s revenue
hubraumhugo · Hacker News · 1d ago