Three types of model organism

·LessWrong··

This is a short post to explain a distinction between three different types of model organism (MO) research:TypePurposeExampleWorst-case model organismsStress-test safety and control techniques by making the problem as hard as possiblePassword-locked models for capability elicitation; sleeper agents for stress-testing alignment training; red-team malign inits in controlNatural model organismsDemonstrate plausible emergence of failure modes in realistic training pipelinesEmergent misalignment ind...

Read full article →

Related Articles

Measuring the sloppiness of code
doppp · Hacker News · 14h ago
Google will buy half the electricity from one of Finland's nuclear power plants
lukaspetersson · Hacker News · 1d ago
HuggingFace: Security.txt
yarapavan · Hacker News · 13h ago
Rune is now open source
ernestrc · Hacker News · 12h ago
The Deathray: A simple way for an untrusted site to freeze a Mac
auberonedu · Hacker News · 1d ago