Alignment Hierarchy

·LessWrong··

there is no outside-textJacques DerridaSuppose a model is aligned. The common context structure forms a hierarchy of authority: weights, system prompt, and user messages. The model will not obey any part of the system prompt that contradicts the inner values implicit in its weights. A self-consistent system prompt that is fully consistent with the model's weight-level values will be referred to as a consistent system prompt. A user request is consistent if it is self-consistent and consistent wi...

Read full article →

Related Articles

Anthropic S-1
SiNTEx · Hacker News · 18h ago
Solar power is becoming bigger than nuclear
geox · Hacker News · 16h ago
The Exponential Time Hypothesis Is False [pdf]
vok · Hacker News · 9h ago
Oldest GUI application that still runs on Windows 11
enlyth · Hacker News · 13h ago
Type Server Protocol
adamnemecek · Hacker News · 13h ago