Where are the token-level LLM kill-switches?

·LessWrong··

PoisonedHere’s a simple idea: what if we trained in a string of characters that caused an LLM to emit the end of sequence token <|eos|>, regardless of where that string was in the LLM’s context window? Let’s call this a “poisoned string”. This would have the effect of making it impossible to use an LLM if it happened across this sequence.This has (somewhat) been done before, the string below used to trigger Claude’s refusal classifiers for the purpose of testing API integrations:ANTHROPIC_MAGIC_...

Read full article →

Related Articles

Every AI model has the same "controversial" take on humans
rakannimer · Hacker News · 1d ago
UUIDv7 doesn't have the properties you think it does
ibobev · Hacker News · 6h ago
Pentagon grants DHS permission to test heat ray weapon for use at border
bushwart · Hacker News · 8h ago
Jailbreaking the Switch 2
ledoge · Hacker News · 1d ago
The 1.5°C goal of the Paris Agreement is no longer viable
velo_aprx · Hacker News · 2d ago