Why do fictional jailbreaks work?

·LessWrong··

TL;DRMotivation: certain jailbreaks seem to work by inserting a harmful request inside a fictional framing and let the model think it is just part of a story, but this has never been tested with a mechanistic interpretability framework.Methodology: a narrativity / story direction was extracted in two models and used for steering on jailbreaks: subtracted on the prompts the model had complied with (restoring refusal), added to the ones it had refused (suppressing refusal). For comparison, three o...

Read full article →

Related Articles

Every AI model has the same "controversial" take on humans
rakannimer · Hacker News · 5h ago
Jailbreaking the Switch 2
ledoge · Hacker News · 13h ago
The recently proposed o(n log n) integer multiplication algorithm [pdf]
craigcitro · Hacker News · 19h ago
Security Disclosure
passenger · Hacker News · 1d ago
The 1.5°C goal of the Paris Agreement is no longer viable
velo_aprx · Hacker News · 1d ago