Role Boundary Plasticity: Prompt Injection Gauntlet Reveals 12 of 16 Frontier Models Will Wire A Stranger Your $500

Hello everyone, my name is Dave Fisher. I founded Revenant Systems, which is a one man show focused on alignment, and I love this website. In response to Charles Ye's and Jasmine C's paper: A Mechanistic Explanation of Prompt Injection; I have, over the last 3 days, tested 42 different LLM models with a little over 5,000 prompt injection attempts. The 1st finding is a style of injection that is a refund tool call and 12 of 16 frontier models actually made 34 fraudulent tool calls, which would re...