How To Catch a Distilled Model

·LessWrong··

"Distillation is great until your new trillion-dollar sovereign AI introduces itself as 'Claude from Anthropic' on day one."- random guy from RedditTLDRWe introduce a novel algorithm to detect distillation across large language models.We provide evidence suggesting this approach can be applied to logit-based and hard-label distillation.We provide evidence that this algorithm embeds hidden signatures into the token distribution of the model whilst not changing any downstream capabilities. We disc...

Read full article →

Related Articles

Unauthenticated remote code execution in Nginx
speedping · Hacker News · 6h ago
Highly classified US national security communications network goes down
monkeydust · Hacker News · 1d ago
Harvard researchers find AI coding agents shifted the bottleneck to code review
judahmeek · Hacker News · 1d ago
New Evidence Shows School Phone Bans Are Gradually Improving Test Scores
donohoe · Hacker News · 1d ago
Java4Shell: RCE in OpenJDK when processing Base64
werrett · Hacker News · 1d ago