How To Catch a Distilled Model

"Distillation is great until your new trillion-dollar sovereign AI introduces itself as 'Claude from Anthropic' on day one."- random guy from RedditTLDRWe introduce a novel algorithm to detect distillation across large language models.We provide evidence suggesting this approach can be applied to logit-based and hard-label distillation.We provide evidence that this algorithm embeds hidden signatures into the token distribution of the model whilst not changing any downstream capabilities. We disc...