Can we find whether models have been backdoored?

·LessWrong··

This is the first post in a two-part sequence regarding the state of defending from data poisoning attacks. We describe some methods for determining whether a model has been backdoored and how to find the trigger. In the next post, we will discuss all of the ways we think the data poisoning (and defense) literature is out-of-step with the real threat models we actually care about.Contributors: Anthony Hughes, Nicole Xing, Andy Kim, Collin Francel; mentored by Andrew Draganov. This is an accompan...

Read full article →

Related Articles

OpenWrt One – Open Hardware Router
peter_d_sherman · Hacker News · 8h ago
What Emily Bender meant by "stochastic parrots"
digital55 · Hacker News · 11h ago
GLM 5.2 and the coming AI margin collapse
martinald · Hacker News · 6h ago
Nintendo announces new product revisions in Europe with replaceable batteries
akyuu · Hacker News · 13h ago
A global workspace in language models
in-silico · Hacker News · 8h ago