Detecting NSFW and Harmful Prompts Through Geometry: Learning What's Safe Instead of What's Harmful
⚠️Content warning: This post contains potentially offensive text and images from our research paper, included solely to illustrate the safety risks associated with vision-language models.TL;DR:i) Can we detect harmful prompts by learning only what safe prompts look like?ii) In our ICLR 2026 paper, we introduce HyPE, a lightweight detector that uses hyperbolic geometry and learns just a single parameter from benign prompts. It shows strong detection performance, even against adversarial attacks.i...
Read full article →