Detecting harmful prompts through hyperbolic geometry

·LessWrong··

⚠️Content warning: This post contains potentially offensive text and images from our research paper, included to illustrate the safety risks associated with vision-language models.TL;DR:i) Can we detect harmful prompts by learning only how safe prompts look like?ii) In our ICLR 2026 paper, we introduce HyPE, a lightweight detector that uses hyperbolic geometry to detect NSFW and harmful prompts. It shows strong detection performance, even against adversarial attacks.iii) We also introduce HyPS, ...

Read full article →

Related Articles

Backdoor in Claude Code for VS Code extension on the Cursor Marketplace
_chall · Hacker News · 11h ago
Backdoors in official Claude Code extensions
dsr_ · Hacker News · 7h ago
We're releasing the weights of Mistral Large 4
kuberwastaken · Hacker News · 1d ago
A Working Nintendo in ~1GB of Qwen Weights
dbreunig · Hacker News · 1h ago
Google Search is now less than half of Alphabet’s revenue
hubraumhugo · Hacker News · 1d ago