AI can kill us without human extinction: P(Catastrophe)

The TrapThere has been a massive discourse over P(doom) in public spaces in response to the OpenAI-Hugging Face Incident. One of the main arguments against a P(doom) by P(null) can be summarized as often frame their dismissal around a crude threshold: 'If you cannot outline a concrete, inescapable mechanism where literally every single human dies, the argument for catastrophic AI risk is invalid'.The AI-safety community has largely allowed itself to be cornered by this framing. After all, there ...