AI will make biological extinction risks worse before it makes them better by MichaelDickens

·Nuno Sempere··

An ar­gu­ment goes: If we don’t build al­igned ar­tifi­cial su­per­in­tel­li­gence, we risk driv­ing our­selves ex­tinct for some other rea­son. We should rush to build ASI quickly, in spite of the risks—the longer we wait, the more vuln­er­a­ble we are to ex­tinc­tion from a differ­ent cause. Other than ASI, the biggest ex­tinc­tion risk is syn­thetic biol­ogy. Some lab could (ac­ci­den­tally or on pur­pose) de­velop a highly trans­mis­si­ble, 100% fatal su­per-plague that wipes out hu­man­ity....

Read full article →

Related Articles

The staggering welfare consequences of catch-up growth after AI by Rafael Proenca
Rafael Proenca · Nuno Sempere · 2h ago
Watching the Wrong Thing: an interpretability audit of two audio deepfake detectors by Gavin_Lee
Gavin_Lee · Nuno Sempere · 6h ago
Will Gemini 3.7 Flash be released by the end of August 2026?
JasonMendoza2008 · Manifold Markets · 1d ago
Geoffrey Irving on how to solve alignment before superintelligence arrives by 80000_Hours
80000_Hours · Nuno Sempere · 2d ago
Will I see the total solar eclipse for at least ~5 seconds tomorrow?
Eli Goldfine · Manifold Markets · 2d ago