AI will make biological extinction risks worse before it makes them better by MichaelDickens

·Nuno Sempere··

An ar­gu­ment goes: If we don’t build al­igned ar­tifi­cial su­per­in­tel­li­gence, we risk driv­ing our­selves ex­tinct for some other rea­son. We should rush to build ASI quickly, in spite of the risks—the longer we wait, the more vuln­er­a­ble we are to ex­tinc­tion from a differ­ent cause. Other than ASI, the biggest ex­tinc­tion risk is syn­thetic biol­ogy. Some lab could (ac­ci­den­tally or on pur­pose) de­velop a highly trans­mis­si­ble, 100% fatal su­per-plague that wipes out hu­man­ity....

Read full article →

Related Articles

Paperclips, broad- and narrow-scope goals, and the over-verification problem by Matthew Rendall
Matthew Rendall · Nuno Sempere · 1d ago
AI takes down a major payment system by EOY 2027?
Brad · Manifold Markets · 3d ago
Strait of Hormuz traffic returns to normal by July 7? [Polymarket]
Bill Clinton · Manifold Markets · 3d ago
Name something AI has gotten crazy good at in the last year. (Bilt Rent Free Jul 1, 2026)
Quroe 🫘 · Manifold Markets · 4d ago
More AI safety research and project ideas I haven’t seen elsewhere by Lloyd Rhodes-Brandon 🔹
Lloyd Rhodes-Brandon 🔹 · Nuno Sempere · 4d ago