Will OpenAI rename to OpenSI in 2026?
7% — undefined traders, $6291 volume
Articles across AI, biotech, forecasting, and emerging tech.
7% — undefined traders, $6291 volume
73% — undefined traders, $4123 volume
[Subtitle.] I interviewed dozens of biosecurity experts. The fear that AI will enable lone wolves to build pandemics is a case study in how domain expertise gets sidelined.This is a crosspost for Why AI-assisted bioweapons won’t kill us all by Abi Olvera, which was published on Positive Sum on 20 July 2026. Here is a response from Olivia Scharfman, and here is Abi’s reply to it.Some of my friends think we are going to die because AI will make building a bioweapon easier.T...
10% — undefined traders, $5560 volume
99% — undefined traders, $5511 volume
26% — undefined traders, $3685 volume
4% — undefined traders, $9206 volume
IntroductionTom Davidson and Tom Houlden’s prior model of an intelligence explosion poses the question: after AIs can entirely substitute for human researchers at the task of improving AI, how many year-equivalents of AI progress might be packed into a short period of time solely from further software progress, holding hardware constant?In this article, I build upon Davidson & Houlden’s model by reconsidering arguments for several parameter values. My chief c...
Epistemic status: I wrote this up hoping people can poke holes in it because I am quite worried.Here’s what we’ve heard so far:Local media is reporting that an employee of a BSL-3 lab in Irkutsk, Russia, died of pneumonic plague on Oct 1st.The initial quarantine covered 200 people who were in contact with the employee before she died.The FSB (Russian FBI) was seen assisting in the quarantine, which means it was not voluntary.Soviet-era whistleblowers like Ken Alibek cl...
6% — undefined traders, $15536 volume
15% — undefined traders, $4357 volume
This post was originally written for my Substack. Please feel free to subscribe if this kind of content interests you!Frontier AI companies have long had the stated goal of automating their own research. The default plan has been to build models that are even better than their most skilled researchers at advancing the frontier, and let these models build their own successors; a feedback loop that will ultimately result in superintelligence that dwarfs the collec...
1. Executive Summary1.1 What this field is and why it mattersAI is already substantially changing how people and institutions work out what to believe, decide what to do, and coordinate on actions to take. As AI systems become increasingly capable, they will be integrated more and more in both major and day-to-day decisions.The upside of involving AI systems in these processes could be enormous. AI tools for epistemics and coordination could make it easier t...
6% — undefined traders, $364720 volume
3% — undefined traders, $9549 volume
24% — undefined traders, $130299 volume
37% — undefined traders, $9457 volume
64% — undefined traders, $9579 volume
Cross-posted from my Substack. The criticality of a response to highly capable open models is becoming urgent, as Anthropic demonstrates the risk from the recent GLM-5.3 release. While loss-of-control is an critical topic, this is the topic most likely to cause chaos in the next 6-12 months. If practices don’t change, I’d say there’s a 50% chance that many Internet based services will have to take themselves offline for extended periods to address security because t...
This is a research proposal and request for criticism. The experiments and benchmark results are not being reported in this post.The research questionHow can a local safety layer stop an AI agent from operating machinery when doing so would put a nearby human at risk? Imagine an AI agent interacts with a physical environment such as opening a high pressure valve or starting a motor while someone is in harm’s way, the agent requests an action but the safety lay...
From August 2024 to May 2025, I worked with AI Watch, collaborating with a global team to map the AI safety landscape — researching organisations, tools, and products, and building a database of who’s doing what in the field.The work involved time-sensitive literature reviews, extracting details on labs and safety initiatives (from OpenAI to smaller research groups), and structured data analysis.What surprised me most: how concentrated the field is in the US/UK/...
This article was written by Jonah Woodward, and is a summary of an original study by Compassion Aligned Machine Learning (CaML): Brazilek, J., Tidmarsh, M., Endres, M., Singh, A., & Miller, J. (2026). HarvestBench: Measuring whether LLM agents will pay to avoid killing animals. arXiv. https://doi.org/10.48550/arXiv.2609.04444 You can view the up-to-date results for HarvestBench on the leaderboard at https://compassionbench.com/harvestbench TL;DRHarvestBench e...
10% — undefined traders, $39892 volume
After more than two years, I have finally published a new A Happier World video!This time I explored the connection between a hidden river in Brussels, a visit by Bill Gates to the city’s sewers, and pandemic prevention.I interviewed @Jeff Kaufman 🔸 and @Will Bradshaw from SecureBio Detection (formerly the Nucleic Acid Observatory), people working at Sciensano (essentially the CDC of Belgium), and someone from the Brussels Sewer Museum. Would love to hear what yo...
Note: This post was crossposted from Planned Obsolescence by the Forum team, with the author’s permission. The author may not see or respond to comments on this post.Subtitle: We can’t develop safety standards if we have to rely on opaque judgmentAll views are my own and do not represent my employer.In the wake of the recent wave of misalignment incidents, both OpenAI and Anthropic have reported slowing down RL training to improve safety. These incidents, combined...
28% — undefined traders, $6120 volume
This lightly-edited version of a memo that I presented at the Summer 2026 Biosecurity Summit outside of DC. While others at SecureBio often see things similarly, I’m attempting to present my view and not a SecureBio “house view”.The GoalWe need to be robust to adversaries who want to cause very large-scale harm with biology. This includes actors (human or AI) who want to kill all humans, cause short-term incapacitation or long-term civilizational collapse, or who ...
4% — undefined traders, $1032 volume
I made a terrain style visualisation of AI safety impact of around 3,466 works organised by citation count! The data was extracted from Arxiv and LessWrong posts based on a dictionary of keywords that appear in AI safety works. Additionally, I think its important to see how the field has “evolved” over time so I added a time functionality to slide and see the hills forming.The map is based on how particular works overlap based on embedding space level clustering or...
18% — undefined traders, $11768 volume
2% — undefined traders, $10650 volume
30% — undefined traders, $12638 volume
1% — undefined traders, $1089 volume
Kunvar Thaman’s Reward Hacking Benchmark: Measuring Exploits in LLM Agents Tool Use (https://arxiv.org/abs/2605.02964) evaluates 13 frontier models on multi-step, tool-use tasks that each contain a built-in shortcut: skipping a verification step, inferring an answer from metadata rather than doing the task, or tampering with a function the evaluation itself depends on.The finding I keep coming back to: in 72% of the reward hacking episodes recorded, the m...
99% — undefined traders, $15116 volume
98% — undefined traders, $12573 volume
1% — undefined traders, $36332 volume
99% — undefined traders, $10195 volume