Catastrophic Forgetting and Safety Erosion Are Driven by the Same Mechanism and Should Be Monitored by the Same Tools

·LessWrong··

This paper is about an observation I made, as an outsider to two distinct research currents in artificial intelligence, regarding the similarity of the phenomenon they each observe and the potential for these two fields to converge toward shared tools. You will find a mix of established results, some unreviewed papers, and my own proposals, all clearly labeled so as not to be misleading.I enjoy thinking and learning about the stakes and the broad principles of LLMs, and I often have a "why not t...

Read full article →

Related Articles

What happened to the Snowden archive
EXHades · Hacker News · 22h ago
The NASA/ESA Mars Sample Return mission has been canceled
Muhammad523 · Hacker News · 2h ago
Samsung is expected to more than double output of its HBM4 and HBM4E DRAM
giuliomagnifico · Hacker News · 1d ago
Ask HN: Is it impossible to disable Siri on macOS 27?
semidror · Hacker News · 8h ago
Qwen Image 2.1
jmillikin · Hacker News · 1d ago