The paper that killed deep learning theory

·Alignment Forum··

Around 10 years ago, a paper came out that arguably killed classical deep learning theory: Zhang et al.'s aptly titled Understanding deep learning requires rethinking generalization.Of course, this is a bit of an exaggeration. No single paper ever kills a field of research on its own, and deep learning theory was not exactly the most productive and healthy field at the time this was published. And the paper didn't come close to addressing all theoretical approaches to understanding aspects of de...

Read full article →

Related Articles

US–Indian space mission maps extreme subsidence in Mexico City
leopoldj · Hacker News · 5mo ago
A Misalignment of AI in Mathematics
Iuz · Hacker News · 22d ago
Why are neural networks and cryptographic ciphers so similar? (2025)
jxmorris12 · Hacker News · 5mo ago
Fun with polynomials and linear algebra; or, slight abstract nonsense
LolWolf · Hacker News · 5mo ago
The gauge broke: devs felt 20% faster with AI, measured 19% slower
intrepidkarthi · Hacker News · 3mo ago