The paper that killed deep learning theory

·Alignment Forum··

Around 10 years ago, a paper came out that arguably killed classical deep learning theory: Zhang et al.'s aptly titled Understanding deep learning requires rethinking generalization.Of course, this is a bit of an exaggeration. No single paper ever kills a field of research on its own, and deep learning theory was not exactly the most productive and healthy field at the time this was published. And the paper didn't come close to addressing all theoretical approaches to understanding aspects of de...

Read full article →

Related Articles

US–Indian space mission maps extreme subsidence in Mexico City
leopoldj · Hacker News · 20d ago
Why are neural networks and cryptographic ciphers so similar? (2025)
jxmorris12 · Hacker News · 19d ago
Fun with polynomials and linear algebra; or, slight abstract nonsense
LolWolf · Hacker News · 20d ago
The Mathematical Dance Inside Plant Cells
isaacfrond · Hacker News · 16d ago
Easy Random Trees
aebtebeten · Hacker News · 15d ago