The paper that killed deep learning theory

·Alignment Forum··

Around 10 years ago, a paper came out that arguably killed classical deep learning theory: Zhang et al.'s aptly titled Understanding deep learning requires rethinking generalization.Of course, this is a bit of an exaggeration. No single paper ever kills a field of research on its own, and deep learning theory was not exactly the most productive and healthy field at the time this was published. And the paper didn't come close to addressing all theoretical approaches to understanding aspects of de...

Read full article →

Related Articles

Welfare Biology and AI: The Psychopath, the Nematode, and the Arahant
Dawn Drescher · EA Forum · 4d ago
Immigration changes are driving foreign researchers to leave the U.S. — or not come to begin with 
Andrew Joseph · STAT News · 4d ago
Models Recall What They Violate: Constraint Adherence in Multi-Turn LLM Ideation
Garvin Kruthof · ArXiv cs.AI · 4d ago
Looking for papers on general formalizations of "agency"
lovagrus · LessWrong · 5d ago
SFF’s HSEE grant round; human intelligence amplification projects I’d like to see by TsviBT
TsviBT · Nuno Sempere · 8d ago