Human-Like Neural Nets by Catapulting

·Hacker News··

Speculative proposal to create artificial neural nets with human-like performance by high-learning-rate/regularization training of overparameterized NNs to trigger catapulting/grokking. Over-parameterization as a route to true generalization would resolve many outstanding mysteries of artificial versus natural intelligence.

Read full article →

Related Articles

Anthropic S-1
SiNTEx · Hacker News · 18h ago
Solar power is becoming bigger than nuclear
geox · Hacker News · 16h ago
The Exponential Time Hypothesis Is False [pdf]
vok · Hacker News · 9h ago
Oldest GUI application that still runs on Windows 11
enlyth · Hacker News · 13h ago
Type Server Protocol
adamnemecek · Hacker News · 13h ago