Gradient-free Single-pass Model Beats nanoGPT on Shakespeare

·LessWrong··

Beam is a character-level language model that computes count tables mapping character contexts to next-character frequencies.At prediction time, each order mjx-container[jax="CHTML"] { line-height: 0; } mjx-container [space="1"] { margin-left: .111em; } mjx-container [space="2"] { margin-left: .167em; } mjx-container [space="3"] { margin-left: .222em; } mjx-container [space="4"] { margin-left: .278em; } mjx-container [space="5"] { margin-left: .333em; } mjx-container [rspace="1"] { margin-right:...

Read full article →

Related Articles

Nissan's third generation e-POWER powertrain
mroche · Hacker News · 9h ago
ASML says it sold 'absolutely nothing' in Europe in 2026
MC995 · Hacker News · 2d ago
Revealing the details of how OpenAI agents hacked Hugging Face
specked-citrus · Hacker News · 2d ago
Lunar Terminator Paradox
dima55 · Hacker News · 15h ago
"As a Language Model": Chat Template Switches LLM Self-Referential Voice
yu3zhou4 · Hacker News · 1d ago