Gradient-free Single-pass Model Beats nanoGPT on Shakespeare

·LessWrong··

Beam is a character-level language model that computes count tables mapping character contexts to next-character frequencies.At prediction time, each order mjx-container[jax="CHTML"] { line-height: 0; } mjx-container [space="1"] { margin-left: .111em; } mjx-container [space="2"] { margin-left: .167em; } mjx-container [space="3"] { margin-left: .222em; } mjx-container [space="4"] { margin-left: .278em; } mjx-container [space="5"] { margin-left: .333em; } mjx-container [rspace="1"] { margin-right:...

Read full article →

Related Articles

Spaghettifying DRAM
matt_d · Hacker News · 6h ago
DeepSeek V4 Pro 0813
explosion-s · Hacker News · 1d ago
Heart aerospace completes first flight of largest electric aircraft
chha · Hacker News · 6h ago
Nine PBS could lose 70 years of archives after cloud vendor goes defunct
vinayakborkar · Hacker News · 7h ago
Tracking down the 16-year-old WAL-reset SQLite bug
ropbear · Hacker News · 1d ago