Training a 3.8B LLM to 0.384 CORE for $998

·Hacker News··

A 3.8B model pretrained from scratch to 0.384 CORE on 65B tokens in 43 hours, for $998.

Read full article →

Related Articles

Anthropic S-1
SiNTEx · Hacker News · 1d ago
Solar power is becoming bigger than nuclear
geox · Hacker News · 1d ago
Python's experimental JIT to be removed
f311a · Hacker News · 5h ago
The Exponential Time Hypothesis Is False [pdf]
vok · Hacker News · 19h ago
Oldest GUI application that still runs on Windows 11
enlyth · Hacker News · 23h ago