Reiner Pope – The math behind how LLMs are trained and served

·Dwarkesh Patel··

Did a very different format with Reiner Pope - a blackboard lecture where he walks through how frontier LLMs are trained and served.It’s shocking how much you can deduce about what the labs are doing from a handful of equations, public API prices, and some chalk.It’s a bit technical, but I encourage you to hang in there – it’s really worth it.There are less than a handful of people in the world who understand the full stack of AI, from chip design to model architecture, as well as Reiner. It was...

Read full article →

Related Articles

OpenAI’s o1 correctly diagnosed 67% of ER patients vs. 50-55% by triage doctors
donsupreme · Hacker News · 2mo ago
Accelerating Gemma 4: faster inference with multi-token prediction drafters
amrrs · Hacker News · 2mo ago
A couple million lines of Haskell: Production engineering at Mercury
unignorant · Hacker News · 2mo ago
Show HN: I trained a language model that thinks the capital of Japan is Paris
farisallafi · Hacker News · 9h ago
Using “underdrawings” for accurate text and numbers
samcollins · Hacker News · 2mo ago