Home/AIWhat Are Tokens in LLMs?s1monb·Hacker News·AI·June 7, 2026How LLMs split text into tokens, the BPE algorithm, and why Read full article →Related ArticlesOpenAI’s o1 correctly diagnosed 67% of ER patients vs. 50-55% by triage doctorsdonsupreme · Hacker News · 1mo agoAccelerating Gemma 4: faster inference with multi-token prediction draftersamrrs · Hacker News · 1mo agoA couple million lines of Haskell: Production engineering at Mercuryunignorant · Hacker News · 1mo agoUsing “underdrawings” for accurate text and numberssamcollins · Hacker News · 1mo agoProgramBench: Can language models rebuild programs from scratch?jonbaer · Hacker News · 1mo ago