FareedKhan-dev/kimi-k3-in-c

GitHub Trending··

A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.https://medium.com/@fareedkhandev/building-kimi-k3-in-c-to-run-a-2-8t-model-on-consumer-hardware-a5792cbf3b59 kimi-k3-in-c A 2.78-trillion-parameter model. One CPU. 8 GB of RAM. Kimi K3 inference in portable C99.No BLAS. No framework. No GPU. 2.78Tparameters 1.56 TBcheckpoint on disk 8.24 GBpeak RSS, measured 176 KBthe whole engine 0GPUs The same 2.78-trillion-parame...

Read full article →

Related Articles

OpenAI’s o1 correctly diagnosed 67% of ER patients vs. 50-55% by triage doctors
donsupreme · Hacker News · 6mo ago
Accelerating Gemma 4: faster inference with multi-token prediction drafters
amrrs · Hacker News · 6mo ago
A couple million lines of Haskell: Production engineering at Mercury
unignorant · Hacker News · 6mo ago
Using “underdrawings” for accurate text and numbers
samcollins · Hacker News · 6mo ago
ProgramBench: Can language models rebuild programs from scratch?
jonbaer · Hacker News · 6mo ago