ggml-org/llama.cpp

GitHub Trending··

LLM inference in C/C++https://llama.appllama.cpp LLM inference in C/C++ ggml / ops / maintainer PRs / dev stats / lib llama API / llama-server REST API Quick start A few options to get llama.cpp installed on your machine: # curl curl -LsSf https://llama.app/install.sh | sh # powershell irm https://llama.app/install.ps1 | iex Visit https://llama.app and follow the instructions Run with Docker - see our Docker documentation Download pre-built binaries from the releases page Build from source by cl...

Read full article →

Related Articles

OpenAI’s o1 correctly diagnosed 67% of ER patients vs. 50-55% by triage doctors
donsupreme · Hacker News · 6mo ago
Accelerating Gemma 4: faster inference with multi-token prediction drafters
amrrs · Hacker News · 6mo ago
A couple million lines of Haskell: Production engineering at Mercury
unignorant · Hacker News · 6mo ago
Using “underdrawings” for accurate text and numbers
samcollins · Hacker News · 6mo ago
ProgramBench: Can language models rebuild programs from scratch?
jonbaer · Hacker News · 6mo ago