Same model, same Q4_K_M label: 5.02, 5.07 and 5.27 bits per weight

·Hacker News··

Catches silent CPU fallback and mislabeled tok/s in local LLMs. llama.cpp and ollama, one file, no deps. - logxio/picchio

Read full article →

Related Articles

EPA says power for data centers can sidestep pollution laws
Levitating · Hacker News · 12h ago
Pentagon's blacklisting of Anthropic was unlawful, US judge rules
softwaredoug · Hacker News · 14h ago
Saving 100 terabytes of memory by optimizing 1.1.1.1's DNS cache
TangerineDream · Hacker News · 1d ago
We found a division by zero bug in FFmpeg with a vibecoded fuzzer
dclavijo · Hacker News · 1d ago
Autistici/Inventati's main .org domain goes dark after US terrorism designation
subvol · Hacker News · 11h ago