Benchmarking Qwen3.8 27B quantizations: 4-bit holds up, 1-bit collapses

·Hacker News··

I test Unsloth GGUFs of Qwen3.8 27B (Q4_K_M, UD-Q2_K_XL, UD-IQ1_S) with llama.cpp on GPQA Diamond, IFBench, Terminal-Bench 2.1. Q4_K_M matches BF16 abd fits an RTX 4090.

Read full article →

Related Articles

Every AI model has the same "controversial" take on humans
rakannimer · Hacker News · 1d ago
UUIDv7 doesn't have the properties you think it does
ibobev · Hacker News · 6h ago
Pentagon grants DHS permission to test heat ray weapon for use at border
bushwart · Hacker News · 8h ago
Jailbreaking the Switch 2
ledoge · Hacker News · 1d ago
The 1.5°C goal of the Paris Agreement is no longer viable
velo_aprx · Hacker News · 2d ago