Unified Memory, Explained: Why Mini PCs Can Run 70B Models a Big GPU Can't

·Hacker News··

One idea explains the whole mini PC category: unified memory lets a $2,000 box hold a 70B model no consumer GPU can fit, then decode it slowly. The roofline math, the prompt-processing catch, the NPU red herring, and the owner-measured speeds.

Read full article →

Related Articles

AI-generated videos to maximally drive a target brain region
smusamashah · Hacker News · 9h ago
The glass backbone: Why the Army's logistics will break in the next war
baud147258 · Hacker News · 1d ago
Postgres rewritten in Rust, now passing 100% of the Postgres regression tests
SweetSoftPillow · Hacker News · 1d ago
No leap second will be introduced at the end of December 2026
ChrisArchitect · Hacker News · 1d ago
QuadRF can spot drones and see WiFi through my wall
speckx · Hacker News · 1h ago