Unified Memory, Explained: Why Mini PCs Can Run 70B Models a Big GPU Can't

·Hacker News··

One idea explains the whole mini PC category: unified memory lets a $2,000 box hold a 70B model no consumer GPU can fit, then decode it slowly. The roofline math, the prompt-processing catch, the NPU red herring, and the owner-measured speeds.

Read full article →

Related Articles

Every AI model has the same "controversial" take on humans
rakannimer · Hacker News · 5h ago
Jailbreaking the Switch 2
ledoge · Hacker News · 14h ago
The recently proposed o(n log n) integer multiplication algorithm [pdf]
craigcitro · Hacker News · 19h ago
Security Disclosure
passenger · Hacker News · 1d ago
The 1.5°C goal of the Paris Agreement is no longer viable
velo_aprx · Hacker News · 1d ago