Show HN: Run an 80B Qwen in 4.3 GB of RAM on a Mac, and a 35B on an iPhone

·Hacker News··

Contribute to leonickson1/Swiftlet development by creating an account on GitHub.

Read full article →

Related Articles

Ten advances in mathematics and theoretical computer science
milkshakes · Hacker News · 12h ago
MiniMax H3 Day-0 Support in ComfyUI: Open Weights, Native Audio, and 2K Video
vblanco · Hacker News · 15h ago
AirLLM 70B inference with single 4GB GPU
Anon84 · Hacker News · 17h ago
Rust project goals: Immobile types and guaranteed destructors
paavohtl · Hacker News · 22h ago
Show HN: Shitty – fast terminal. Memory-unsafe and faster than yours
pshirshov · Hacker News · 1d ago