WebLLM: high-performance in-browser LLM inference engine

·Hacker News··

High-performance In-browser LLM Inference Engine . Contribute to mlc-ai/web-llm development by creating an account on GitHub.

Read full article →

Related Articles

Three sites made 215,128 “best software” pages for AI. Perplexity cites them
jakobgreenfeld · Hacker News · 1h ago
The ChatGPT/Codex app bundles a full copy of LibreOffice
timpera · Hacker News · 19h ago
GrapheneOS says Pixel 11 has MTE support after all
user_7832 · Hacker News · 1h ago
The Emergent Symbolic Structure of Artificial Neural Networks
schmuhblaster · Hacker News · 11h ago
I trained a small transformer in 1.5hrs and it beats many LLMs
porridgeraisin · Hacker News · 1d ago