14× faster embeddings: how we rebuilt the ONNX path in Manticore

·Hacker News··

Released in Manticore Search 27.1.5, the new ONNX Runtime backend makes auto-embeddings ~14× faster on average than the previous SentenceTransformers/Candle path on the same hardware, same model, same weights — and the margin holds whether you run 1 client thread or 32.

Read full article →

Related Articles

Since Linux 6.9, LUKS suspend stopped wiping disk-encryption keys from memory
IngoBlechschmid · Hacker News · 15h ago
Department of Commerce has lifted export controls on Claude Fable 5 and Mythos 5
Pragmata · Hacker News · 2d ago
Claude Code is steganographically marking requests
kirushik · Hacker News · 2d ago
Kimi K2.7 Code is generally available in GitHub Copilot
unliftedq · Hacker News · 1d ago
Postgres transactions are a distributed systems superpower
KraftyOne · Hacker News · 12h ago