Persistent State Machines: LLM Attention with INT4 In-Memory Cells

·Hacker News··

Persistent State Machines: Complete Mathematical Proofs and Vivado Implementation Synthesis (Version 8.0) ABSTRACT We present a formal discrete framework for attention operators in Large Language Models via Persistent State Machines (PSMs). Computation is broadcast to stationary in-memory cells that evaluate local deterministic state transitions. Complete mathematical proofs are given for quantization error bounds, a concrete multi-phase discrete Softmax construction under an explicit bounded-lo

Read full article →

Related Articles

We got admin access to Baseten's production GitHub in 25 minutes
bearsyankees · Hacker News · 9h ago
Building a Linux GPU Driver for the M4 Mac Mini in One Month
ADevWithAnIdea · Hacker News · 8h ago
Show HN: An e-ink frame that hears birds and draws them as 1800s illustrations
arnemunthekaas · Hacker News · 15h ago
America's Driver's License Breach Is a National Security Disaster
hn_acker · Hacker News · 12h ago
How much oil-market buffer is left?
mcone · Hacker News · 8h ago