Persistent State Machines: LLM Attention with INT4 In-Memory Cells

·Hacker News··

Persistent State Machines: Complete Mathematical Proofs and Vivado Implementation Synthesis (Version 8.0) ABSTRACT We present a formal discrete framework for attention operators in Large Language Models via Persistent State Machines (PSMs). Computation is broadcast to stationary in-memory cells that evaluate local deterministic state transitions. Complete mathematical proofs are given for quantization error bounds, a concrete multi-phase discrete Softmax construction under an explicit bounded-lo

Read full article →

Related Articles

Backdoor in Claude Code for VS Code extension on the Cursor Marketplace
_chall · Hacker News · 21h ago
Backdoors in official Claude Code extensions
dsr_ · Hacker News · 17h ago
Show HN: A working Nintendo in ~1GB of Qwen weights
dbreunig · Hacker News · 12h ago
We're releasing the weights of Mistral Large 4
kuberwastaken · Hacker News · 1d ago
Google Search is now less than half of Alphabet’s revenue
hubraumhugo · Hacker News · 1d ago