Persistent State Machines: LLM Attention with INT4 In-Memory Cells

Researchers introduced Persistent State Machines (PSMs) as a formal framework for attention mechanisms in large language models, providing mathematical proofs and FPGA implementations demonstrating low power and efficient operation.