Autoregressive Inference

Beginner Basics

Part 2 traces the evolution of transformer architecture from vanilla transformers to modern LLMs.

This explains query, key, value attention, autoregressive generation, KV Cache reuse, GPU memory growth, and MQA, GQA, MLA reduce LLM serving costs.

Oct 31, 2026