25M parameter LLM

Tutorials

Create and Train a 25M-Parameter LLM from Scratch Using Only Your CPU

A tutorial shows building, pre-training, and fine-tuning a 25M-parameter LLM on CPU, covering architecture, loss, and reinforcement learning.

Oct 18, 2026