How to compress text to 1 bit per character | Compression is Intelligence Part 3
How arithmetic coding turns a language model's predictions into a near-optimal compression scheme.
Nov 17, 2026
Lesson by Grant Sanderson, with visuals by Aaron Gostein, Mitchell Zemil, Claire Vermillion, Paul Dancstep and Nishad Deulkar

Previous Lesson
But what is Cross-Entropy? | Compression is Intelligence Part 2

Next Lesson
Solving Wordle using information theory