Computer Science

How to compress text to 1 bit per character | Compression is Intelligence Part 3

How arithmetic coding turns a language model's predictions into a near-optimal compression scheme.

Nov 17, 2026
Lesson by Grant Sanderson, with visuals by Aaron Gostein, Mitchell Zemil, Claire Vermillion, Paul Dancstep and Nishad Deulkar
Previous Lesson
But what is Cross-Entropy? | Compression is Intelligence Part 2
Next Lesson
Solving Wordle using information theory