# Neural Networks

The basics of neural networks, and the math behind how they learn

But what is a Neural Network?An overview of what a neural network is, introduced in the context of recognizing hand-written digits.Chapter 1Oct 5, 2017

Gradient descent, how neural networks learnAn overview of gradient descent in the context of neural networks. This is a method used widely throughout machine learning for optimizing how a computer performs on certain tasks.Chapter 2Oct 16, 2017

Analyzing our neural networkChapter 3Oct 16, 2017

What is backpropagation really doing?An overview of backpropagation, the algorithm behind how neural networks learn.Chapter 4Nov 3, 2017

Backpropagation calculusThe math of backpropagation, the algorithm by which neural networks learn.Chapter 5Nov 3, 2017

But what is a GPT? Visual intro to Transformers | Deep learning, chapter 5A visual introduction to transformers. This chapter focusses on the overall structure, and word embeddingsApr 1, 2024

Visualizing Attention, a Transformer's Heart | Chapter 6, Deep LearningDemystifying attention, the key mechanism inside transformers and LLMs.Apr 7, 2024

How might LLMs store facts | Chapter 7, Deep LearningUnpacking the multilayer perceptrons in a transformer, and how they may store facts.Aug 31, 2024