Neural Networks
The basics of neural networks, and the math behind how they learn
But what is a Neural Network?An overview of what a neural network is, introduced in the context of recognizing hand-written digits.Chapter 1Oct 5, 2017
Gradient descent, how neural networks learnAn overview of gradient descent in the context of neural networks. This is a method used widely throughout machine learning for optimizing how a computer performs on certain tasks.Chapter 2Oct 16, 2017
Analyzing our neural networkChapter 3Oct 16, 2017
What is backpropagation really doing?An overview of backpropagation, the algorithm behind how neural networks learn.Chapter 4Nov 3, 2017
Backpropagation calculusThe math of backpropagation, the algorithm by which neural networks learn.Chapter 5Nov 3, 2017
But what is a GPT? Visual intro to Transformers | Deep learning, chapter 5A visual introduction to transformers. This chapter focusses on the overall structure, and word embeddingsApr 1, 2024
Visualizing Attention, a Transformer's Heart | Chapter 6, Deep LearningDemystifying attention, the key mechanism inside transformers and LLMs.Apr 7, 2024
How might LLMs store facts | Chapter 7, Deep LearningUnpacking the multilayer perceptrons in a transformer, and how they may store facts.Aug 31, 2024