What is backpropagation really doing? | Chapter 3, deep learning
What's actually happening to a neural network as it learns? Training data generation + T-shirt at http://3b1b.co/crowdflower Crowdflower does some cool work ...
==========
Here we tackle backpropagation, the core algorithm behind how neural networks learn. After a quick recap for where we are, the first thing I'll do is an intuitive walkthrough for what the algorithm is actually doing without any reference to the formulas, Then for those of you who do want to dive into the math, the next video goes into the calculus underlying all this. If you watched the last two videos or if you're just jumping in with the appropriate background, you know what a neural network is and how it feeds forward information. Here we're doing the classic example of recognizing handwritten digits, whose pixel values get fed into the first layer of the network with 784 neurons. And I've been showing a network with two hidden layers having just 16 neurons each, and...
==========
Here we tackle backpropagation, the core algorithm behind how neural networks learn. After a quick recap for where we are, the first thing I'll do is an intuitive walkthrough for what the algorithm is actually doing without any reference to the formulas, Then for those of you who do want to dive into the math, the next video goes into the calculus underlying all this. If you watched the last two videos or if you're just jumping in with the appropriate background, you know what a neural network is and how it feeds forward information. Here we're doing the classic example of recognizing handwritten digits, whose pixel values get fed into the first layer of the network with 784 neurons. And I've been showing a network with two hidden layers having just 16 neurons each, and...
