- These lecture notes
- Video of lecture
- Whiteboard notes
- For a more in depth discussion on neural networks we recommend Goodfellow et al chapters 6 and 7.
- Neural Networks demystified at https://www.youtube.com/watch?v=bxe2T-V8XRs&list=PLiaHhY2iBX9hdHaRr6b7XevZtgZRa1PoU&ab_channel=WelchLabs
- Building Neural Networks from scratch at https://www.youtube.com/watch?v=Wo5dMEP_BbI&list=PLQVvvaa0QuDcjD5BAw2DxE6OF2tius3V3&ab_channel=sentdex
- Video on Neural Networks at https://www.youtube.com/watch?v=CqOfi41LfDw
- Video on the back propagation algorithm at https://www.youtube.com/watch?v=Ilg3gGewQ5U
I also recommend Michael Nielsen's intuitive approach to the neural networks and the universal approximation theorem, see the slides at http://neuralnetworksanddeeplearning.com/chap4.html.