Lecture October 14, 2024

  1. Building our own Feed-forward Neural Network and discussion of project 2
  1. These lecture notes
  2. Video of lecture
  3. Whiteboard notes
  4. For a more in depth discussion on neural networks we recommend Goodfellow et al chapters 6 and 7.
  5. Neural Networks demystified at https://www.youtube.com/watch?v=bxe2T-V8XRs&list=PLiaHhY2iBX9hdHaRr6b7XevZtgZRa1PoU&ab_channel=WelchLabs
  6. Building Neural Networks from scratch at https://www.youtube.com/watch?v=Wo5dMEP_BbI&list=PLQVvvaa0QuDcjD5BAw2DxE6OF2tius3V3&ab_channel=sentdex
  7. Video on Neural Networks at https://www.youtube.com/watch?v=CqOfi41LfDw
  8. Video on the back propagation algorithm at https://www.youtube.com/watch?v=Ilg3gGewQ5U

I also recommend Michael Nielsen's intuitive approach to the neural networks and the universal approximation theorem, see the slides at http://neuralnetworksanddeeplearning.com/chap4.html.