Week 38: Statistical analysis, bias-variance tradeoff and resampling methods

 

 

 

Plans for week 38, lecture Monday September 15

  1. Statistical interpretation of OLS and various expectation values
  2. Resampling techniques, Bootstrap and cross validation and bias-variance tradeoff
  3. The material we did not cover last week, that is on more advanced methods for updating the learning rate, are covered by its own video. We will briefly discuss these topics at the beginning of the lecture and during the lab sessions. See video on ADAgrad, RMSprop and ADAM (material from last week not covered during lecture) at https://youtu.be/J_41Hld6tTU
  4. Video of Lecture
  5. Video from lab sessions on the bias-variance tradeoff
  6. Whiteboard notes