This week we will discuss during the first hour of each lab session some technicalities related to the project and methods for updating the learning like ADAgrad, RMSprop and ADAM. As teaching material, see the jupyter-notebook from week 37 (September 12-16).
For the lab session, the following video on cross validation (from 2024), could be helpful, see https://www.youtube.com/watch?v=T9jjWsmsd1o
See also video on ADAgrad, RMSprop and ADAM (material from last week not covered during lecture) at https://youtu.be/J_41Hld6tTU