Gradient Methods

 

 

 

Overview of week March 3-7

  1. Semi-Newton methods (Broyden's algorithm and Broyden-Farberg-Goldberg-Shanno algorithm)
  2. Steepest descent and conjugate gradient descent
  3. Stochastic gradient descent and variants thereof
  4. Automatic differentiation