Processing math: 100%

 

 

 

Conjugate gradient method

Let ˆrk be the residual at the k-th step:

ˆrk=ˆbˆAˆxk.

Note that ˆrk is the negative gradient of f at ˆx=ˆxk, so the gradient descent method would be to move in the direction ˆrk. Here, we insist that the directions ˆpk are conjugate to each other, so we take the direction closest to the gradient ˆrk under the conjugacy constraint. This gives the following expression

ˆpk+1=ˆrkˆpTkˆAˆrkˆpTkˆAˆpkˆpk.