Steepest descent method

One can show that the solution ˆx is also the unique minimizer of the quadratic form

f(ˆx)=12ˆxTˆAˆxˆxTˆx,ˆxRn.

This suggests taking the first basis vector ˆr1 (see below for definition) to be the gradient of f at ˆx=ˆx0, which equals

ˆAˆx0ˆb,

and ˆx0=0 it is equal ˆb.