If the matrix to diagonalize is large and sparse, direct methods simply become impractical, also because many of the direct methods tend to destroy sparsity. As a result large dense matrices may arise during the diagonalization procedure. The idea behind iterative methods is to project the $n-$dimensional problem in smaller spaces, so-called Krylov subspaces. Given a matrix A and a vector v, the associated Krylov sequences of vectors (and thereby subspaces) v, Av, A2v, A3v,…, represent successively larger Krylov subspaces.
Matrix | Ax=b | Ax=λx |
A=A∗ | Conjugate gradient | Lanczos |
A≠A∗ | GMRES etc | Arnoldi |