Preface |
|
xi | |
1 Introduction |
|
1 | |
|
1.1 On the origin of iterative methods |
|
|
3 | |
|
1.2 Further arguments for iterative methods |
|
|
8 | |
|
|
10 | |
|
|
11 | |
2 Mathematical preliminaries |
|
15 | |
|
|
15 | |
|
2.2 Eigenvalues and eigenvectors |
|
|
17 | |
3 Basic iteration methods |
|
21 | |
|
|
21 | |
|
3.2 The Krylov subspace approach |
|
|
25 | |
|
|
27 | |
|
3.3.1 A more accurate basis for the Krylov subspace |
|
|
30 | |
4 Construction of approximate solutions |
|
33 | |
|
4.1 The RitzGalerkin approach |
|
|
33 | |
|
4.2 The minimum norm residual approach |
|
|
34 | |
|
4.3 The PetrovGalerkin approach |
|
|
34 | |
|
4.4 The minimum norm error approach |
|
|
36 | |
5 The Conjugate Gradients method |
|
37 | |
|
5.1 Derivation of the method |
|
|
37 | |
|
|
41 | |
|
5.3 The convergence of Conjugate Gradients |
|
|
47 | |
|
5.3.1 Local effects in the convergence behaviour |
|
|
50 | |
|
5.4 CG and the normal equations |
|
|
57 | |
|
|
63 | |
6 GMRES and MINRES |
|
65 | |
|
|
65 | |
|
6.1.1 A residual vector variant of GMRES |
|
|
71 | |
|
|
74 | |
|
6.2 The convergence behaviour of GMRES |
|
|
76 | |
|
6.3 Some numerical illustrations |
|
|
78 | |
|
|
84 | |
|
6.5 Rank-one updates for the matrix splitting |
|
|
87 | |
|
|
91 | |
7 Bi-Conjugate Gradients |
|
95 | |
|
7.1 Derivation of the method |
|
|
95 | |
|
7.2 Another derivation of Bi-CG |
|
|
97 | |
|
|
98 | |
|
|
102 | |
|
7.4.1 Numerical illustrations |
|
|
106 | |
|
7.5 Complex symmetric systems |
|
|
107 | |
8 How serious is irregular convergence? |
|
115 | |
|
|
117 | |
|
8.2 Rounding errors and discretization errors |
|
|
119 | |
|
8.3 Effects of rounding errors to Krylov processes |
|
|
121 | |
|
8.3.1 The Lanczos recurrence in finite precision |
|
|
123 | |
|
8.3.2 Effects of rounding errors on implementations |
|
|
128 | |
|
8.3.3 Some considerations for CG |
|
|
131 | |
9 Bi-CGSTAB |
|
133 | |
|
9.1 A more smoothly converging variant of CGS |
|
|
133 | |
|
9.2 Bi-CGSTAB(2) and variants |
|
|
138 | |
|
9.3 More general hybrid Bi-CG methods |
|
|
141 | |
|
9.3.1 Numerical experiments |
|
|
145 | |
10 Solution of singular systems |
|
147 | |
|
10.1 Only nonzero eigenvalues matter |
|
|
147 | |
|
10.2 Pure Neumann problems |
|
|
148 | |
11 Solution of f (A)x = b with Krylov subspace information |
|
151 | |
|
|
151 | |
|
|
152 | |
|
11.3 Computation of the inverse of f (11m,m) |
|
|
154 | |
|
|
155 | |
|
11.5 Matrix sign function |
|
|
157 | |
12 Miscellaneous |
|
159 | |
|
12.1 Termination criteria |
|
|
159 | |
|
12.2 Implementation aspects |
|
|
160 | |
|
12.3 Parallelism and data locality in CG |
|
|
162 | |
|
12.4 Parallel performance of CG |
|
|
166 | |
|
12.4.1 Processor configuration and data distribution |
|
|
167 | |
|
12.4.2 Required communication |
|
|
168 | |
|
12.5 Parallel implementation of GMRES(m) |
|
|
169 | |
13 Preconditioning |
|
173 | |
|
|
173 | |
|
13.2 Incomplete LU factorizations |
|
|
178 | |
|
13.2.1 An example of incomplete decompositions |
|
|
183 | |
|
13.2.2 Efficient implementations of ILU(0) preconditioning |
|
|
186 | |
|
13.3 Changing the order of computation |
|
|
187 | |
|
13.4 Reordering the unknowns |
|
|
188 | |
|
13.5 Variants of ILU preconditioners |
|
|
192 | |
|
|
193 | |
|
13.7 Element by element preconditioners |
|
|
196 | |
|
13.8 Polynomial preconditioning |
|
|
196 | |
|
13.9 Sparse Approximate Inverse (SPAI) |
|
|
197 | |
|
13.10 Preconditioning by blocks or domains |
|
|
199 | |
|
13.10.1 Canonical enhancement of a linear system |
|
|
200 | |
|
13.10.2 Interface coupling matrix |
|
|
202 | |
|
|
203 | |
References |
|
205 | |
Index |
|
219 | |