|
|
1 | |
|
1.1 Solving Systems of Linear Equations |
|
|
1 | |
|
|
10 | |
|
1.1.1.1 Floating Point Arithmetic |
|
|
10 | |
|
1.1.1.2 Arithmetic Operations |
|
|
11 | |
|
1.1.1.3 Loss of Significance |
|
|
12 | |
|
|
13 | |
|
1.1.2.1 Creating Matrices in MATLAB |
|
|
13 | |
|
1.2 The Special Case of "Square" Systems |
|
|
17 | |
|
1.2.1 The Henderson Searle Formulas |
|
|
21 | |
|
1.2.2 Schur Complements and the Sherman-Morrison-Woodbury Formula |
|
|
24 | |
|
|
37 | |
|
1.2.3.1 Computing Inverse Matrices |
|
|
37 | |
|
|
39 | |
|
|
39 | |
|
|
39 | |
|
2 Generating Invertible Matrices |
|
|
41 | |
|
2.1 A Brief Review of Gauss Elimination with Back Substitution |
|
|
41 | |
|
|
47 | |
|
2.1.1.1 Solving Systems of Linear Equations |
|
|
47 | |
|
|
49 | |
|
2.2.1 The Minimal Polynomial |
|
|
57 | |
|
2.3 The LU and LDU Factorization |
|
|
63 | |
|
|
75 | |
|
2.3.1.1 The LU Factorization |
|
|
75 | |
|
2.4 The Adjugate of a Matrix |
|
|
76 | |
|
2.5 The Frame Algorithm and the Cayley-Hamilton Theorem |
|
|
81 | |
|
2.5.1 Digression on Newton's Identities |
|
|
85 | |
|
2.5.2 The Characteristic Polynomial and the Minimal Polynomial |
|
|
90 | |
|
|
95 | |
|
2.5.3.1 The Frame Algorithm |
|
|
95 | |
|
|
95 | |
|
2.5.4.1 Polynomials in MATLAB |
|
|
95 | |
|
3 Subspaces Associated to Matrices |
|
|
99 | |
|
3.1 Fundamental Subspaces |
|
|
99 | |
|
|
109 | |
|
3.1.1.1 The Fundamental Subspaces |
|
|
109 | |
|
3.2 A Deeper Look at Rank |
|
|
111 | |
|
3.3 Direct Sums and Idempotents |
|
|
117 | |
|
3.4 The Index of a Square Matrix |
|
|
128 | |
|
|
147 | |
|
3.4.1.1 The Standard Nilpotent Matrix |
|
|
147 | |
|
3.5 Left and Right Inverses |
|
|
148 | |
|
4 The Moore-Penrose Inverse |
|
|
155 | |
|
4.1 Row Reduced Echelon Form and Matrix Equivalence |
|
|
155 | |
|
|
160 | |
|
|
167 | |
|
4.1.2.1 Row Reduced Echelon Form |
|
|
167 | |
|
|
169 | |
|
4.1.3.1 Pivoting Strategies |
|
|
169 | |
|
|
170 | |
|
4.2 The Hermite Echelon Form |
|
|
171 | |
|
4.3 Full Rank Factorization |
|
|
176 | |
|
|
179 | |
|
4.3.1.1 Full Rank Factorization |
|
|
179 | |
|
4.4 The Moore-Penrose Inverse |
|
|
179 | |
|
|
190 | |
|
4.4.1.1 The Moore-Penrose Inverse |
|
|
190 | |
|
4.5 Solving Systems of Linear Equations |
|
|
190 | |
|
4.6 Schur Complements Again (optional) |
|
|
194 | |
|
|
199 | |
|
|
199 | |
|
|
208 | |
|
5.3 Constructing Other Generalized Inverses |
|
|
210 | |
|
|
217 | |
|
|
223 | |
|
|
230 | |
|
|
233 | |
|
6.1 The Normed Linear Space Cn |
|
|
233 | |
|
|
244 | |
|
|
252 | |
|
|
252 | |
|
|
257 | |
|
7.1 The Inner Product Space C" |
|
|
257 | |
|
7.2 Orthogonal Sets of Vectors in CI' |
|
|
262 | |
|
|
269 | |
|
7.2.1.1 The Gram-Schmidt Process |
|
|
269 | |
|
|
269 | |
|
|
274 | |
|
|
276 | |
|
7.3.2.1 The QR Factorization |
|
|
276 | |
|
7.4 A Fundamental Theorem of Linear Algebra |
|
|
278 | |
|
7.5 Minimum Norm Solutions |
|
|
282 | |
|
|
285 | |
|
|
291 | |
|
8.1 Orthogonal Projections |
|
|
291 | |
|
8.2 The Geometry of Subspaces and the Algebra of Projections |
|
|
299 | |
|
8.3 The Fundamental Projections of a Matrix |
|
|
309 | |
|
|
313 | |
|
8.3.1.1 The Fundamental Projections |
|
|
313 | |
|
8.4 Full Rank Factorizations of Projections |
|
|
313 | |
|
|
315 | |
|
8.6 Quotient Spaces (optional) |
|
|
324 | |
|
|
329 | |
|
|
329 | |
|
|
337 | |
|
9.1.1.1 Eigenvalues and Eigenvectors in MATLAB |
|
|
337 | |
|
|
338 | |
|
9.3 The Square Root and Polar Decomposition Theorems |
|
|
347 | |
10 Matrix Diagonalization |
|
351 | |
|
10.1 Diagonalization with Respect to Equivalence |
|
|
351 | |
|
10.2 Diagonalization with Respect to Similarity |
|
|
357 | |
|
10.3 Diagonalization with Respect to a Unitary |
|
|
371 | |
|
|
376 | |
|
10.3.1.1 Schur Triangularization |
|
|
376 | |
|
10.4 The Singular Value Decomposition |
|
|
377 | |
|
|
385 | |
|
10.4.1.1 The Singular Value Decomposition |
|
|
385 | |
11 Jordan Canonical Form |
|
389 | |
|
11.1 Jordan Form and Generalized Eigenvectors |
|
|
389 | |
|
|
389 | |
|
|
392 | |
|
|
392 | |
|
|
395 | |
|
|
396 | |
|
|
397 | |
|
|
398 | |
|
11.1.4.1 Generalized Eigenvectors |
|
|
402 | |
|
11.2 The Smith Normal Form (optional) |
|
|
422 | |
12 Multilinear Matters |
|
431 | |
|
|
431 | |
|
12.2 Matrices Associated to Bilinear Forms |
|
|
437 | |
|
|
440 | |
|
12.4 Symmetric Bilinear Forms |
|
|
442 | |
|
12.5 Congruence and Symmetric Matrices |
|
|
447 | |
|
12.6 Skew-Symmetric Bilinear Forms |
|
|
450 | |
|
12.7 Tensor Products of Matrices |
|
|
452 | |
|
|
456 | |
|
12.7.1.1 Tensor Product of Matrices |
|
|
456 | |
Appendix A Complex Numbers |
|
459 | |
|
|
459 | |
|
A.2 The System of Complex Numbers |
|
|
464 | |
|
A.3 The Rules of Arithmetic in C |
|
|
466 | |
|
A.3.1 Basic Rules of Arithmetic in C |
|
|
466 | |
|
A.3.1.1 Associative Law of Addition |
|
|
466 | |
|
A.3.1.2 Existence of a Zero |
|
|
466 | |
|
A.3.1.3 Existence of Opposites |
|
|
466 | |
|
A.3.1.4 Commutative Law of Addition |
|
|
466 | |
|
A.3.1.5 Associative Law of Multiplication |
|
|
467 | |
|
A.3.1.6 Distributive Laws |
|
|
467 | |
|
A.3.1.7 Commutative Law for Multiplication |
|
|
467 | |
|
A.3.1.8 Existence of Identity |
|
|
467 | |
|
A.3.1.9 Existence of Inverses |
|
|
467 | |
|
A.4 Complex Conjugation, Modulus, and Distance |
|
|
468 | |
|
A.4.1 Basic Facts about Complex Conjugation |
|
|
469 | |
|
A.4.2 Basic Facts about Magnitude |
|
|
469 | |
|
A.4.3 Basic Properties of Distance |
|
|
470 | |
|
A.5 The Polar Form of Complex Numbers |
|
|
473 | |
|
|
480 | |
|
|
482 | |
Appendix B Basic Matrix Operations |
|
485 | |
|
|
485 | |
|
|
487 | |
|
B.3 Scalar Multiplication |
|
|
489 | |
|
B.4 Matrix Multiplication |
|
|
490 | |
|
|
495 | |
|
|
502 | |
|
B.5.1.1 Matrix Manipulations |
|
|
502 | |
|
|
503 | |
|
|
506 | |
|
B.6.1.1 Getting at Pieces of Matrices |
|
|
506 | |
Appendix C Determinants |
|
509 | |
|
|
509 | |
|
C.2 Defining Determinants |
|
|
512 | |
|
C.3 Some Theorems about Determinants |
|
|
517 | |
|
|
517 | |
|
C.3.2 The Cauchy-Binet Theorem |
|
|
517 | |
|
C.3.3 The Laplace Expansion Theorem |
|
|
520 | |
|
C.4 The Trace of a Square Matrix |
|
|
528 | |
Appendix D A Review of Basics |
|
531 | |
|
|
531 | |
|
|
533 | |
|
|
534 | |
|
|
538 | |
Index |
|
543 | |