Preface |
|
vii | |
Acknowledgments |
|
ix | |
|
|
xix | |
|
|
xxiii | |
|
|
1 | (6) |
|
|
1 | (1) |
|
1.2 Multivariate Models and Methods |
|
|
1 | (2) |
|
|
3 | (4) |
|
|
7 | (72) |
|
|
7 | (1) |
|
2.2 Vectors, Vector Spaces, and Vector Subspaces |
|
|
7 | (5) |
|
|
7 | (1) |
|
|
8 | (1) |
|
|
9 | (3) |
|
2.3 Bases, Vector Norms, and the Algebra of Vector Spaces |
|
|
12 | (13) |
|
|
13 | (1) |
|
b Lengths, Distances, and Angles |
|
|
13 | (2) |
|
c Gram-Schmidt Orthogonalization Process |
|
|
15 | (2) |
|
|
17 | (4) |
|
e Vector Inequalities, Vector Norms, and Statistical Distance |
|
|
21 | (4) |
|
2.4 Basic Matrix Operations |
|
|
25 | (16) |
|
a Equality, Addition, and Multiplication of Matrices |
|
|
26 | (2) |
|
|
28 | (1) |
|
|
29 | (1) |
|
d Trace and the Euclidean Matrix Norm |
|
|
30 | (2) |
|
e Kronecker and Hadamard Products |
|
|
32 | (3) |
|
|
35 | (1) |
|
g The Vec(·) and Vech(·) Operators |
|
|
35 | (6) |
|
2.5 Rank, Inverse, and Determinant |
|
|
41 | (14) |
|
|
41 | (6) |
|
|
47 | (3) |
|
|
50 | (5) |
|
2.6 Systems of Equations, Transformations, and Quadratic Forms |
|
|
55 | (21) |
|
|
55 | (6) |
|
|
61 | (2) |
|
c Projection Transformations |
|
|
63 | (4) |
|
d Eigenvalues and Eigenvectors |
|
|
67 | (4) |
|
|
71 | (1) |
|
f Quadratic Forms and Extrema |
|
|
72 | (1) |
|
|
73 | (3) |
|
2.7 Limits and Asymptotics |
|
|
76 | (3) |
|
3 Multivariate Distributions and the Linear Model |
|
|
79 | (106) |
|
|
79 | (1) |
|
3.2 Random Vectors and Matrices |
|
|
79 | (5) |
|
3.3 The Multivariate Normal (MVN) Distribution |
|
|
84 | (9) |
|
a Properties of the Multivariate Normal Distribution |
|
|
86 | (2) |
|
|
88 | (2) |
|
c The Matrix Normal Distribution |
|
|
90 | (3) |
|
3.4 The Chi-Square and Wishart Distributions |
|
|
93 | (6) |
|
a Chi-Square Distribution |
|
|
93 | (3) |
|
b The Wishart Distribution |
|
|
96 | (3) |
|
3.5 Other Multivariate Distributions |
|
|
99 | (7) |
|
a The Univariate t and F Distributions |
|
|
99 | (1) |
|
b Hotelling's T2 Distribution |
|
|
99 | (2) |
|
|
101 | (3) |
|
d Multivariate t, F, and X2 Distributions |
|
|
104 | (2) |
|
3.6 The General Linear Model |
|
|
106 | (12) |
|
a Regression, ANOVA, and ANCOVA Models |
|
|
107 | (3) |
|
b Multivariate Regression, MANOVA, and MANCOVA Models |
|
|
110 | (4) |
|
c The Seemingly Unrelated Regression (SUR) Model |
|
|
114 | (1) |
|
d The General MANOVA Model (GMANOVA) |
|
|
115 | (3) |
|
|
118 | (15) |
|
3.8 Tests of Covariance Matrices |
|
|
133 | (16) |
|
a Tests of Covariance Matrices |
|
|
133 | (1) |
|
b Equality of Covariance Matrices |
|
|
133 | (4) |
|
c Testing for a Specific Covariance Matrix |
|
|
137 | (1) |
|
d Testing for Compound Symmetry |
|
|
138 | (1) |
|
|
139 | (4) |
|
|
143 | (2) |
|
g Tests for Linear Structure |
|
|
145 | (4) |
|
|
149 | (32) |
|
a Two-Sample Case, Σ1 = Σ2 = Σ |
|
|
149 | (7) |
|
b Two-Sample Case, Σ1 ≠ Σ2 |
|
|
156 | (4) |
|
c Two-Sample Case, Nonnormality |
|
|
160 | (1) |
|
d Profile Analysis, One Group |
|
|
160 | (5) |
|
e Profile Analysis, Two Groups |
|
|
165 | (10) |
|
f Profile Analysis, Σ1 ≠ Σ2 |
|
|
175 | (6) |
|
3.10 Univariate Profile Analysis |
|
|
181 | (1) |
|
a Univariate One-Group Profile Analysis |
|
|
182 | (1) |
|
b Univariate Two-Group Profile Analysis |
|
|
182 | (1) |
|
|
182 | (3) |
|
4 Multivariate Regression Models |
|
|
185 | (126) |
|
|
185 | (1) |
|
4.2 Multivariate Regression |
|
|
186 | (26) |
|
a Multiple Linear Regression |
|
|
186 | (1) |
|
b Multivariate Regression Estimation and Testing Hypotheses |
|
|
187 | (6) |
|
c Multivariate Influence Measures |
|
|
193 | (4) |
|
d Measures of Association, Variable Selection and Lack-of-Fit Tests |
|
|
197 | (7) |
|
e Simultaneous Confidence Sets for a New Observation ynew and the Elements of B |
|
|
204 | (2) |
|
f Random X Matrix and Model Validation: Mean Squared Error of Prediction in Multivariate Regression |
|
|
206 | (5) |
|
g Exogeniety in Regression |
|
|
211 | (1) |
|
4.3 Multivariate Regression Example |
|
|
212 | (6) |
|
4.4 One-Way MANOVA and MANCOVA |
|
|
218 | (16) |
|
|
218 | (7) |
|
|
225 | (5) |
|
c Simultaneous Test Procedures (STP) for One-Way MANOVA/MANCOVA |
|
|
230 | (4) |
|
4.5 One-Way MANOVA/MANCOVA Examples |
|
|
234 | (11) |
|
|
234 | (5) |
|
b MANCOVA (Example 4.5.2) |
|
|
239 | (6) |
|
4.6 MANOVA/MANCOVA with Unequal Σi or Nonnormal Data |
|
|
245 | (1) |
|
4.7 One-Way MANOVA with Unequal Σi Example |
|
|
246 | (1) |
|
4.8 Two-Way MANOVA/MANCOVA |
|
|
246 | (11) |
|
a Two-Way MANOVA with Interaction |
|
|
246 | (6) |
|
b Additive Two-Way MANOVA |
|
|
252 | (4) |
|
|
256 | (1) |
|
|
256 | (1) |
|
4.9 Two-Way MANOVA/MANCOVA Example |
|
|
257 | (7) |
|
a Two-Way MANOVA (Example 4.9.1) |
|
|
257 | (4) |
|
b Two-Way MANCOVA (Example 4.9.2) |
|
|
261 | (3) |
|
4.10 Nonorthogonal Two-Way MANOVA Designs |
|
|
264 | (6) |
|
a Nonorthogonal Two-Way MANOVA Designs with and Without Empty Cells, and Interaction |
|
|
265 | (3) |
|
b Additive Two-Way MANOVA Designs With Empty Cells |
|
|
268 | (2) |
|
4.11 Unbalance, Nonorthogonal Designs Example |
|
|
270 | (3) |
|
4.12 Higher Ordered Fixed Effect, Nested and Other Designs |
|
|
273 | (3) |
|
4.13 Complex Design Examples |
|
|
276 | (6) |
|
a Nested Design (Example 4.13.1) |
|
|
276 | (3) |
|
b Latin Square Design (Example 4.13.2) |
|
|
279 | (3) |
|
4.14 Repeated Measurement Designs |
|
|
282 | (12) |
|
a One-Way Repeated Measures Design |
|
|
282 | (4) |
|
b Extended Linear Hypotheses |
|
|
286 | (8) |
|
4.15 Repeated Measurements and Extended Linear Hypotheses Example |
|
|
294 | (7) |
|
a Repeated Measures (Example 4.15.1) |
|
|
294 | (4) |
|
b Extended Linear Hypotheses (Example 4.15.2) |
|
|
298 | (3) |
|
4.16 Robustness and Power Analysis for MR Models |
|
|
301 | (3) |
|
4.17 Power Calculations---Power.sas |
|
|
304 | (3) |
|
4.18 Testing for Mean Differences with Unequal Covariance Matrices |
|
|
307 | (4) |
|
5 Seemingly Unrelated Regression Models |
|
|
311 | (40) |
|
|
311 | (1) |
|
|
312 | (4) |
|
a Estimation and Hypothesis Testing |
|
|
312 | (2) |
|
|
314 | (2) |
|
5.3 Seeming Unrelated Regression Example |
|
|
316 | (2) |
|
|
318 | (1) |
|
|
319 | (1) |
|
|
320 | (7) |
|
|
320 | (1) |
|
b Estimation and Hypothesis Testing |
|
|
321 | (3) |
|
|
324 | (1) |
|
|
324 | (2) |
|
|
326 | (1) |
|
|
326 | (1) |
|
|
327 | (6) |
|
a One Group Design (Example 5.7.1) |
|
|
328 | (2) |
|
b Two Group Design (Example 5.7.2) |
|
|
330 | (3) |
|
5.8 Tests of Nonadditivity |
|
|
333 | (2) |
|
5.9 Testing for Nonadditivity Example |
|
|
335 | (2) |
|
|
337 | (1) |
|
5.11 Sum of Profile Designs |
|
|
338 | (1) |
|
5.12 The Multivariate SUR (MSUR) Model |
|
|
339 | (2) |
|
5.13 Sum of Profile Example |
|
|
341 | (3) |
|
5.14 Testing Model Specification in SUR Models |
|
|
344 | (4) |
|
|
348 | (3) |
|
6 Multivariate Random and Mixed Models |
|
|
351 | (68) |
|
|
351 | (1) |
|
6.2 Random Coefficient Regression Models |
|
|
352 | (5) |
|
|
352 | (1) |
|
b Estimating the Parameters |
|
|
353 | (2) |
|
|
355 | (2) |
|
6.3 Univariate General Linear Mixed Models |
|
|
357 | (12) |
|
|
357 | (2) |
|
b Covariance Structures and Model Fit |
|
|
359 | (2) |
|
|
361 | (5) |
|
d Balanced Variance Component Experimental Design Models |
|
|
366 | (1) |
|
e Multilevel Hierarchical Models |
|
|
367 | (1) |
|
|
368 | (1) |
|
|
369 | (16) |
|
a Random Coefficient Regression (Example 6.4.1) |
|
|
371 | (5) |
|
b Generalized Randomized Block Design (Example 6.4.2) |
|
|
376 | (4) |
|
c Repeated Measurements (Example 6.4.3) |
|
|
380 | (1) |
|
d HLM Model (Example 6.4.4) |
|
|
381 | (4) |
|
6.5 Mixed Multivariate Models |
|
|
385 | (9) |
|
|
386 | (2) |
|
|
388 | (3) |
|
c Evaluating Expected Mean Square |
|
|
391 | (1) |
|
|
392 | (1) |
|
e Repeated Measurements Model |
|
|
392 | (2) |
|
6.6 Balanced Mixed Multivariate Models Examples |
|
|
394 | (6) |
|
|
395 | (1) |
|
b Multivariate Split-Plot Design |
|
|
395 | (5) |
|
6.7 Double Multivariate Model (DMM) |
|
|
400 | (3) |
|
6.8 Double Multivariate Model Examples |
|
|
403 | (12) |
|
a Double Multivariate MANOVA (Example 6.8.1) |
|
|
404 | (3) |
|
b Split-Plot Design (Example 6.8.2) |
|
|
407 | (8) |
|
6.9 Multivariate Hierarchical Linear Models |
|
|
415 | (2) |
|
6.10 Tests of Means with Unequal Covariance Matrices |
|
|
417 | (2) |
|
7 Discriminant and Classification Analysis |
|
|
419 | (26) |
|
|
419 | (1) |
|
7.2 Two Group Discrimination and Classification |
|
|
420 | (9) |
|
a Fisher's Linear Discriminant Function |
|
|
421 | (1) |
|
b Testing Discriminant Function Coefficients |
|
|
422 | (2) |
|
|
424 | (3) |
|
d Evaluating Classification Rules |
|
|
427 | (2) |
|
7.3 Two Group Discriminant Analysis Example |
|
|
429 | (5) |
|
a Egyptian Skull Data (Example 7.3.1) |
|
|
429 | (3) |
|
b Brain Size (Example 7.3.2) |
|
|
432 | (2) |
|
7.4 Multiple Group Discrimination and Classification |
|
|
434 | (6) |
|
a Fisher's Linear Discriminant Function |
|
|
434 | (1) |
|
b Testing Discriminant Functions for Significance |
|
|
435 | (2) |
|
|
437 | (1) |
|
|
438 | (1) |
|
e Logistic Discrimination and Other Topics |
|
|
439 | (1) |
|
7.5 Multiple Group Discriminant Analysis Example |
|
|
440 | (5) |
|
8 Principal Component, Canonical Correlation, and Exploratory Factor Analysis |
|
|
445 | (70) |
|
|
445 | (1) |
|
8.2 Principal Component Analysis |
|
|
445 | (15) |
|
a Population Model for PCA |
|
|
446 | (3) |
|
b Number of Components and Component Structure |
|
|
449 | (4) |
|
c Principal Components with Covariates |
|
|
453 | (2) |
|
|
455 | (3) |
|
|
458 | (1) |
|
|
458 | (1) |
|
|
458 | (2) |
|
8.3 Principal Component Analysis Examples |
|
|
460 | (8) |
|
a Test Battery (Example 8.3.1) |
|
|
460 | (1) |
|
b Semantic Differential Ratings (Example 8.3.2) |
|
|
461 | (4) |
|
c Performance Assessment Program (Example 8.3.3) |
|
|
465 | (3) |
|
8.4 Statistical Tests in Principal Component Analysis |
|
|
468 | (6) |
|
a Tests Using the Covariance Matrix |
|
|
468 | (4) |
|
b Tests Using a Correlation Matrix |
|
|
472 | (2) |
|
8.5 Regression on Principal Components |
|
|
474 | (2) |
|
|
475 | (1) |
|
|
475 | (1) |
|
8.6 Multivariate Regression on Principal Components Example |
|
|
476 | (1) |
|
8.7 Canonical Correlation Analysis |
|
|
477 | (15) |
|
a Population Model for CCA |
|
|
477 | (5) |
|
|
482 | (1) |
|
|
483 | (2) |
|
d Association and Redundancy |
|
|
485 | (2) |
|
e Partial, Part and Bipartial Canonical Correlation |
|
|
487 | (3) |
|
f Predictive Validity in Multivariate Regression using CCA |
|
|
490 | (1) |
|
g Variable Selection and Generalized Constrained CCA |
|
|
491 | (1) |
|
8.8 Canonical Correlation Analysis Examples |
|
|
492 | (4) |
|
a Rohwer CCA (Example 8.8.1) |
|
|
492 | (2) |
|
b Partial and Part CCA (Example 8.8.2) |
|
|
494 | (2) |
|
8.9 Exploratory Factor Analysis |
|
|
496 | (15) |
|
a Population Model for EFA |
|
|
497 | (5) |
|
b Estimating Model Parameters |
|
|
502 | (4) |
|
|
506 | (1) |
|
|
507 | (2) |
|
e Estimating Factor Scores |
|
|
509 | (1) |
|
|
510 | (1) |
|
8.10 Exploratory Factor Analysis Examples |
|
|
511 | (4) |
|
a Performance Assessment Program (PAP---Example 8.10.1) |
|
|
511 | (1) |
|
b Di Vesta and Walls (Example 8.10.2) |
|
|
512 | (1) |
|
|
512 | (3) |
|
9 Cluster Analysis and Multidimensional Scaling |
|
|
515 | (42) |
|
|
515 | (1) |
|
|
516 | (6) |
|
|
516 | (3) |
|
|
519 | (3) |
|
|
522 | (1) |
|
|
522 | (11) |
|
a Agglomerative Hierarchical Clustering Methods |
|
|
523 | (7) |
|
b Nonhierarchical Clustering Methods |
|
|
530 | (1) |
|
|
531 | (2) |
|
|
533 | (1) |
|
9.4 Cluster Analysis Examples |
|
|
533 | (8) |
|
a Protein Consumption (Example 9.4.1) |
|
|
534 | (2) |
|
b Nonhierarchical Method (Example 9.4.2) |
|
|
536 | (2) |
|
c Teacher Perception (Example 9.4.3) |
|
|
538 | (3) |
|
d Cedar Project (Example 9.4.4) |
|
|
541 | (1) |
|
9.5 Multidimensional Scaling |
|
|
541 | (7) |
|
a Classical Metric Scaling |
|
|
542 | (2) |
|
|
544 | (3) |
|
|
547 | (1) |
|
9.6 Multidimensional Scaling Examples |
|
|
548 | (9) |
|
a Classical Metric Scaling (Example 9.6.1) |
|
|
549 | (1) |
|
b Teacher Perception (Example 9.6.2) |
|
|
550 | (3) |
|
|
553 | (4) |
|
10 Structural Equation Models |
|
|
557 | (52) |
|
|
557 | (1) |
|
10.2 Path Diagrams, Basic Notation, and the General Approach |
|
|
558 | (9) |
|
10.3 Confirmatory Factor Analysis |
|
|
567 | (8) |
|
10.4 Confirmatory Factor Analysis Examples |
|
|
575 | (5) |
|
a Performance Assessment 3 -- Factor Model (Example 10.4.1) |
|
|
575 | (3) |
|
b Performance Assessment 5-Factor Model (Example 10.4.2) |
|
|
578 | (2) |
|
|
580 | (6) |
|
10.6 Path Analysis Examples |
|
|
586 | (8) |
|
a Community Structure and Industrial Conflict (Example 10.6.1) |
|
|
586 | (4) |
|
b Nonrecursive Model (Example 10.6.2) |
|
|
590 | (4) |
|
10.7 Structural Equations with Manifest and Latent Variables |
|
|
594 | (1) |
|
10.8 Structural Equations with Manifest and Latent Variables Example |
|
|
595 | (5) |
|
10.9 Longitudinal Analysis with Latent Variables |
|
|
600 | (4) |
|
10.10 Exogeniety in Structural Equation Models |
|
|
604 | (5) |
Appendix |
|
609 | (16) |
References |
|
625 | (42) |
Author Index |
|
667 | (8) |
Subject Index |
|
675 | |