Summary |
|
|
|
|
1.1 Overview and Study Charter |
|
|
7 | (1) |
|
|
8 | (1) |
|
|
9 | (1) |
|
1.3.1 Focus on Prediction with Physics/Engineering Models |
|
|
9 | (1) |
|
1.3.2 Focus on Mathematical and Quantitative Issues |
|
|
9 | (1) |
|
1.4 VVUQ Processes and Principles |
|
|
10 | (3) |
|
|
10 | (1) |
|
|
11 | (1) |
|
|
11 | (1) |
|
1.4.4 Uncertainty Quantification |
|
|
12 | (1) |
|
1.4.5 Key VVUQ Principles |
|
|
13 | (1) |
|
1.5 Uncertainty and Probability |
|
|
13 | (1) |
|
|
14 | (4) |
|
1.6.1 The Physical System |
|
|
16 | (1) |
|
|
16 | (1) |
|
|
16 | (1) |
|
1.6.4 Sources of Uncertainty |
|
|
16 | (1) |
|
1.6.5 Propagation of Input Uncertainties |
|
|
17 | (1) |
|
1.6.6 Validation and Prediction |
|
|
17 | (1) |
|
|
17 | (1) |
|
1.7 Organization of This Report |
|
|
18 | (1) |
|
|
18 | (1) |
|
2 Sources of Uncertainty and Error |
|
|
|
|
19 | (1) |
|
2.2 Projectile-Impact Example Problem |
|
|
20 | (3) |
|
|
23 | (1) |
|
|
24 | (1) |
|
|
24 | (1) |
|
|
25 | (1) |
|
|
26 | (1) |
|
2.8 Choosing a Model Form |
|
|
26 | (1) |
|
|
26 | (1) |
|
2.10 Climate-Modeling Case Study |
|
|
27 | (3) |
|
2.10.1 Is Formal UQ Possible for Truly Complex Models? |
|
|
28 | (1) |
|
2.10.2 Future Directions for Research and Teaching Involving UQ for Climate Models |
|
|
29 | (1) |
|
|
30 | (1) |
|
|
31 | (6) |
|
|
31 | (1) |
|
|
32 | (1) |
|
3.3 Solution Verification |
|
|
33 | (2) |
|
3.4 Summary of Verification Principles |
|
|
35 | (1) |
|
|
36 | (1) |
|
4 Emulation, Reduced-Order Modeling, and Forward Propagation |
|
|
37 | (15) |
|
4.1 Approximating the Computational Model |
|
|
38 | (3) |
|
4.1.1 Computer Model Emulation |
|
|
38 | (1) |
|
4.1.2 Reduced-Order Models |
|
|
39 | (2) |
|
4.2 Forward Propagation of Input Uncertainty |
|
|
41 | (1) |
|
|
42 | (4) |
|
4.3.1 Global Sensitivity Analysis |
|
|
43 | (1) |
|
4.3.2 Local Sensitivity Analysis |
|
|
44 | (2) |
|
4.4 Choosing Input Settings for Ensembles of Computer Runs |
|
|
46 | (1) |
|
4.5 Electromagnetic Interference in a Tire Pressure Sensor: Case Study |
|
|
46 | (3) |
|
|
46 | (1) |
|
|
46 | (2) |
|
|
48 | (1) |
|
4.5.4 Representative Result |
|
|
49 | (1) |
|
|
49 | (3) |
|
5 Model Validation and Prediction |
|
|
52 | (34) |
|
|
52 | (7) |
|
5.1.1 Note Regarding Methodology |
|
|
54 | (3) |
|
5.1.2 The Ball-Drop Example Revisited |
|
|
57 | (1) |
|
5.1.3 Model Validation Statement |
|
|
58 | (1) |
|
5.2 Uncertainties in Physical Measurements |
|
|
59 | (1) |
|
5.3 Model Calibration and Inverse Problems |
|
|
60 | (3) |
|
|
63 | (4) |
|
5.5 Assessing the Quality of Predictions |
|
|
67 | (3) |
|
5.6 Automobile Suspension Systems Case Study |
|
|
70 | (4) |
|
|
70 | (1) |
|
|
70 | (1) |
|
5.6.3 The Process Being Modeled and Data |
|
|
70 | (1) |
|
5.6.4 Modeling the Uncertainties |
|
|
71 | (1) |
|
5.6.5 Analysis and Results |
|
|
72 | (2) |
|
5.7 Inference from Multiple Computer Models |
|
|
74 | (1) |
|
5.8 Exploiting Multiple Sources of Physical Observations |
|
|
75 | (1) |
|
|
75 | (4) |
|
|
75 | (1) |
|
|
76 | (1) |
|
|
76 | (1) |
|
5.9.4 Solution Verification |
|
|
77 | (1) |
|
|
78 | (1) |
|
5.10 Rare, High-Consequence Events |
|
|
79 | (1) |
|
|
80 | (3) |
|
|
83 | (3) |
|
|
86 | (9) |
|
|
86 | (1) |
|
6.2 Decisions Within VVUQ Activities |
|
|
86 | (1) |
|
6.3 Decisions Based on VVUQ Information |
|
|
87 | (1) |
|
6.4 Decision Making Informed by VVUQ in the Stockpile Stewardship Program |
|
|
88 | (2) |
|
6.5 Decision Making Informed by VVUQ at the Nevada National Security Site |
|
|
90 | (3) |
|
|
90 | (1) |
|
6.5.2 The Physical System |
|
|
91 | (1) |
|
6.5.3 Computational Modeling of the Physical System |
|
|
92 | (1) |
|
6.5.4 Parameter Estimation |
|
|
92 | (1) |
|
6.5.5 Making (Extrapolative) Predictions and Describing Uncertainty |
|
|
93 | (1) |
|
6.5.6 Reporting Results to Decision Makers and Stakeholders |
|
|
93 | (1) |
|
|
93 | (1) |
|
|
94 | (1) |
|
7 Next Steps in Practice, Research, and Education for Verification, Validation, and Uncertainty Quantification |
|
|
95 | (14) |
|
7.1 VVUQ Principles and Best Practices |
|
|
95 | (3) |
|
7.1.1 Verification Principles and Best Practices |
|
|
96 | (1) |
|
7.1.2 Validation and Prediction Principles and Best Practices |
|
|
97 | (1) |
|
7.2 Principles and Best Practices in Related Areas |
|
|
98 | (2) |
|
7.2.1 Transparency and Reporting |
|
|
98 | (1) |
|
|
99 | (1) |
|
7.2.3 Software, Tools, and Repositories |
|
|
99 | (1) |
|
7.3 Research for Improved Mathematical Foundations |
|
|
100 | (3) |
|
7.3.1 Verification Research |
|
|
100 | (1) |
|
|
101 | (1) |
|
7.3.3 Validation and Prediction Research |
|
|
102 | (1) |
|
7.4 Education Changes for the Effective Integration of VVUQ |
|
|
103 | (3) |
|
7.4.1 VVUQ at the University |
|
|
103 | (3) |
|
|
106 | (1) |
|
|
106 | (1) |
|
|
106 | (3) |
|
|
|
|
109 | (11) |
|
B Agendas of Committee Meetings |
|
|
120 | (4) |
|
|
124 | (6) |
|
|
130 | |