Foreword |
|
v | |
Preface |
|
ix | |
|
Part 1 Introduction and Background Material |
|
|
1 | (54) |
|
Chapter 1 Introduction: Tools and Challenges in Derivative-Free and Blackbox Optimization |
|
|
3 | (12) |
|
1.1 What Are Derivative-Free and Blackbox Optimization? |
|
|
3 | (3) |
|
1.2 Classifications of Optimization Problems |
|
|
6 | (2) |
|
|
8 | (3) |
|
1.4 Remarks on Blackbox Optimization Problems |
|
|
11 | (4) |
|
Chapter 2 Mathematical Background |
|
|
15 | (18) |
|
2.1 Vectors, Matrices, and Norms |
|
|
16 | (1) |
|
2.2 Functions and Multivariate Calculus |
|
|
17 | (3) |
|
|
20 | (1) |
|
2.4 Basic Properties of Sets |
|
|
21 | (1) |
|
|
22 | (2) |
|
|
24 | (9) |
|
Chapter 3 The Beginnings of DFO Algorithms |
|
|
33 | (22) |
|
|
33 | (2) |
|
|
35 | (2) |
|
|
37 | (3) |
|
3.4 Selecting a Starting Point |
|
|
40 | (1) |
|
3.5 Convergence Analysis of Coordinate Search |
|
|
41 | (3) |
|
3.6 Algorithmic Variants of Coordinate Search |
|
|
44 | (3) |
|
|
47 | (8) |
|
|
53 | (2) |
|
Part 2 Popular Heuristic Methods |
|
|
55 | (38) |
|
Chapter 4 Genetic Algorithms |
|
|
57 | (18) |
|
4.1 Biology Overview and the GA Algorithm |
|
|
58 | (1) |
|
4.2 Fitness and Selection |
|
|
59 | (3) |
|
|
62 | (2) |
|
4.4 Crossover and Mutation |
|
|
64 | (3) |
|
4.5 Convergence and Stopping |
|
|
67 | (8) |
|
|
75 | (18) |
|
|
76 | (2) |
|
5.2 The Nelder-Mead Simplex |
|
|
78 | (2) |
|
|
80 | (1) |
|
|
81 | (12) |
|
Further Remarks on Heuristics |
|
|
90 | (3) |
|
Part 3 Direct Search Methods |
|
|
93 | (64) |
|
Chapter 6 Positive Bases and Nonsmooth Optimization |
|
|
95 | (20) |
|
|
96 | (3) |
|
6.2 Constructing Positive Bases |
|
|
99 | (2) |
|
6.3 Positive Bases and Descent Directions |
|
|
101 | (1) |
|
6.4 Optimality Conditions for Unconstrained Problems |
|
|
101 | (6) |
|
6.5 Optimality Conditions for Constrained Problems |
|
|
107 | (8) |
|
Chapter 7 Generalised Pattern Search |
|
|
115 | (20) |
|
|
116 | (3) |
|
7.2 Opportunistic Strategy, the search Step, and Starting Points Selection |
|
|
119 | (1) |
|
|
120 | (2) |
|
|
122 | (7) |
|
7.5 Numerical Experiments with the Rheology Problem |
|
|
129 | (6) |
|
Chapter 8 Mesh Adaptive Direct Search |
|
|
135 | (22) |
|
|
136 | (4) |
|
8.2 Opportunistic Strategy, the search Step, and Starting Points Selection |
|
|
140 | (1) |
|
8.3 Convergence Analysis of MADS |
|
|
140 | (3) |
|
8.4 Dense Sets of Polling Directions |
|
|
143 | (5) |
|
8.5 Further Experiments with the Rheology Optimization Problem |
|
|
148 | (9) |
|
Further Remarks on Direct Search Methods |
|
|
154 | (3) |
|
Part 4 Model-Based Methods |
|
|
157 | (62) |
|
Chapter 9 Building Linear and Quadratic Models |
|
|
159 | (24) |
|
|
160 | (3) |
|
|
163 | (3) |
|
9.3 Error Bounds for Linear Interpolation |
|
|
166 | (4) |
|
|
170 | (2) |
|
|
172 | (11) |
|
Chapter 10 Model-Based Descent |
|
|
183 | (18) |
|
10.1 Controllable Accuracy |
|
|
184 | (1) |
|
|
185 | (2) |
|
10.3 Flexibility in the MBD Algorithm and Stopping Criteria |
|
|
187 | (1) |
|
10.4 The MBD Algorithm Has Successful Iterations |
|
|
188 | (6) |
|
|
194 | (2) |
|
10.6 Additional Experiments with the Rheology Problem |
|
|
196 | (5) |
|
Chapter 11 Model-Based Trust Region |
|
|
201 | (18) |
|
|
202 | (3) |
|
11.2 Model Checks and Stopping Conditions |
|
|
205 | (1) |
|
11.3 Solving the Trust Region Subproblem |
|
|
206 | (3) |
|
|
209 | (4) |
|
11.5 More Experiments with the Rheology Optimization Problem |
|
|
213 | (6) |
|
Further Remarks on Model-Based Methods |
|
|
217 | (2) |
|
Part 5 Extensions and Refinements |
|
|
219 | (44) |
|
Chapter 12 Variables and Constraints |
|
|
221 | (14) |
|
|
222 | (2) |
|
12.2 Types of Constraints |
|
|
224 | (1) |
|
12.3 The Constraint Violation Function |
|
|
225 | (3) |
|
12.4 Relaxable Constraints by the Progressive Barrier |
|
|
228 | (7) |
|
Chapter 13 Optimization Using Surrogates and Models |
|
|
235 | (12) |
|
13.1 Surrogate Problem and Surrogate Functions |
|
|
235 | (3) |
|
13.2 The Surrogate Management Framework |
|
|
238 | (3) |
|
13.3 Final Experiments with the Rheology Optimization Problem |
|
|
241 | (6) |
|
Chapter 14 Biobjective Optimization |
|
|
247 | (16) |
|
14.1 The Pareto Set and Front |
|
|
248 | (1) |
|
14.2 Single-Objective Approaches |
|
|
249 | (4) |
|
14.3 Biobjective Optimization Algorithm |
|
|
253 | (10) |
|
|
261 | (2) |
|
Appendix A Comparing Optimization Methods |
|
|
263 | (18) |
|
|
264 | (1) |
|
|
265 | (2) |
|
|
267 | (14) |
Solutions to Selected Exercises |
|
281 | (8) |
References |
|
289 | (10) |
Index |
|
299 | |