|
|
1 | (12) |
|
|
2 | (2) |
|
|
4 | (3) |
|
|
7 | (6) |
|
|
10 | (3) |
|
2 Optimization Techniques: An Overview |
|
|
13 | (32) |
|
2.1 History of Optimization |
|
|
13 | (16) |
|
2.2 Deterministic and Analytic Methods |
|
|
29 | (4) |
|
2.2.1 Gradient Descent Method |
|
|
29 | (1) |
|
2.2.2 Newton-Raphson Method |
|
|
30 | (2) |
|
2.2.3 Nelder-Mead Search Method |
|
|
32 | (1) |
|
|
33 | (4) |
|
2.3.1 Simulated Annealing |
|
|
33 | (2) |
|
2.3.2 Stochastic Approximation |
|
|
35 | (2) |
|
2.4 Evolutionary Algorithms |
|
|
37 | (8) |
|
|
37 | (4) |
|
2.4.2 Differential Evolution |
|
|
41 | (2) |
|
|
43 | (2) |
|
3 Particle Swarm Optimization |
|
|
45 | (38) |
|
|
45 | (1) |
|
|
46 | (3) |
|
|
49 | (6) |
|
|
51 | (2) |
|
|
53 | (2) |
|
|
55 | (19) |
|
3.4.1 Nonlinear Function Minimization |
|
|
55 | (2) |
|
|
57 | (4) |
|
3.4.3 Artificial Neural Networks |
|
|
61 | (13) |
|
3.5 Programming Remarks and Software Packages |
|
|
74 | (9) |
|
|
80 | (3) |
|
4 Multi-dimensional Particle Swarm Optimization |
|
|
83 | (18) |
|
4.1 The Need for Multi-dimensionality |
|
|
83 | (2) |
|
|
85 | (2) |
|
|
87 | (5) |
|
4.4 Programming Remarks and Software Packages |
|
|
92 | (9) |
|
4.4.1 MD PSO Operation in PSO_MDlib Application |
|
|
92 | (2) |
|
4.4.2 MD PSO Operation in PSOTestApp Application |
|
|
94 | (5) |
|
|
99 | (2) |
|
5 Improving Global Convergence |
|
|
101 | (50) |
|
5.1 Fractional Global Best Formation |
|
|
102 | (14) |
|
|
102 | (1) |
|
|
102 | (2) |
|
|
104 | (1) |
|
5.1.4 Nonlinear Function Minimization |
|
|
104 | (12) |
|
5.2 Optimization in Dynamic Environments |
|
|
116 | (12) |
|
5.2.1 Dynamic Environments: The Test Bed |
|
|
116 | (1) |
|
|
117 | (1) |
|
5.2.3 FGBF for the Moving Peak Benchmark for MPB |
|
|
118 | (1) |
|
5.2.4 Optimization over Multidimensional MPB |
|
|
119 | (1) |
|
5.2.5 Performance Evaluation on Conventional MPB |
|
|
120 | (4) |
|
5.2.6 Performance Evaluation on Multidimensional MPB |
|
|
124 | (4) |
|
5.3 Who Will Guide the Guide? |
|
|
128 | (13) |
|
|
130 | (1) |
|
5.3.2 SA-Driven PSO and MD PSO Applications |
|
|
131 | (3) |
|
5.3.3 Applications to Non-linear Function Minimization |
|
|
134 | (7) |
|
5.4 Summary and Conclusions |
|
|
141 | (1) |
|
5.5 Programming Remarks and Software Packages |
|
|
142 | (9) |
|
5.5.1 FGBF Operation in PSO_MDlib Application |
|
|
143 | (1) |
|
5.5.2 MD PSO with FGBF Application Over MPB |
|
|
144 | (3) |
|
|
147 | (4) |
|
6 Dynamic Data Clustering |
|
|
151 | (36) |
|
6.1 Dynamic Data Clustering via MD PSO with FGBF |
|
|
152 | (8) |
|
|
152 | (3) |
|
6.1.2 Results on 2D Synthetic Datasets |
|
|
155 | (5) |
|
6.1.3 Summary and Conclusions |
|
|
160 | (1) |
|
6.2 Dominant Color Extraction |
|
|
160 | (11) |
|
|
160 | (3) |
|
6.2.2 Fuzzy Model over HSV-HSL Color Domains |
|
|
163 | (1) |
|
6.2.3 DC Extraction Results |
|
|
164 | (6) |
|
6.2.4 Summary and Conclusions |
|
|
170 | (1) |
|
6.3 Dynamic Data Clustering via SA-Driven MD PSO |
|
|
171 | (5) |
|
6.3.1 SA-Driven MD PSO-Based Dynamic Clustering in 2D Datasets |
|
|
171 | (3) |
|
6.3.2 Summary and Conclusions |
|
|
174 | (2) |
|
6.4 Programming Remarks and Software Packages |
|
|
176 | (11) |
|
6.4.1 FGBF Operation in 2D Clustering |
|
|
176 | (3) |
|
6.4.2 DC Extraction in PSOTestApp Application |
|
|
179 | (4) |
|
6.4.3 SA-DRIVEN Operation in PSOTestApp Application |
|
|
183 | (2) |
|
|
185 | (2) |
|
7 Evolutionary Artificial Neural Networks |
|
|
187 | (44) |
|
7.1 Search for the Optimal Artificial Neural Networks: An Overview |
|
|
188 | (2) |
|
7.2 Evolutionary Neural Networks by MD PSO |
|
|
190 | (15) |
|
7.2.1 PSO for Artificial Neural Networks: The Early Attempts |
|
|
190 | (1) |
|
7.2.2 MD PSO-Based Evolutionary Neural Networks |
|
|
191 | (2) |
|
7.2.3 Classification Results on Synthetic Problems |
|
|
193 | (7) |
|
7.2.4 Classification Results on Medical Diagnosis Problems |
|
|
200 | (3) |
|
7.2.5 Parameter Sensitivity and Computational Complexity Analysis |
|
|
203 | (2) |
|
7.3 Evolutionary RBF Classifiers for Polarimetric SAR Images |
|
|
205 | (12) |
|
7.3.1 Polarimetric SAR Data Processing |
|
|
207 | (2) |
|
7.3.2 SAR Classification Framework |
|
|
209 | (2) |
|
7.3.3 Polarimetric SAR Classification Results |
|
|
211 | (6) |
|
7.4 Summary and Conclusions |
|
|
217 | (1) |
|
7.5 Programming Remarks and Software Packages |
|
|
218 | (13) |
|
|
227 | (4) |
|
8 Personalized ECG Classification |
|
|
231 | (28) |
|
8.1 ECG Classification by Evolutionary Artificial Neural Networks |
|
|
233 | (11) |
|
8.1.1 Introduction and Motivation |
|
|
233 | (2) |
|
8.1.2 ECG Data Processing |
|
|
235 | (4) |
|
8.1.3 Experimental Results |
|
|
239 | (5) |
|
8.2 Classification of Holter Registers |
|
|
244 | (9) |
|
|
245 | (1) |
|
8.2.2 Personalized Long-Term ECG Classification: A Systematic Approach |
|
|
246 | (4) |
|
8.2.3 Experimental Results |
|
|
250 | (3) |
|
8.3 Summary and Conclusions |
|
|
253 | (2) |
|
8.4 Programming Remarks and Software Packages |
|
|
255 | (4) |
|
|
257 | (2) |
|
9 Image Classification and Retrieval by Collective Network of Binary Classifiers |
|
|
259 | (36) |
|
|
260 | (2) |
|
9.2 Content-Based Image Classification and Retrieval Framework |
|
|
262 | (8) |
|
9.2.1 Overview of the Framework |
|
|
263 | (1) |
|
9.2.2 Evolutionary Update in the Architecture Space |
|
|
264 | (1) |
|
9.2.3 The Classifier Framework: Collective Network of Binary Classifiers |
|
|
265 | (5) |
|
9.3 Results and Discussions |
|
|
270 | (10) |
|
9.3.1 Database Creation and Feature Extraction |
|
|
271 | (1) |
|
9.3.2 Classification Results |
|
|
272 | (5) |
|
|
277 | (3) |
|
9.4 Summary and Conclusions |
|
|
280 | (1) |
|
9.5 Programming Remarks and Software Packages |
|
|
281 | (14) |
|
|
293 | (2) |
|
10 Evolutionary Feature Synthesis |
|
|
295 | |
|
|
295 | (2) |
|
10.2 Feature Synthesis and Selection: An Overview |
|
|
297 | (2) |
|
10.3 The Evolutionary Feature Synthesis Framework |
|
|
299 | (7) |
|
|
299 | (2) |
|
10.3.2 Evolutionary Feature Synthesis Framework |
|
|
301 | (5) |
|
10.4 Simulation Results and Discussions |
|
|
306 | (8) |
|
10.4.1 Performance Evaluations with Respect to Discrimination and Classification |
|
|
307 | (2) |
|
10.4.2 Comparative Performance Evaluations on Content-Based Image Retrieval |
|
|
309 | (5) |
|
10.5 Programming Remarks and Software Packages |
|
|
314 | |
|
|
321 | |