|
|
1 | (14) |
|
|
1 | (1) |
|
|
2 | (1) |
|
1.3 Combinatorial Designs |
|
|
3 | (2) |
|
|
3 | (1) |
|
|
3 | (1) |
|
|
4 | (1) |
|
1.4 Combinatorial Testing |
|
|
5 | (5) |
|
1.4.1 Covering Array for Testing |
|
|
6 | (1) |
|
1.4.2 Automatic Efficient Test Generator |
|
|
6 | (2) |
|
|
8 | (1) |
|
|
8 | (1) |
|
1.4.5 Backtracking Algorithm |
|
|
9 | (1) |
|
|
9 | (1) |
|
1.5 Structure of This Book |
|
|
10 | (5) |
|
|
11 | (4) |
|
2 Combinatorial Testing in Cloud Computing |
|
|
15 | (10) |
|
2.1 Combinatorial Testing in Cloud Computing |
|
|
15 | (1) |
|
2.2 Improvements of Combinatorial Testing in Cloud Environment |
|
|
16 | (1) |
|
2.3 Faulty Location Analysis in Combinatorial Testing |
|
|
17 | (5) |
|
2.3.1 Fault Localization Based on Failure-Inducing Combinations |
|
|
17 | (1) |
|
2.3.2 Identifying Failure-Inducing Combinations in a Combinatorial Test Set |
|
|
18 | (1) |
|
2.3.3 Faulty Interaction Identification via Constraint Solving and Optimization |
|
|
19 | (1) |
|
2.3.4 Characterizing Failure-Causing Parameter Interactions by Adaptive Testing |
|
|
20 | (2) |
|
2.3.5 Comparisons of Existing Faulty Location Analysis Solutions |
|
|
22 | (1) |
|
|
22 | (3) |
|
|
23 | (2) |
|
3 Adaptive Fault Detection In Multi-tenancy Saas Systems |
|
|
25 | (12) |
|
3.1 Adaptive Testing Framework |
|
|
25 | (4) |
|
3.1.1 Learning from Earlier Test Results |
|
|
25 | (3) |
|
3.1.2 AR Algorithm Framework |
|
|
28 | (1) |
|
3.1.3 Relationship Between Faults, Final-Faults, and Candidate-Faults |
|
|
29 | (1) |
|
3.2 Simulation of AR Algorithm |
|
|
29 | (3) |
|
3.3 Incremental Testing to Allow New Components |
|
|
32 | (5) |
|
|
36 | (1) |
|
4 Test Algebra for Concurrent Combinatorial Testing |
|
|
37 | (16) |
|
|
37 | (9) |
|
4.1.1 Learning from Previous Test Results |
|
|
38 | (2) |
|
4.1.2 Changing Test Result Status |
|
|
40 | (1) |
|
4.1.3 Matrix Representation |
|
|
40 | (2) |
|
4.1.4 Relationship Between Configuration and Its Interactions |
|
|
42 | (1) |
|
4.1.5 Merging Concurrent Testing Results |
|
|
43 | (2) |
|
|
45 | (1) |
|
4.1.7 Incremental Development |
|
|
45 | (1) |
|
|
46 | (7) |
|
|
46 | (6) |
|
|
52 | (1) |
|
5 Concurrent Test Algebra Execution with Combinatorial Testing |
|
|
53 | (16) |
|
5.1 TA Analysis Framework |
|
|
53 | (6) |
|
5.1.1 The Role of N in Concurrent Combinatorial Testing |
|
|
58 | (1) |
|
5.1.2 Modified Testing Process |
|
|
58 | (1) |
|
5.2 TA Analysis Algorithm |
|
|
59 | (1) |
|
5.3 TA Analysis Process and Related Considerations |
|
|
60 | (2) |
|
|
60 | (1) |
|
5.3.2 Adjustment in Analyzing |
|
|
61 | (1) |
|
|
62 | (1) |
|
5.4.1 X and F Table Design |
|
|
62 | (1) |
|
|
62 | (1) |
|
5.4.3 N and U Table Design |
|
|
63 | (1) |
|
|
63 | (4) |
|
|
67 | (2) |
|
|
67 | (2) |
|
6 Test Algebra Execution in a Cloud Environment |
|
|
69 | (14) |
|
6.1 TA Concurrent Execution and Analysis |
|
|
69 | (7) |
|
6.1.1 TA Concurrent Execution |
|
|
69 | (2) |
|
|
71 | (1) |
|
6.1.3 NU Configuration Selection Algorithms |
|
|
72 | (2) |
|
6.1.4 Analysis Process of NU and U Configurations |
|
|
74 | (2) |
|
|
76 | (5) |
|
6.2.1 TA MapReduce Experiment Flowchart |
|
|
76 | (1) |
|
6.2.2 Different Configuration Numbers of TA Experiments |
|
|
76 | (1) |
|
6.2.3 Different Speedup Strategy for TA Experiments |
|
|
76 | (1) |
|
6.2.4 Different Fault Rates for TA Experiments |
|
|
77 | (2) |
|
6.2.5 Explanation on Simulated Data |
|
|
79 | (1) |
|
6.2.6 Simulation with Different Clusters |
|
|
79 | (1) |
|
6.2.7 Simulation using 37-node Cluster with Different Map Slots |
|
|
79 | (2) |
|
|
81 | (2) |
|
|
82 | (1) |
|
7 Adaptive Reasoning Algorithm with Automated Test Cases Generation and Test Algebra in Saas System |
|
|
83 | (18) |
|
7.1 Experimentation Using a MTA SaaS Sample |
|
|
83 | (3) |
|
|
86 | (2) |
|
7.3 SaaS Test Case Generation |
|
|
88 | (4) |
|
7.4 Simulation and Analysis |
|
|
92 | (9) |
|
7.4.1 Simulation of ARP Algorithm |
|
|
92 | (2) |
|
7.4.2 Incremental Testing with Automatic Test Generation |
|
|
94 | (1) |
|
7.4.3 Simulation Experiments of ARP+PTR |
|
|
95 | (1) |
|
7.4.4 Analysis of the Strategy on Test Generation |
|
|
96 | (3) |
|
7.4.5 TA Simulation in SaaS |
|
|
99 | (1) |
|
|
99 | (2) |
|
8 TaaS Design for Combinatorial Testing |
|
|
101 | (14) |
|
|
101 | (1) |
|
8.2 TaaS Design with TA and AR |
|
|
102 | (3) |
|
|
105 | (5) |
|
|
107 | (1) |
|
|
107 | (1) |
|
|
108 | (1) |
|
8.3.4 Runtime Composition, Execution and Scalability |
|
|
108 | (2) |
|
|
110 | (2) |
|
|
112 | (3) |
|
|
112 | (3) |
|
9 Integrated Taas with Fault Detection and Test Algebra |
|
|
115 | |
|
|
115 | (4) |
|
|
115 | (1) |
|
9.1.2 Framework Illustration |
|
|
116 | (3) |
|
9.2 Experiments and Results |
|
|
119 | (8) |
|
|
119 | (3) |
|
|
122 | (1) |
|
|
123 | (4) |
|
|
127 | |
|
|
127 | |