Preface |
|
v | |
About the authors |
|
vi | |
Acknowledgements |
|
vii | |
Introduction: Why should you read this book? |
|
1 | (4) |
|
Part 1 Why you should want to do power analysis |
|
|
1 | (1) |
|
Part 2 Why you should want to do power analyses our way |
|
|
2 | (1) |
|
Why have we based the book on R and how much R will we assume you know? |
|
|
3 | (1) |
|
|
3 | (1) |
|
|
3 | (2) |
|
1 What is statistical power? |
|
|
5 | (18) |
|
1.1 An important preliminary: sampling and statistical testing |
|
|
6 | (2) |
|
1.2 Null hypothesis statistical testing |
|
|
8 | (9) |
|
1.3 Type I and Type II errors |
|
|
17 | (3) |
|
1.4 How do we define statistical power? |
|
|
20 | (3) |
|
2 Why low power is undesirable |
|
|
23 | (16) |
|
2.1 With a low-powered study you risk missing interesting effects that are really there |
|
|
24 | (1) |
|
2.2 You cannot read much into lack of statistical significance in a low-powered study |
|
|
25 | (1) |
|
2.3 You cannot read much into statistical significance in a low-powered study |
|
|
25 | (5) |
|
2.4 Your estimation of the size of an apparent effect can be unreliable in low-powered studies |
|
|
30 | (5) |
|
2.5 Should you ever knowingly carry out a low-powered study? |
|
|
35 | (4) |
|
3 Improving the power of an experiment |
|
|
39 | (20) |
|
3.1 The challenge posed by inherent variation |
|
|
40 | (2) |
|
3.2 Are you measuring the right variables? |
|
|
42 | (2) |
|
3.3 Can you measure variables more precisely? |
|
|
44 | (1) |
|
3.4 Repeated measurement and subsampling to reduce inherent variation |
|
|
45 | (1) |
|
3.5 Can you select experimental material so as to reduce inherent variation? |
|
|
46 | (1) |
|
3.6 Can you strengthen the effect that you are interested in? |
|
|
47 | (4) |
|
3.7 Can you change the design of your experiment to boost power? |
|
|
51 | (1) |
|
3.8 Would you be willing to accept a higher rate of Type I error? |
|
|
52 | (1) |
|
3.9 Can you increase sample size? |
|
|
53 | (1) |
|
3.10 Practical and ethical reasons why you should not always seek to further increase power |
|
|
54 | (1) |
|
3.11 Case study: thinking a bit more about how much power is enough |
|
|
55 | (4) |
|
4 How to quantify power by simulation |
|
|
59 | (30) |
|
4.1 What you need to know to estimate power, and ways to produce plausible estimates of these |
|
|
60 | (3) |
|
4.2 The concept of estimating power by repeated evaluation of synthetic data |
|
|
63 | (4) |
|
4.3 The nuts and bolts of generating synthetic data and estimating power in a single one-factor design |
|
|
67 | (7) |
|
4.4 Using simulation to compare alternative ways of doing the same experiment |
|
|
74 | (1) |
|
4.5 Selecting between different alternative experiments to decide which experiment you are actually going to do, and reporting its power |
|
|
75 | (2) |
|
4.6 Case study: presenting and interpreting your power analysis |
|
|
77 | (12) |
|
5 Simple factorial designs |
|
|
89 | (850) |
|
5.1 Introducing our focal example |
|
|
80 | (1) |
|
5.2 Think about your data frame as a way to envisage your experiment |
|
|
80 | (2) |
|
5.3 Generating a simulated data set for our focal experiment |
|
|
82 | (8) |
|
5.4 Comparing different designs |
|
|
90 | (4) |
|
5.5 Drop-outs: using power analysis to explore the possible impact of adverse events |
|
|
94 | (3) |
|
5.6 Factors with more than two levels |
|
|
97 | (2) |
|
6 Extensions to other designs |
|
|
99 | (1) |
|
6.1 A simple linear regression |
|
|
100 | (1) |
|
6.2 Beyond the straight and narrow |
|
|
106 | (4) |
|
6.3 When we don't control the values of our predictors |
|
|
110 | (2) |
|
6.4 When things are not normal |
|
|
112 | (3) |
|
|
115 | (4) |
|
7 Dealing with multiple hypotheses |
|
|
119 | (12) |
|
7.1 Several research questions in a single study |
|
|
120 | (1) |
|
7.2 Designs that implicitly test multiple hypotheses |
|
|
120 | (5) |
|
|
125 | (6) |
|
8 Applying our simulation approach beyond null hypothesis testing: parameter estimation, Bayesian, and model-selection contexts |
|
|
131 | (14) |
|
8.1 Likelihood of obtaining a specified precision of parameter estimation |
|
|
132 | (7) |
|
8.2 Translating the concept of power across to Bayesian analysis |
|
|
139 | (2) |
|
8.3 Using simulations to help with model-selection approaches |
|
|
141 | (1) |
|
8.4 Exploiting your freedom in how you define study effectiveness |
|
|
142 | (3) |
|
Appendix: Some handy hints on simulating data in R |
|
|
145 | (8) |
|
|
145 | (1) |
|
|
145 | (1) |
|
|
146 | (1) |
|
Drawing samples of categorical data |
|
|
146 | (1) |
|
Permutations and indexing |
|
|
147 | (1) |
|
|
148 | (1) |
|
Generating samples of continuous variables |
|
|
149 | (1) |
|
Generating correlated data |
|
|
150 | (3) |
Glossary |
|
153 | (4) |
Index |
|
157 | |