Preface to the Third Edition |
|
xiii | |
|
1 Some Background on Probability |
|
|
1 | (32) |
|
|
1 | (1) |
|
|
1 | (4) |
|
1.3 Conditional probability and independence |
|
|
5 | (3) |
|
1.4 Discrete random variables |
|
|
8 | (1) |
|
1.5 Continuous random variables |
|
|
9 | (2) |
|
|
11 | (1) |
|
1.7 Some standard discrete probability distributions |
|
|
12 | (3) |
|
1.8 Some standard continuous probability distributions |
|
|
15 | (3) |
|
|
18 | (5) |
|
1.10 Conditional expectation |
|
|
23 | (4) |
|
|
27 | (6) |
|
|
33 | (16) |
|
|
33 | (1) |
|
|
33 | (4) |
|
2.3 Some numerical simulations |
|
|
37 | (2) |
|
|
39 | (2) |
|
2.5 Some variations of gambler's ruin |
|
|
41 | (3) |
|
2.5.1 The infinitely rich opponent |
|
|
41 | (2) |
|
2.5.2 The generous opponent |
|
|
43 | (1) |
|
2.5.3 Changing the stakes |
|
|
43 | (1) |
|
|
44 | (5) |
|
|
49 | (16) |
|
|
49 | (1) |
|
3.2 Unrestricted random walks |
|
|
50 | (2) |
|
3.3 The exact probability distribution of a random walk |
|
|
52 | (2) |
|
3.4 First returns of the symmetric random walk |
|
|
54 | (3) |
|
|
57 | (8) |
|
|
65 | (40) |
|
4.1 States and transitions |
|
|
65 | (1) |
|
4.2 Transition probabilities |
|
|
66 | (4) |
|
4.3 General two-state Markov chains |
|
|
70 | (2) |
|
4.4 Powers of the general transition matrix |
|
|
72 | (8) |
|
4.5 Gambler's ruin as a Markov chain |
|
|
80 | (3) |
|
4.6 Classification of states |
|
|
83 | (7) |
|
4.7 Classification of chains |
|
|
90 | (4) |
|
4.8 A wildlife Markov chain model |
|
|
94 | (2) |
|
|
96 | (9) |
|
|
105 | (14) |
|
|
105 | (1) |
|
|
105 | (3) |
|
5.3 Partition theorem approach |
|
|
108 | (1) |
|
|
109 | (1) |
|
5.5 The generating function |
|
|
110 | (2) |
|
|
112 | (3) |
|
5.7 Summary of the Poisson process |
|
|
115 | (1) |
|
|
115 | (4) |
|
6 Birth and Death Processes |
|
|
119 | (26) |
|
|
119 | (1) |
|
|
119 | (3) |
|
6.3 Birth process: Generating function equation |
|
|
122 | (2) |
|
|
124 | (3) |
|
6.5 The combined birth and death process |
|
|
127 | (5) |
|
6.6 General population processes |
|
|
132 | (3) |
|
|
135 | (10) |
|
|
145 | (24) |
|
|
145 | (1) |
|
7.2 The single-server queue |
|
|
146 | (2) |
|
|
148 | (6) |
|
7.4 Queues with multiple servers |
|
|
154 | (5) |
|
7.5 Queues with fixed service times |
|
|
159 | (3) |
|
7.6 Classification of queues |
|
|
162 | (1) |
|
|
162 | (7) |
|
8 Reliability and Renewal |
|
|
169 | (14) |
|
|
169 | (1) |
|
8.2 The reliability function |
|
|
169 | (2) |
|
8.3 Exponential distribution and reliability |
|
|
171 | (1) |
|
|
172 | (1) |
|
8.5 Reliability of series and parallel systems |
|
|
173 | (3) |
|
|
176 | (2) |
|
8.7 Expected number of renewals |
|
|
178 | (1) |
|
|
179 | (4) |
|
9 Branching and Other Random Processes |
|
|
183 | (30) |
|
|
183 | (1) |
|
|
183 | (3) |
|
|
186 | (2) |
|
9.4 Probability of extinction |
|
|
188 | (3) |
|
9.5 Branching processes and martingales |
|
|
191 | (4) |
|
|
195 | (2) |
|
9.7 A continuous time epidemic |
|
|
197 | (2) |
|
9.8 A discrete time epidemic model |
|
|
199 | (3) |
|
9.9 Deterministic epidemic models |
|
|
202 | (2) |
|
9.10 An iterative solution scheme for the simple epidemic |
|
|
204 | (3) |
|
|
207 | (6) |
|
10 Brownian Motion: Wiener Process |
|
|
213 | (14) |
|
|
213 | (1) |
|
|
213 | (2) |
|
10.3 Wiener process as a limit of a random walk |
|
|
215 | (2) |
|
10.4 Brownian motion with drift |
|
|
217 | (1) |
|
|
217 | (2) |
|
|
219 | (2) |
|
10.7 Other Brownian motions in one dimension |
|
|
221 | (2) |
|
10.8 Brownian motion in more than one dimension |
|
|
223 | (1) |
|
|
224 | (3) |
|
11 Computer Simulations and Projects |
|
|
227 | (10) |
Answers and Comments on End-of-Chapter Problems |
|
237 | (8) |
Appendix |
|
245 | (4) |
References and Further Reading |
|
249 | (2) |
Index |
|
251 | |