Preface |
|
xiii | |
|
|
xvii | |
Abbreviations |
|
xix | |
|
|
1 | (24) |
|
Why Do We Analyze Algorithms? |
|
|
2 | (8) |
|
|
2 | (1) |
|
One Problem - Several Solutions |
|
|
3 | (5) |
|
|
8 | (2) |
|
|
10 | (12) |
|
|
12 | (2) |
|
|
14 | (8) |
|
|
22 | (3) |
|
|
25 | (54) |
|
|
26 | (8) |
|
|
28 | (6) |
|
|
34 | (8) |
|
Changing Order of Summation |
|
|
34 | (2) |
|
Summations and Finite Differences |
|
|
36 | (4) |
|
|
40 | (2) |
|
|
42 | (2) |
|
Permutations and Combinations |
|
|
44 | (12) |
|
Combinations and Lattice Paths |
|
|
48 | (8) |
|
|
56 | (16) |
|
Definitions and Properties |
|
|
56 | (2) |
|
Transformations and Basic Sums |
|
|
58 | (6) |
|
|
64 | (2) |
|
|
66 | (6) |
|
Binomial Coefficients and Hypergeometric Functions |
|
|
72 | (5) |
|
|
75 | (2) |
|
|
77 | (2) |
|
|
79 | (56) |
|
|
80 | (2) |
|
Sample Space and Random Variables |
|
|
82 | (4) |
|
Calculating Probabilities |
|
|
86 | (8) |
|
|
94 | (25) |
|
Probability Mass Function |
|
|
94 | (5) |
|
|
99 | (13) |
|
|
112 | (7) |
|
Functions of Random Variables |
|
|
119 | (1) |
|
Conditional Probabilities |
|
|
119 | (4) |
|
|
123 | (4) |
|
|
127 | (3) |
|
Dependent Random Variables |
|
|
130 | (5) |
|
|
135 | (64) |
|
|
135 | (23) |
|
Bernoulli Variables and the Binomial Distribution |
|
|
136 | (4) |
|
The Multinomial Distribution |
|
|
140 | (1) |
|
The Geometric Distribution |
|
|
141 | (7) |
|
The Negative-Binomial Distribution |
|
|
148 | (3) |
|
The Hypergeometric Distribution |
|
|
151 | (3) |
|
|
154 | (3) |
|
|
157 | (1) |
|
Types of Probabilistic Convergence |
|
|
158 | (4) |
|
The Theorem of Total Probability |
|
|
162 | (8) |
|
|
170 | (4) |
|
|
174 | (9) |
|
|
183 | (5) |
|
|
188 | (4) |
|
|
192 | (7) |
|
Recurrences or Difference Equations |
|
|
199 | (72) |
|
How Do Difference Equations Arise? |
|
|
200 | (8) |
|
Properties of Difference Equations |
|
|
208 | (7) |
|
First Order Linear Difference Equations |
|
|
215 | (6) |
|
Recurrences with ``Integer Functions'' |
|
|
221 | (8) |
|
Divide-and-Conquer Recurrences |
|
|
221 | (3) |
|
|
224 | (3) |
|
|
227 | (2) |
|
|
229 | (7) |
|
Some Full-History Recurrences |
|
|
233 | (3) |
|
Recurrences in Numerical Analysis |
|
|
236 | (6) |
|
|
242 | (9) |
|
Partial Difference Equations |
|
|
251 | (12) |
|
The Relations with Continuous Calculations |
|
|
254 | (2) |
|
Counting Arrangements---with and without Repetition |
|
|
256 | (5) |
|
|
261 | (2) |
|
|
263 | (8) |
|
|
263 | (3) |
|
Recurrences and Finite Differences |
|
|
266 | (5) |
|
Introduction to Generating Functions |
|
|
271 | (84) |
|
Generating Functions---Definitions |
|
|
272 | (15) |
|
Ordinary Generating Functions |
|
|
272 | (5) |
|
Exponential Generating Functions |
|
|
277 | (3) |
|
|
280 | (3) |
|
Multivariate Generating Functions |
|
|
283 | (2) |
|
|
285 | (2) |
|
Extraction of Coefficients |
|
|
287 | (12) |
|
Transformations between the Generating Functions |
|
|
293 | (1) |
|
Multivariate Generating Functions |
|
|
294 | (2) |
|
Recurrences from Generating Functions |
|
|
296 | (3) |
|
|
299 | (6) |
|
|
305 | (22) |
|
Ordinary Recurrence Relations |
|
|
305 | (10) |
|
Vector Recurrence Relations |
|
|
315 | (4) |
|
Partial Difference Equations |
|
|
319 | (4) |
|
Walks on the Integer Grid |
|
|
323 | (4) |
|
|
327 | (4) |
|
Applications in Probability |
|
|
331 | (16) |
|
Definition of Generating Functions Used in Probability |
|
|
331 | (4) |
|
|
335 | (2) |
|
|
337 | (3) |
|
Quicksort and Binary Search Analysis |
|
|
340 | (7) |
|
The Lagrange Inversion Theorem |
|
|
347 | (8) |
|
Enumeration with Generating Functions |
|
|
355 | (68) |
|
Definition of Enumerators |
|
|
355 | (4) |
|
|
359 | (5) |
|
|
359 | (1) |
|
|
360 | (4) |
|
Counting Compositions of Integers |
|
|
364 | (17) |
|
|
364 | (3) |
|
Inhomogeneous Compositions |
|
|
367 | (2) |
|
Compositions with Restrictions |
|
|
369 | (3) |
|
|
372 | (3) |
|
|
375 | (6) |
|
|
381 | (11) |
|
|
383 | (5) |
|
|
388 | (2) |
|
|
390 | (1) |
|
|
391 | (1) |
|
|
392 | (11) |
|
|
403 | (20) |
|
The Sum and Product of Labeled Structures |
|
|
404 | (4) |
|
|
408 | (5) |
|
|
413 | (3) |
|
|
416 | (7) |
|
Further Enumeration Methods |
|
|
423 | (66) |
|
|
423 | (11) |
|
|
424 | (5) |
|
|
429 | (1) |
|
Counting Alternating Permutations |
|
|
430 | (4) |
|
|
434 | (12) |
|
Distribution of Identical Balls into Distinguishable Bins |
|
|
435 | (4) |
|
Distribution of Distinct Objects into Ordered Cells |
|
|
439 | (6) |
|
Distribution of Identical Objects into Identical Cells |
|
|
445 | (1) |
|
Distribution of Distinct Objects into Identical Cells |
|
|
445 | (1) |
|
The Principle of Inclusion and Exclusion (PIE) |
|
|
446 | (14) |
|
The PIE for Homogeneous Properties |
|
|
455 | (5) |
|
Extensions and Further Applications of the PIE |
|
|
460 | (8) |
|
The PIE via the Symbolic Method |
|
|
464 | (4) |
|
Probabilistic Inclusion - Exclusion Principle |
|
|
468 | (11) |
|
|
479 | (4) |
|
Counting Permutations of [ l..n] with k Ascents |
|
|
480 | (2) |
|
Counting Permutations of [ l..n] with Runs of Ascents of Length r |
|
|
482 | (1) |
|
Counting Permutations of [ l..n] with m Maximal Runs of Ascents |
|
|
483 | (1) |
|
|
483 | (6) |
|
|
489 | (56) |
|
|
490 | (4) |
|
|
494 | (9) |
|
|
495 | (2) |
|
|
497 | (2) |
|
Finite State Automata and Regular Languages |
|
|
499 | (4) |
|
Counting Regular Languages |
|
|
503 | (14) |
|
|
503 | (2) |
|
Counting Regular Languages |
|
|
505 | (9) |
|
Admissibility Considerations |
|
|
514 | (3) |
|
Waiting Time Probabilistic Problems |
|
|
517 | (10) |
|
Algorithms and Markov Chains |
|
|
527 | (18) |
|
Introduction to Asymptotics |
|
|
545 | (84) |
|
Asymptotic Notations and Applications |
|
|
546 | (17) |
|
Properties of the Big Oh Notation |
|
|
547 | (3) |
|
|
550 | (9) |
|
Limits for Indeterminate Forms |
|
|
559 | (4) |
|
The Critical Range Method |
|
|
563 | (6) |
|
|
569 | (10) |
|
The Euler Summation Formula |
|
|
579 | (12) |
|
|
589 | (2) |
|
|
591 | (7) |
|
Asymptotics from Recurrences |
|
|
598 | (11) |
|
Divide-and-Conquer Asymptotics |
|
|
598 | (6) |
|
|
604 | (5) |
|
Limit Laws in Probability |
|
|
609 | (20) |
|
|
610 | (6) |
|
The Central Limit Theorem |
|
|
616 | (7) |
|
|
623 | (6) |
|
Asymptotics and Generating Functions |
|
|
629 | (32) |
|
Elementary Bounds from Generating Functions |
|
|
629 | (5) |
|
The Lagrange Inversion Formula |
|
|
632 | (2) |
|
Estimates from Singularities |
|
|
634 | (15) |
|
|
634 | (7) |
|
Difference Equations: Asymptotics from GFs |
|
|
641 | (3) |
|
|
644 | (2) |
|
Darboux Theorem and its Relation to the Binomial Theorem |
|
|
646 | (2) |
|
Logarithmic Singularities |
|
|
648 | (1) |
|
Estimates from Entire Functions |
|
|
649 | (9) |
|
|
649 | (4) |
|
Asymptotics of Hypergeometric Series |
|
|
653 | (3) |
|
|
656 | (2) |
|
|
658 | (3) |
|
Review of Analytic Techniques |
|
|
661 | (38) |
|
|
661 | (6) |
|
|
667 | (10) |
|
|
667 | (6) |
|
Operations on Power Series |
|
|
673 | (4) |
|
Functions of a Complex Variable: Basic Concepts |
|
|
677 | (9) |
|
Diagonalization of Series |
|
|
683 | (3) |
|
|
686 | (6) |
|
Partial Fraction Decomposition |
|
|
692 | (2) |
|
|
694 | (2) |
|
|
696 | (3) |
|
|
699 | (54) |
|
Appendix A: Binomial Coefficients |
|
|
699 | (7) |
|
Appendix B: The Bernoulli Numbers |
|
|
706 | (2) |
|
Appendix C: Stirling and Euler/Eulerian Numbers |
|
|
708 | (7) |
|
Appendix D: Fibonacci Numbers |
|
|
715 | (4) |
|
Appendix E: Harmonic Numbers |
|
|
719 | (2) |
|
Appendix F: Miscellaneous Formulas |
|
|
721 | (4) |
|
Appendix G: The Gamma Function |
|
|
725 | (3) |
|
Appendix H: Random Variables and Distributions |
|
|
728 | (2) |
|
Appendix I: Combinatorics of Permutations |
|
|
730 | (2) |
|
Appendix J: Continued Fractions |
|
|
732 | (6) |
|
Appendix K: Occupancy Enumeration |
|
|
738 | (2) |
|
Appendix L: Generating Functions |
|
|
740 | (9) |
|
|
749 | (4) |
Answers/Hints to Selected Problems |
|
753 | (19) |
Bibliography |
|
772 | (11) |
Index |
|
783 | |