| Preface |
|
xi | |
|
|
|
1 | (40) |
|
The Importance of Program Evaluation |
|
|
1 | (7) |
|
|
|
8 | (1) |
|
Characteristics of "Good" Programs |
|
|
9 | (3) |
|
|
|
12 | (6) |
|
Program Evaluation Defined |
|
|
18 | (1) |
|
Reasons Why Programs Are Evaluated |
|
|
19 | (1) |
|
Motivations for Program Evaluation |
|
|
20 | (4) |
|
Overcoming the Subjective Perspective |
|
|
24 | (5) |
|
Philosophical Assumptions of Program Evaluation |
|
|
29 | (4) |
|
|
|
33 | (3) |
|
|
|
36 | (5) |
|
Chapter 2 Ethical Issues in Program Evaluation |
|
|
41 | (22) |
|
The Role of Institutional Review Boards (IRBS) |
|
|
42 | (1) |
|
|
|
42 | (5) |
|
How Ethical Guidelines Get Operationalized |
|
|
47 | (2) |
|
Research with Special Populations |
|
|
49 | (2) |
|
Ethical Issues Pertaining to Diverse Cultures and Groups |
|
|
51 | (1) |
|
Ethical Boundaries in Participatory and Action Research |
|
|
52 | (4) |
|
The Practitioner-Evaluator's Ethical Responsibilities |
|
|
56 | (1) |
|
Concluding Thoughts on Ethics and Evaluation |
|
|
57 | (6) |
|
Chapter 3 Needs Assessment |
|
|
63 | (30) |
|
Types of Needs Assessment |
|
|
65 | (3) |
|
How Does a Needs Assessment Start? |
|
|
68 | (2) |
|
What Are the Steps Involved in Conducting a Needs Assessment? |
|
|
70 | (1) |
|
How Do I Select a Needs Assessment Approach? |
|
|
71 | (7) |
|
What Do I Need To Know About Surveys? |
|
|
78 | (3) |
|
Special Considerations: Converging the Data |
|
|
81 | (2) |
|
Thinking Creatively About Needs Assessment |
|
|
83 | (1) |
|
What Is a Community Readiness Study? |
|
|
84 | (9) |
|
Chapter 4 Qualitative and Mixed Methods in Evaluation |
|
|
93 | (28) |
|
|
|
93 | (1) |
|
What Is "Qualitative Evaluation"? |
|
|
94 | (1) |
|
What Is "Mixed Methods Evaluation"? |
|
|
94 | (1) |
|
When Is Qualitative Evaluation Useful? When Is Mixed Methods Evaluation the Right Choice? |
|
|
95 | (3) |
|
Qualitative Methods and Evaluation of Practitioners In Situ |
|
|
98 | (1) |
|
Qualitative Methods Commonly Used in Evaluation Research |
|
|
99 | (1) |
|
|
|
99 | (1) |
|
Designing a Mixed Methods Evaluation |
|
|
100 | (4) |
|
Managing and Organizing Qualitative Data |
|
|
104 | (1) |
|
|
|
105 | (2) |
|
Mixed Methods Data Analysis and Integration |
|
|
107 | (1) |
|
|
|
108 | (2) |
|
|
|
110 | (1) |
|
Dissemination and Advocacy |
|
|
111 | (2) |
|
Examples of Qualitative Evaluations |
|
|
113 | (8) |
|
Chapter 5 What Are Formative and Process Evaluation? |
|
|
121 | (34) |
|
How Do I Develop a Logic Model? |
|
|
122 | (3) |
|
|
|
125 | (1) |
|
|
|
125 | (1) |
|
Conducting a Formative Evaluation |
|
|
126 | (3) |
|
What Is Process Evaluation? |
|
|
129 | (2) |
|
Process Evaluation: Program Description Function |
|
|
131 | (5) |
|
Process Evaluation: Program Monitoring |
|
|
136 | (1) |
|
Becoming a Program Monitor |
|
|
136 | (2) |
|
Mission Statements, Goals, and Objectives |
|
|
138 | (3) |
|
Writing Program Objectives |
|
|
141 | (2) |
|
What Should Be Monitored? |
|
|
143 | (3) |
|
|
|
146 | (2) |
|
|
|
148 | (3) |
|
|
|
151 | (4) |
|
Chapter 6 Single System Research Designs |
|
|
155 | (38) |
|
What Are Single System Research Designs? |
|
|
155 | (3) |
|
Selecting Outcome Measures |
|
|
158 | (2) |
|
Assessing Measures Over Time |
|
|
160 | (1) |
|
Notation and General Principles |
|
|
161 | (2) |
|
|
|
163 | (2) |
|
|
|
165 | (2) |
|
Quality Assurance Studies |
|
|
167 | (2) |
|
Summative Evaluation Designs |
|
|
169 | (4) |
|
Summative Experimental Designs |
|
|
173 | (7) |
|
|
|
180 | (1) |
|
|
|
181 | (2) |
|
|
|
183 | (2) |
|
Ethics of Single System Research Designs |
|
|
185 | (1) |
|
How to Critically Review a SSRD |
|
|
186 | (1) |
|
|
|
187 | (6) |
|
Chapter 7 Client Satisfaction |
|
|
193 | (18) |
|
The Importance of Monitoring Consumer Satisfaction |
|
|
193 | (2) |
|
The Arguments for Client Satisfaction Studies |
|
|
195 | (1) |
|
The Problem with Client Satisfaction Studies |
|
|
196 | (3) |
|
A Sampling of Recent Client Satisfaction Studies |
|
|
199 | (1) |
|
How Do Consistently High Ratings Get Explained? |
|
|
200 | (2) |
|
Recommendations for Client Satisfaction Studies |
|
|
202 | (9) |
|
|
|
211 | (16) |
|
What Are Nonprobability Sampling Designs? |
|
|
212 | (4) |
|
What Is Probability (Scientific) Sampling? |
|
|
216 | (3) |
|
Considerations in Selecting a Sample |
|
|
219 | (2) |
|
How Big Should the Sample Be? |
|
|
221 | (3) |
|
|
|
224 | (3) |
|
Chapter 9 Group Research Designs |
|
|
227 | (56) |
|
What Are Group Research Designs? |
|
|
227 | (1) |
|
Starting an Outcome Evaluation |
|
|
228 | (3) |
|
Outcome Evaluation Designs |
|
|
231 | (3) |
|
General Principles of Group Research Designs |
|
|
234 | (1) |
|
Pre-Experimental Research Designs |
|
|
235 | (11) |
|
Quasi-Experimental Research Designs |
|
|
246 | (6) |
|
Some Threats to Internal Validity |
|
|
252 | (5) |
|
Protection Against Alternative Explanations |
|
|
257 | (1) |
|
|
|
258 | (8) |
|
Efficacy and Effectiveness Studies |
|
|
266 | (2) |
|
What About Negative Outcome Studies? |
|
|
268 | (3) |
|
A Note About the Term Experiment |
|
|
271 | (1) |
|
Some Newer Developments in Experimental Program Evaluation |
|
|
272 | (2) |
|
|
|
274 | (9) |
|
Chapter 10 Cost-Effectiveness and Cost Analysis |
|
|
283 | (18) |
|
Why Consider Cost as an Evaluative Criterion? |
|
|
283 | (3) |
|
Example of a Cost-Effectiveness Evaluation |
|
|
286 | (1) |
|
How Do I Begin a Cost-Effectiveness Study? |
|
|
287 | (3) |
|
|
|
290 | (2) |
|
|
|
292 | (4) |
|
|
|
296 | (5) |
|
Chapter 11 Measurement Tools and Strategies |
|
|
301 | (30) |
|
Why Is Good Measurement so Important to Evaluation? |
|
|
301 | (2) |
|
|
|
303 | (3) |
|
|
|
306 | (1) |
|
What Do I Need to Know About Reliability? |
|
|
307 | (5) |
|
What Do I Need to Know About Validity? |
|
|
312 | (3) |
|
How Do I Find an Instrument for My Evaluation Project? |
|
|
315 | (2) |
|
How Does One Construct a "Good" Evaluation Instrument? What Do I Need to Know About Questionnaire Design? |
|
|
317 | (3) |
|
What Are Some of the Commons Errors Made in Developing Questionnaires? |
|
|
320 | (7) |
|
What Do I Need to Know About Levels of Measurement in Designing Instruments? |
|
|
327 | (4) |
|
Chapter 12 Selecting the Best Evaluation Measure for Your Project |
|
|
331 | (20) |
|
Checklist for Selecting Evaluation Instruments |
|
|
332 | (2) |
|
|
|
334 | (2) |
|
Evaluation Self-Efficacy Scale |
|
|
336 | (2) |
|
The Community Attitudes Toward Sex Offenders (CATSO) Scale |
|
|
338 | (2) |
|
Intimate Violence Responsibility Scale (IVRS) |
|
|
340 | (3) |
|
|
|
343 | (3) |
|
|
|
346 | (5) |
|
Chapter 13 Pragmatic Issues |
|
|
351 | (28) |
|
What Is Treatment Fidelity and Why Is It so Important? |
|
|
351 | (5) |
|
|
|
356 | (3) |
|
Program Drift and the Transfer of Programs |
|
|
359 | (1) |
|
How Might Political Issues Affect a Program Evaluation? |
|
|
360 | (2) |
|
The "Threat" of Evaluation |
|
|
362 | (1) |
|
Guidelines for Evaluation in Politically Charged Arenas |
|
|
363 | (4) |
|
Internal and External Evaluators |
|
|
367 | (3) |
|
Culturally Sensitive Evaluation Practice |
|
|
370 | (4) |
|
|
|
374 | (5) |
|
Chapter 14 Writing Evaluation Proposals, Reports, and Journal Articles |
|
|
379 | (24) |
|
Components of the Evaluation Proposal and Report |
|
|
380 | (11) |
|
Considerations in Planning and Writing Evaluation Reports and Manuscripts |
|
|
391 | (1) |
|
Common Mistakes Made by Students in Writing Evaluation Reports |
|
|
392 | (3) |
|
Checklist for Writing and Assessing Evaluation Reports |
|
|
395 | (2) |
|
The Utilization of Evaluation Reports |
|
|
397 | (1) |
|
Writing for Professional Publication |
|
|
398 | (5) |
| Index |
|
403 | |
