Foreword |
|
Gordon Willis |
|
xiii | |
Acknowledgments |
|
xv | |
Contributors |
|
xvii | |
|
|
1 | (6) |
|
|
1.1 Cognitive Interviewing Methodology |
|
|
2 | (5) |
|
2 Foundations and New Directions |
|
|
7 | (8) |
|
|
|
|
7 | (1) |
|
2.2 Sociology and the Interpretivist Tradition |
|
|
8 | (1) |
|
2.3 New Directions: Interpretation and Cognition |
|
|
9 | (2) |
|
2.4 Methodological Implications for Cognitive Interviewing |
|
|
11 | (3) |
|
|
14 | (1) |
|
|
15 | (20) |
|
|
|
|
15 | (1) |
|
3.2 Cognitive Interviewing Study Sample |
|
|
15 | (5) |
|
3.2.1 Considerations of Sample Design |
|
|
16 | (4) |
|
3.3 The Cognitive Interview |
|
|
20 | (8) |
|
3.3.1 Differing Approaches to Cognitive Interviewing |
|
|
20 | (2) |
|
3.3.2 Different Kinds of Data: Respondent as Evaluator versus Respondent as Story Teller |
|
|
22 | (6) |
|
3.4 The Role of Interviewer |
|
|
28 | (5) |
|
3.4.1 Interviewer as Data Collector |
|
|
29 | (1) |
|
3.4.2 Interviewer as Researcher |
|
|
30 | (3) |
|
|
33 | (2) |
|
|
35 | (16) |
|
|
|
|
|
|
35 | (1) |
|
4.2 Analysis of Cognitive Interviews: Overview |
|
|
36 | (2) |
|
4.3 Analytic Steps for Cognitive Interviews |
|
|
38 | (11) |
|
4.3.1 Step 1: Conducting the Interview |
|
|
39 | (1) |
|
4.3.2 Step Two: Producing Interview Summaries |
|
|
40 | (2) |
|
4.3.3 Step Three: Developing a Thematic Schema |
|
|
42 | (2) |
|
4.3.4 Step Four: Developing an Advanced Schema |
|
|
44 | (3) |
|
4.3.5 Step Five: Making Conclusions |
|
|
47 | (2) |
|
4.4 The Benefits of a Complete Analysis |
|
|
49 | (1) |
|
|
50 | (1) |
|
5 Assessing Translated Questions via Cognitive Interviewing |
|
|
51 | (18) |
|
|
|
|
51 | (1) |
|
5.2 Why Use Cognitive Testing in Multilingual Survey Research |
|
|
51 | (3) |
|
5.2.1 Multilingual Research Settings |
|
|
52 | (1) |
|
5.2.2 Instrument Production in Multilingual Settings |
|
|
53 | (1) |
|
5.3 Translation and Translation Assessment Procedures |
|
|
54 | (3) |
|
5.3.1 Team Translation Approaches |
|
|
54 | (1) |
|
5.3.2 Translation Assessment Procedures |
|
|
54 | (1) |
|
5.3.3 Pretesting as Part of Translation Assessment |
|
|
55 | (2) |
|
5.4 Cognitively Testing Translations of Survey Questions |
|
|
57 | (3) |
|
5.4.1 Cognitive Interviewers |
|
|
58 | (1) |
|
5.4.2 Respondent Selection |
|
|
58 | (1) |
|
5.4.3 Introduction, Protocol, and Implementation |
|
|
59 | (1) |
|
|
59 | (1) |
|
5.5 Problems Uncovered by Cognitive Testing of Translations |
|
|
60 | (6) |
|
5.5.1 Uncovering Translation Problems |
|
|
61 | (3) |
|
5.5.2 Uncovering Problems with the Source Question |
|
|
64 | (1) |
|
5.5.3 Uncovering Problems Related to Cultural Differences -- Need for Adaptation |
|
|
65 | (1) |
|
|
66 | (3) |
|
|
69 | (16) |
|
|
|
|
69 | (1) |
|
6.2 Contents of a Cognitive Interviewing Report |
|
|
70 | (10) |
|
|
70 | (1) |
|
6.2.2 Summary of Findings |
|
|
71 | (2) |
|
|
73 | (4) |
|
6.2.4 Question-by-Question Review |
|
|
77 | (3) |
|
|
80 | (1) |
|
6.3 Characteristics of a Cognitive Interviewing Report |
|
|
80 | (4) |
|
|
81 | (1) |
|
|
82 | (2) |
|
|
84 | (1) |
|
7 Case Study: Evaluation of a Sexual Identity Question |
|
|
85 | (22) |
|
|
|
|
85 | (1) |
|
|
86 | (7) |
|
7.2.1 Intended Construct for the National Health Interview Survey Sexual Identity Question |
|
|
86 | (1) |
|
7.2.2 Review of Data Quality Problems |
|
|
87 | (2) |
|
7.2.3 Development of an Improved Sexual Identity Question |
|
|
89 | (4) |
|
7.3 Case Study: Cognitive Interviewing Evaluation of the National Health Interview Survey Revised Sexual Identity Question |
|
|
93 | (3) |
|
7.3.1 Recruitment and Respondent Demographics |
|
|
93 | (1) |
|
7.3.2 Interviewing Procedures |
|
|
93 | (2) |
|
|
95 | (1) |
|
|
96 | (10) |
|
7.4.1 Summary of Question Performance |
|
|
96 | (1) |
|
7.4.2 Basis of Respondents' Answers |
|
|
97 | (2) |
|
7.4.3 Cases of Response Problems |
|
|
99 | (1) |
|
7.4.4 Interpretation of Categories |
|
|
100 | (5) |
|
|
105 | (1) |
|
|
106 | (1) |
|
8 Analysis Software for Cognitive Interviewing Studies: Q-Notes and Q-Bank |
|
|
107 | (26) |
|
|
|
|
107 | (1) |
|
8.2 Q-Notes Analysis Features |
|
|
108 | (10) |
|
8.2.1 Level 1: Conducting Interviews |
|
|
108 | (2) |
|
8.2.2 Level 2: Summarizing Interview Notes |
|
|
110 | (2) |
|
8.2.3 Level 3: Comparing Across Respondents |
|
|
112 | (3) |
|
8.2.4 Level 4: Comparing Across Groups |
|
|
115 | (3) |
|
8.2.5 Level 5: Drawing Conclusions about Question Performance |
|
|
118 | (1) |
|
8.3 Project Management Features |
|
|
118 | (7) |
|
8.3.1 Streamlined Communication |
|
|
119 | (1) |
|
8.3.2 Interview Data Collection |
|
|
119 | (2) |
|
8.3.3 Respondent Descriptors |
|
|
121 | (1) |
|
8.3.4 Controlled Access by Project |
|
|
121 | (1) |
|
|
122 | (2) |
|
8.3.6 Question Translations |
|
|
124 | (1) |
|
|
124 | (1) |
|
8.4 Q-Bank: Making Cognitive Interview Findings Publicly Accessible |
|
|
125 | (1) |
|
|
126 | (4) |
|
8.5.1 Searching for Questions |
|
|
126 | (1) |
|
|
127 | (1) |
|
|
128 | (1) |
|
|
129 | (1) |
|
8.6 Q-Bank: Challenges for the Past and Future |
|
|
130 | (1) |
|
|
130 | (3) |
|
9 Cognitive Interviewing in Mixed Research |
|
|
133 | (20) |
|
|
|
|
133 | (1) |
|
9.2 The Mixed Research Paradigm: Characteristics and Design |
|
|
134 | (2) |
|
9.2.1 Cognitive Interviewing Studies and Research Design |
|
|
135 | (1) |
|
9.3 Mixed Method Research and Survey Question Evaluation |
|
|
136 | (16) |
|
9.3.1 Case 1: Cognitive Interviewing and Survey Field Testing |
|
|
137 | (8) |
|
9.3.2 Case 2: Cognitive Interviewing and Differential Item Functioning (DIF) |
|
|
145 | (3) |
|
9.3.3 Case 3: Cognitive Interviewing and Psychometric Scales |
|
|
148 | (4) |
|
|
152 | (1) |
|
|
153 | (10) |
|
|
|
|
|
|
153 | (1) |
|
10.2 Summary of Practices |
|
|
154 | (5) |
|
|
154 | (2) |
|
|
156 | (1) |
|
10.2.3 Documenting Study Findings |
|
|
157 | (2) |
|
|
159 | (4) |
|
10.3.1 Topics for Examination |
|
|
159 | (1) |
|
10.3.2 Mixed Method Research |
|
|
160 | (1) |
|
10.3.3 Accepted Standards of Cognitive Interviewing Studies |
|
|
161 | (2) |
Key Concepts |
|
163 | (4) |
Question Evaluation Resources |
|
167 | (4) |
References |
|
171 | (10) |
Index |
|
181 | |