| |
| |
Orientation and Background | |
| |
| |
Introduction to Cognitive Interviewing | |
| |
| |
What is (and isn't) cognitive interviewing? | |
| |
| |
A broader perspective: The cognitive testing process | |
| |
| |
Setting the Stage: First Principles of Questionnaire Design | |
| |
| |
Questionnaire-related (and other) sources of error in self-report surveys | |
| |
| |
Why do survey questions produce response error? A sociolinguistic perspective | |
| |
| |
How can we avoid problems in survey questions? | |
| |
| |
If we are proficient designers, why do we need to test questions? | |
| |
| |
Chapter summary | |
| |
| |
Exercise: Question evaluation | |
| |
| |
The CASM Approach to Questionnaire Design | |
| |
| |
Origins of CASM | |
| |
| |
Applications of Basic CASM Research | |
| |
| |
Cognitive interviewing as Applied CASM Research | |
| |
| |
Chapter summary | |
| |
| |
Cognitive Interviewing in Practice: Think-Aloud, Verbal Probing, and Other Techniques | |
| |
| |
Think-Aloud interviewing | |
| |
| |
Verbal Probing Techniques | |
| |
| |
Concurrent versus retrospective interviewing | |
| |
| |
Choosing between think-aloud and probing techniques | |
| |
| |
Vignettes, card sorts, and field-based probes | |
| |
| |
Chapter summary | |
| |
| |
The Intricacies of Verbal Probing | |
| |
| |
Developing Standard Cognitive Probes | |
| |
| |
Examples of cognitive probing | |
| |
| |
Logical and structural problems | |
| |
| |
A systematic approach to probe development: The Question Pitfalls Model | |
| |
| |
Chapter summary | |
| |
| |
Exercise: Using the QAS to develop probe questions | |
| |
| |
Beyond the Standard Model of Verbal Probing | |
| |
| |
A classification of probe types | |
| |
| |
Proactive versus Reactive probing | |
| |
| |
Standardized versus free-form probes | |
| |
| |
Chapter summary | |
| |
| |
Exercise: Emergent probing | |
| |
| |
A Further Perspective: Probing as Expansive Interviewing | |
| |
| |
A broad view of cognitive interviewing | |
| |
| |
The Ethnographic Interview as an alternative perspective | |
| |
| |
Merging Cognitive and Expansive interviewing | |
| |
| |
Chapter summary | |
| |
| |
Avoiding Probing Pitfalls | |
| |
| |
Are we in danger of finding problems that don't exist? | |
| |
| |
Practices that avoid artificial problems | |
| |
| |
Chapter summary | |
| |
| |
The Cognitive Testing Process | |
| |
| |
Training of Cognitive Interviewers | |
| |
| |
Who makes a good cognitive interviewer? | |
| |
| |
Technical background of the cognitive interviewer | |
| |
| |
How should cognitive interviewer training be accomplished? | |
| |
| |
Continuing education in cognitive interviewing | |
| |
| |
Chapter summary | |
| |
| |
Planning and Conducting Cognitive Interviews | |
| |
| |
Fitting cognitive testing into the overall design sequence | |
| |
| |
Preparing for the interview: Subject recruitment | |
| |
| |
The interviewing process | |
| |
| |
Logistic issues in the cognitive interview | |
| |
| |
Chapter summary | |
| |
| |
Analyzing and Documenting Cognitive Interview Results | |
| |
| |
Characterizing cognitive interview outcomes | |
| |
| |
The analysis of think-aloud interview results | |
| |
| |
Analysis of the probed interview | |
| |
| |
Persistent analysis issues | |
| |
| |
Chapter summary | |
| |
| |
Exercise: Analyzing cognitive interviews | |
| |
| |
Other Issues and Topics | |
| |
| |
Special Applications of Cognitive Interviewing | |
| |
| |
Adjusting to survey administration mode | |
| |
| |
Cognitive testing of sensitive questions | |
| |
| |
Cognitive interviewing and establishment surveys | |
| |
| |
Testing questions on attitudes and opinions | |
| |
| |
Interviewing across the age range | |
| |
| |
Testing non-questionnaire materials | |
| |
| |
Chapter summary | |
| |
| |
Evaluation of Cognitive Interviewing Techniques | |
| |
| |
Theoretical perspectives | |
| |
| |
Empirical evaluation of cognitive interviewing | |
| |
| |
Are we evaluating the right outcome? | |
| |
| |
Limitations to cognitive interviews | |
| |
| |
Chapter summary | |
| |
| |
Beyond Cognitive Testing: Affiliated Pretesting Methods | |
| |
| |
Expert Review | |
| |
| |
Focus Groups | |
| |
| |
Behavior Coding | |
| |
| |
Reinterview surveys | |
| |
| |
How do pretesting methods compare? | |
| |
| |
Chapter summary | |
| |
| |
Recommendations and Future Directions | |
| |
| |
Twelve recommendations for cognitive interviewing practice | |
| |
| |
Future directions for cognitive interviewing | |
| |
| |
A final case study | |
| |
| |
In conclusion | |
| |
| |
References | |
| |
| |
| |
Sample cognitive testing protocol | |
| |
| |
| |
Example | |