The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Using cognitive interviews and think-aloud protocols to understand thought processes
Abstract
OUR SITUATION Cognitive interviews (CIs) and think-aloud protocols (TAPs) are two strategies that offer unique approaches to capture participant thought processes when engaging with instruments and interventions. In this paper, we describe the origins of CIs and TAPs, the types of research questions they can be used to address, and strategies to implement these approaches. METHODOLOGICAL LITERATURE REVIEW CIs and TAPs are interview methods that make thought processes more explicit. CIs include targeted interview questions that are focused on evaluating participant comprehension during an activity, such as a survey. TAPs request the participant to think-aloud while they solve a problem or complete a task; this is to help understand the problem-solving process. OUR RECOMMENDATIONS AND THEIR APPLICATIONS An understanding of the research aim is critical to identify whether a CI or TAP is preferred. Researchers should ensure that participants are selected based on the needs of the research and that they are appropriately prepared for the selected interview type. Individuals can analyze verbal reports from CIs and TAPs using qualitative and quantitative methods, and researchers are encouraged to disseminate their findings to inform design practices of other researchers. POTENTIAL IMPACT CIs and TAPs are methods that help pharmacy education researchers explore thought processes; specifically, these methods are useful to study test response processes, improve survey construction, and map cognitive models of complex thought processes. CIs and TAPs are methodologies that should be in the toolbox of pharmacy education researchers to support design, evaluation, and refinement of instruments and educational interventions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Psychology of Survey Response
Tourangeau, R., Rips, L. J., & Rasinski, K. (2000) · doi:10.1017/cbo9780511819322 · Cited by 4,734
Ericsson (1993) · doi:10.1037/0033-295x.87.3.215 · Cited by 4,539
Protocol Analysis: Verbal Reports as Data
Venkatesan, M., Ericsson, K. A., & Simon, H. A. (1986) · Journal of Marketing Research · doi:10.2307/3151491 · Cited by 4,347
Quantifying Qualitative Analyses of Verbal Data: A Practical Guide
Chi, M. T. H. (1997) · Journal of the Learning Sciences · doi:10.1207/s15327809jls0603_1 · Cited by 1,764
Research synthesis: the practice of cognitive interviewing
Beatty, P. C., & Willis, G. B. (2007) · Public Opinion Quarterly · doi:10.1093/poq/nfm006 · Cited by 1,615
Willis, G. B., & Artino, A. R. (2013) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-13-00154.1 · Cited by 685
How effective are selection methods in medical education? A systematic review
Patterson, F., Knight, A., Dowell, J., Nicholson, S., Cousans, F., & Cleland, J. (2016) · Medical Education · doi:10.1111/medu.12817 · Cited by 481
The think aloud method: what is it and how do I use it?
Eccles, D. W., & Arsal, G. (2017) · Qualitative Research in Sport, Exercise and Health · doi:10.1080/2159676x.2017.1331501 · Cited by 421
Rosenthal, M. (2016) · Currents in Pharmacy Teaching and Learning · doi:10.1016/j.cptl.2016.03.021 · Cited by 358
Patterson, F., Zibarras, L., & Ashworth, V. (2016) · Medical Teacher · doi:10.3109/0142159x.2015.1072619 · Cited by 232
Cited by
McGrath, C., Cerratto Pargman, T., Juth, N., & Palmgren, P. J. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2023.100139 · Cited by 195
How to use the Delphi method to aid in decision making and build consensus in pharmacy education
Olsen, A. A., Wolcott, M. D., Haines, S. T., Janke, K. K., & McLaughlin, J. E. (2021) · Currents in Pharmacy Teaching and Learning · doi:10.1016/j.cptl.2021.07.018 · Cited by 115
Self-citationGuo, S., Shi, L., & Zhai, X. (2025) · Education and Information Technologies · doi:10.1007/s10639-025-13338-6 · Cited by 35
Wardle, C., Urbani, S., & Wang, E. (2025) · Journal of Medical Internet Research · doi:10.2196/79961 · Cited by 43
“This method has shown to be useful in usability test settings in order to understand people’s behavior with particular technologies [68,69], including a previous iteration of a study observing and listening to people search for health information online [70].”
Explainable Recommendations and Calibrated Trust: Two Systematic User Errors
Naiseh, M., Cemiloglu, D., Al Thani, D., Jiang, N., & Ali, R. (2021) · Computer · doi:10.1109/mc.2021.3076131 · Cited by 30
Metadata
- Authors
- Wolcott, M. D., & Lobczowski, N. G.
- Venue
- Currents in Pharmacy Teaching and Learning
- Publisher
- Elsevier BV
- Published
- 2021-02
- Volume
- 13
- Issue
- 2
- Pages
- 181-188
- ISSN
- 1877-1297 (ISSN-L)
- OpenAlex
- W3093052501
- Cited by
- 256
- References
- 26
- FWCI
- 27.43
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Using cognitive interviews and think-aloud protocols to understand thought processes. https://app.cochat.ai/papers/10.1016/j.cptl.2020.09.005
- The paper
- Wolcott, M. D., & Lobczowski, N. G. (2021). Using cognitive interviews and think-aloud protocols to understand thought processes. Currents in Pharmacy Teaching and Learning. https://doi.org/10.1016/j.cptl.2020.09.005
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.