Comparing results from different styles of cognitive interviewing: ‘verbal probing’ vs. ‘thinking aloud’
Abstract
Two styles of cognitive interviewing exist, thinking aloud (TA) and verbal probing (VP), but there have been few studies undertaken which compare the two. This paper reports on such a comparison, which was undertaken in order to understand the merits and drawbacks of each approach. VP finds more problems than TA. TA appears to be better at examining respondents’ understandings of the underlying concepts behind each question; VP is better for exploring specific terms in each question. TA interviews appeared to generate more information about how respondents used information from their past experiences to select codes in closed‐ended questions. However, in terms of the eventual redrafting of the questions respondents were asked about, there was very little difference between the VP and TA interviews.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The round 1 survey was validated in a pilot phase with three senior psychiatry residents using the 'think aloud' approach.
“The survey was validated in a pilot phase, during which three senior psychiatry residents from the Netherlands and Belgium filled out the survey in the presence of the corresponding author using the ‘think aloud’ approach. 9”
From Irremediable psychiatric suffering in the context of medical assistance in dying: A delphi-study (2022) · cites this paper as [9]
Cites
The Psychology of Survey Response
Tourangeau, R., Rips, L. J., & Rasinski, K. (2000) · doi:10.1017/cbo9780511819322 · Cited by 4,734 · see citing works
Elder, J. W., Geertz, C., & Rosenhack, K. P. S. (1964) · Cited by 3,878 · see citing works
Cognitive Interviewing: A Tool for Improving Questionnaire Design
Willis, G. (2004) · Cited by 1,934 · see citing works
Willis, G. (2005) · doi:10.4135/9781412983655 · Cited by 1,778 · see citing works
Research synthesis: the practice of cognitive interviewing
Beatty, P. C., & Willis, G. B. (2007) · Public Opinion Quarterly · doi:10.1093/poq/nfm006 · Cited by 1,615 · see citing works
Gusfield, J. R., & Apter, D. E. (1966) · American Sociological Review · doi:10.2307/2091287 · Cited by 1,279 · see citing works
Methods for Testing and Evaluating Survey Questionnaires
(2004) · doi:10.1002/0471654728 · Cited by 855 · see citing works
Questions and Answers in Attitude Surveys.
Robinson, J. P., Schuman, H., & Presser, S. (1983) · Social Forces · doi:10.2307/2578327 · Cited by 781 · see citing works
(1983) · Electoral Studies · doi:10.1016/0261-3794(83)90143-9 · Cited by 553 · see citing works
Questions and Answers in Attitude Surveys
Albaum, G., Schuman, H., & Presser, S. (1982) · Journal of Marketing Research · doi:10.2307/3151742 · Cited by 512 · see citing works
Sutton, R. M. (2004) · The British Journal of Criminology · doi:10.1093/bjc/azh084 · Cited by 356 · see citing works
Do the social sciences create phenomena?: the example of public opinion research
Osborne, T., & Rose, N. (1999) · British Journal of Sociology · doi:10.1111/j.1468-4446.1999.00367.x · Cited by 270 · see citing works
Opinions on Fictitious Issues: The Pressure to Answer Survey Questions
Bishop, G. F., Tuchfarber, A. J., & Oldendick, R. W. (1986) · Public Opinion Quarterly · doi:10.1086/268978 · Cited by 240 · see citing works
Cognitive Interviewing Revisited: A Useful Technique, in Theory?
Willis, G. (2004) · doi:10.1002/0471654728.ch2 · Cited by 103 · see citing works
Hills, M. G., & Belson, W. A. (1988) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.2307/2347500 · Cited by 95 · see citing works
The Dynamics of Cognitive Interviewing
Beatty, P. C. W. (2004) · doi:10.1002/0471654728.ch3 · Cited by 89 · see citing works
Sources of Error in Cognitive Interviews
Conrad, F. G., & Blair, J. (2009) · Public Opinion Quarterly · doi:10.1093/poq/nfp013 · Cited by 88 · see citing works
Data Quality in Cognitive Interviews: The Case of Verbal Reports
Conrad, F. G., & Blair, J. (2004) · doi:10.1002/0471654728.ch4 · Cited by 66 · see citing works
Do Different Cognitive Interview Techniques Produce Different Results?
DeMaio, T. J., & Landreth, A. (2004) · doi:10.1002/0471654728.ch5 · Cited by 63 · see citing works
Do Surveys Overstate Public Concerns?
Sterngold, A., Warland, R. H., & Herrmann, R. O. (1994) · Public Opinion Quarterly · doi:10.1086/269421 · Cited by 57 · see citing works
Sudman, S., Belson, W. A., Converse, J. M., & Presser, S. (1988) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2070641 · Cited by 46 · see citing works
Farrall, S. D., Priede, C., Ruuskanen, E., Jokinen, A., Galev, T., Arcai, M., & Maffei, S. (2011) · International Journal of Social Research Methodology · doi:10.1080/13645579.2011.640147 · Cited by 10 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Peterson, C. H., Peterson, N. A., & Powell, K. G. (2017) · Measurement and Evaluation in Counseling and Development · doi:10.1080/07481756.2017.1339564 · Cited by 336 · see citing works
Hilton, C. E. (2015) · International Journal of Social Research Methodology · doi:10.1080/13645579.2015.1091640 · Cited by 148 · see citing works
The value of cognitive interviewing for optimizing a patient experience survey
Buers, C., Triemstra, M., Bloemendal, E., Zwijnenberg, N. C., Hendriks, M. C. P., & Delnoij, D. M. J. (2013) · International Journal of Social Research Methodology · doi:10.1080/13645579.2012.750830 · Cited by 56 · see citing works
Yzermans, J. C., Baliatsas, C., van Dulmen, S., & KAMP, I. V. (2015) · International Journal of Hygiene and Environmental Health · doi:10.1016/j.ijheh.2015.08.006 · Cited by 34 · see citing works
Sadiqi, S., Lehr, A. M., Post, M. W. M., Dvorak, M. F., Kandziora, F., Rajasekaran, S., Schnake, K. J., Vaccaro, A. R., & Öner, F. C. (2017) · European Spine Journal · doi:10.1007/s00586-017-5032-8 · Cited by 28 · see citing works
Aukes, E. J., Bontje, L. E., & Slinger, J. H. (2019) · Forum qualitative Sozialforschung · doi:10.17169/fqs-21.2.3422 · Cited by 28 · see citing works
The ‘thinking aloud’ process: a way forward in social work supervision
Rankine, M. (2019) · Reflective Practice · doi:10.1080/14623943.2018.1564651 · Cited by 24 · see citing works
Irremediable psychiatric suffering in the context of medical assistance in dying: A delphi-study
van Veen, S. M. P., Evans, N., Ruissen, A. M., Vandenberghe, J., Beekman, A. T. F., & Widdershoven, G. A. M. (2022) · The Canadian Journal of Psychiatry · doi:10.1177/07067437221087052 · Cited by 21 · see citing works
Budtz, C. R., Rønn-Smidt, H., Thomsen, J. L., Hansen, R. P., & Christiansen, D. H. (2021) · BMC Family Practice · doi:10.1186/s12875-021-01546-1 · Cited by 21 · see citing works
Which probes are most useful when undertaking cognitive interviews?
Priede, C., Jokinen, A., Ruuskanen, E., & Farrall, S. D. (2013) · International Journal of Social Research Methodology · doi:10.1080/13645579.2013.799795 · Cited by 21 · see citing works
Self-citationDeveloping and Validating Cognitive Models in Assessment
Keehner, M., Gorin, J. S., Feng, G., & Katz, I. R. (2016) · John Wiley & Sons, Inc. eBooks · doi:10.1002/9781118956588.ch4 · Cited by 20 · see citing works
Presenting the Meta-Performance Test, a Metacognitive Battery based on Performance
Castillo-Díaz, M. A., & Gomes, C. M. A. (2021) · International Journal of Educational Methodology · doi:10.12973/ijem.7.2.289 · Cited by 17 · see citing works
Evans, J. H. (2024) · doi:10.1093/oso/9780197750704.001.0001 · Cited by 16 · see citing works
Fortuna, K. L., Myers, A., Brooks, J., Collins-Pisano, C., Marceau, S., Pratt, S., Lyons, K., Walker, R., Thompson, S., Greene, K., et al. (2021) · Patient Experience Journal · doi:10.35680/2372-0247.1533 · Cited by 15 · see citing works
Jacobs, C., Wheeler, J., Williams, M. A., & Joiner, R. (2023) · Computers & Education X Reality · doi:10.1016/j.cexr.2023.100027 · Cited by 13 · see citing works
Luckett, T., Virdun, C., Rao, A., Daly, L., Hackl, N. A., Willems, A., & Phillips, J. L. (2022) · Annals of Palliative Medicine · doi:10.21037/apm-22-9 · Cited by 13 · see citing works
The Response Process Evaluation MethodPreprint
Wolf, M. G., Ihm, E. D., Maul, A., & Taves, A. (2023) · doi:10.31234/osf.io/rbd2x · Cited by 13 · see citing works
Smith, S. K., Burns-O’Connell, G., Knibb, R. C., Greenwood, R., Hussain, S., Shaw, R. L., Straus, J., Banks, J., Hall, A. J., Dhanda, N., et al. (2024) · Health Expectations · doi:10.1111/hex.70088 · Cited by 11 · see citing works
Wang, H., King, B., & Yang, R. (2022) · The Gerontologist · doi:10.1093/geront/gnac176 · Cited by 11 · see citing works
Tarrant, C., Angell, E., Baker, R., Boulton, M. G., Freeman, G. K., Wilkie, P., Jackson, P., Wobi, F., & Ketley, D. (2014) · Health Services and Delivery Research · doi:10.3310/hsdr02460 · Cited by 12 · see citing works
Chong, D. W.-Q., Jawahir, S., Tan, E. H., & Sararaks, S. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18094435 · Cited by 11 · see citing works
Brzoska, P., Erdsiek, F., Aksakal, T., Mader, M., Ölçer, S., Idris, M., Altinok, K., Wahidie, D., Padberg, D., & Yılmaz-Aslan, Y. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19031620 · Cited by 10 · see citing works
Farrall, S. D., Priede, C., Ruuskanen, E., Jokinen, A., Galev, T., Arcai, M., & Maffei, S. (2011) · International Journal of Social Research Methodology · doi:10.1080/13645579.2011.640147 · Cited by 10 · see citing works
Self-citationMeadows, K., Ferrante, N., & Geršić, T. (2025) · Patient · doi:10.1007/s40271-025-00752-8 · Cited by 9 · see citing works
The Response-Process-Evaluation Method: A New Approach to Survey-Item Validation
Wolf, M. G., Ihm, E. D., Maul, A., & Taves, A. (2025) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459251353135 · Cited by 9 · see citing works
Sopromadze, N., & Moorosi, P. (2016) · International Journal of Research & Method in Education · doi:10.1080/1743727x.2016.1181163 · Cited by 8 · see citing works
Validation of Parkinson’s Disease-Related Questionnaires in South Africa
Nelson, G., Ndlovu, N., Christofides, N. J., Hlungwani, T. M., Faust, I. M., & Racette, B. A. (2020) · Parkinson s Disease · doi:10.1155/2020/7542138 · Cited by 8 · see citing works
Grove, B. E., Schougaard, L. M. V., Ivarsen, P., Kyte, D. G., Hjøllund, N. H., & de Thurah, A. L. (2021) · Journal of Patient-Reported Outcomes · doi:10.1186/s41687-021-00384-0 · Cited by 8 · see citing works
Passmore, S. R., Gerbitz, A., Hancock, G. R., Evans, L., Green‐Harris, G., Edwards, D. F., Jackson, T., & Thomas, S. B. (2024) · Journal of Empirical Research on Human Research Ethics · doi:10.1177/15562646231222665 · Cited by 6 · see citing works
Supervision Under the Microscope: Critical Conversations in a Learning Community
Davys, A. M., Howard, F., Rankine, M., & Thompson, A. (2019) · Practice · doi:10.1080/09503153.2018.1558196 · Cited by 7 · see citing works
Kotsev, E. N. (2022) · Organizacija · doi:10.2478/orga-2022-0004 · Cited by 6 · see citing works
“I Chose Math Because…”: Cognitive interviews of a motivation measure
Rutherford, T. A., Liu, A. S., & Wagemaker, M. (2021) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2021.101992 · Cited by 7 · see citing works
Rankine, M., & Thompson, A. (2022) · Qualitative Social Work · doi:10.1177/14733250221113020 · Cited by 5 · see citing works
The multidimensional online civic engagement for youth (MOCE-Y) scale: development and validation
Ni, Y., Geldhof, G. J., Chandler, K. D., & Settersten, R. A. (2026) · Applied Developmental Science · doi:10.1080/10888691.2026.2623250 · Cited by 4 · see citing works
Wheldon, C. W., Grace, J., Zimet, G. D., Daley, E. M., Akpan, I. N., Alkhatib, S. A., & Thompson, E. L. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.109557 · Cited by 4 · see citing works
Data‐rich textbook figures promote core competencies: Comparison of two textbooks
Finby, B., Heyer, L. J., & Campbell, A. M. (2021) · Biochemistry and Molecular Biology Education · doi:10.1002/bmb.21488 · Cited by 4 · see citing works
Burshnic, V., Knollman-Porter, K., Topper, R. H., McConnell, E. S., Haitsma, K. S. V., & Abbott, K. H. (2022) · American Journal of Speech-Language Pathology · doi:10.1044/2022_ajslp-21-00303 · Cited by 4 · see citing works
van der Wind, A. J. H. –., van Diemen, T., Dompeling, S. D., Öner, F. C., Post, M. W. M., & Sadiqi, S. (2022) · Spinal Cord · doi:10.1038/s41393-022-00829-3 · Cited by 5 · see citing works
Адаптация и валидизация шкалы проэкологической мотивации на российской выборке
Ivanova, A. A., Agissova, F., Максимовна, Ш. Т., & Владимировна, С. Е. (2023) · Психология Журнал Высшей школы экономики · doi:10.17323/1813-8918-2023-4-679-698 · Cited by 4 · see citing works
An Unreliable Ladder: Top–Bottom Self-Placement, Subjective Social Status, and Political Preferences
Anderson, L. R., & Aussant, A. (2025) · Sociological Science · doi:10.15195/v12.a25 · Cited by 3 · see citing works
Li, S., Gao, Y., Lin, Y., Wu, W., Fang, Q., Ni, X., Zhou, Y., Hong, M., Zhang, R., & Lou, Y. (2022) · Journal of Clinical Nursing · doi:10.1111/jocn.16272 · Cited by 3 · see citing works
Hunch Mining: Intuition Augmented with Cognitive Computing, Analytics, and Artificial Intelligence
Nelson, J., Clark, T. W., & Stewart, I. (2018) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2018.633 · Cited by 3 · see citing works
Faizah, F., Suminar, D. R., & Yoenanto, N. H. (2025) · Cogent Education · doi:10.1080/2331186x.2025.2588903
A Qualitative Exploration of Maternal Anxiety: Implications for Helping Professionals
Prikhidko, A., Pathirana, M., Long, H., Bendeck, A. C., & Acosta, P. (2022) · Maternal and Child Health Journal · doi:10.1007/s10995-022-03546-8 · Cited by 3 · see citing works
Can Smartphone Apps Assist People with Serious Mental Illness in Taking Medications as Prescribed?
Bianco, C. L., Myers, A. L., Smagula, S. F., & Fortuna, K. L. (2020) · Sleep Medicine Clinics · doi:10.1016/j.jsmc.2020.10.010 · Cited by 2 · see citing works
Adamczyk, P., Markowska, M., Petelewicz, M., Piotrowska, K., & Stankowska, J. (2021) · Przegląd Socjologii Jakościowej · doi:10.18778/1733-8069.17.1.09 · Cited by 2 · see citing works
Zamanzadeh, V., Ghahramanian, A., Valizadeh, L., & Bagheriyeh, F. (2022) · Research Square · doi:10.21203/rs.3.rs-587444/v2 · Cited by 2 · see citing works
Heyl, L., Schneider, N., Herbst, F. A., Engeleit, K., Hesse, A., Bökel, A., Korallus, C., & Egen, C. (2025) · Zeitschrift für Evidenz Fortbildung und Qualität im Gesundheitswesen · doi:10.1016/j.zefq.2025.10.005 · Cited by 1 · see citing works
Kognitivno intervjuiranje kao metoda predtestiranja upitničkih mjera
Vukelić, N. (2022) · Psihologijske teme · doi:10.31820/pt.31.2.4 · Cited by 1 · see citing works
Caporaso, A., & Presser, S. (2024) · Journal of Survey Statistics and Methodology · doi:10.1093/jssam/smad047 · Cited by 1 · see citing works
Robb, D. A., Risbridger, D. R., Mills, B., Rakhmatulin, I., Kong, X., Erden, M. S., Esser, M. J. D., Carter, R., & Chantler, M. J. (2024) · IEEE International Conference on Automation Science and Engineering (CASE) · doi:10.1109/case59546.2024.10711782 · Cited by 1 · see citing works
Bagheriyeh, F., Ghahramanian, A., Valizadeh, L., & Zamanzadeh, V. (2021) · Research Square · doi:10.21203/rs.3.rs-587444/v1 · Cited by 1 · see citing works
JAK RELIGIJNI? WNIOSKI Z WYWIADÓW KOGNITYWNYCH DLA BADANIA RELIGIJNOŚCI POLAKÓW
Bożewicz, M. (2016) · Uniwersyteckie Czasopismo Socjologiczne · doi:10.21697/ucs.2016.17.4.06
Lin, C.-H., & Chou, F. (2020) · Journal of Family Studies · doi:10.1080/13229400.2020.1864452
Fortuna, K. L., Cosco, T. D., Inkster, B., Myers, A., Saunders, C. H., & Venegas, M. D. R. A. (2020) · doi:10.2196/preprints.20124
Heinze, J. (2022) · Logos Verlag Berlin eBooks · doi:10.30819/5553
Evans, J. H. (2024) · doi:10.1093/oso/9780197750704.002.0006
Evans, J. H. (2024) · doi:10.1093/oso/9780197750704.003.0006
Evans, J. H. (2024) · doi:10.1093/oso/9780197750704.005.0001
The Public’s View of Human-Brain Organoids and Neuro-Chimeric Animals
Evans, J. H., III (2024) · doi:10.1093/oso/9780197750704.003.0003
What We Know about the Public’s Views of Humans
Evans, J. H. (2024) · doi:10.1093/oso/9780197750704.003.0002
Evans, J. H. (2024) · doi:10.1093/oso/9780197750704.002.0003
van Erp, R. A. L., de Rooij, S. E., Wymenga, A. N. M., Zeegers, A. V. C. M., & van der Palen, J. A. M. (2024) · Gerontology and Geriatric Medicine · doi:10.1177/23337214241230159
Camfield, L. (2023) · Springer eBooks · doi:10.1007/978-3-031-17299-1_1067
Exploring Followership Resilience in the Hospitality Industry
Kotsev, E. N. (2024) · Advances in hospitality, tourism and the services industry (AHTSI) book series · doi:10.4018/979-8-3693-3390-7.ch009
Followership role orientations in clothing factories: a lower-level managers’ perspective
Kotsev, E. N. (2024) · Research Journal of Textile and Apparel · doi:10.1108/rjta-02-2024-0030
Koirala, Y., Doherty, K., Eccleston, C. E. A., & Vickers, J. C. (2025) · Dementia · doi:10.1177/14713012251315329
L’entrevue cognitive : les apports et les limites dans la validation d’un questionnaire
Dulude, É., Fleuret, C., Bodar, L., Bastien, M.-P., & Ayotte, M.-H. (2024) · Mesure et évaluation en éducation · doi:10.7202/1118271ar
Spark, L. C., Schlage, K., Callander, E. J., Leefhelm, E., Hobday, M. B., Wakgari, N., & Bradfield, Z. (2025) · medRxiv · doi:10.1101/2025.06.18.25329896
Grove, B. E., Schougaard, L. M. V., Ivarsen, P., Kyte, D. G., Hjøllund, N. H., & de Thurah, A. (2021) · Figshare · doi:10.6084/m9.figshare.16822552
Grove, B. E., Schougaard, L. M. V., Ivarsen, P., Kyte, D. G., Hjøllund, N. H., & de Thurah, A. (2021) · Figshare · doi:10.6084/m9.figshare.16822561
Grove, B. E., Schougaard, L. M. V., Ivarsen, P., Kyte, D. G., Hjøllund, N. H., & de Thurah, A. (2021) · Figshare · doi:10.6084/m9.figshare.16822555
Grove, B. E., Schougaard, L. M. V., Ivarsen, P., Kyte, D. G., Hjøllund, N. H., & de Thurah, A. (2021) · Figshare · doi:10.6084/m9.figshare.16822549
Grove, B. E., Schougaard, L. M. V., Ivarsen, P., Kyte, D. G., Hjøllund, N. H., & de Thurah, A. (2021) · Figshare · doi:10.6084/m9.figshare.16822558
Grove, B. E., Schougaard, L. M. V., Ivarsen, P., Kyte, D. G., Hjøllund, N. H., & de Thurah, A. (2021) · Figshare · doi:10.6084/m9.figshare.16822564
Grove, B. E., Schougaard, L. M. V., Ivarsen, P., Kyte, D. G., Hjøllund, N. H., & de Thurah, A. (2021) · Figshare · doi:10.6084/m9.figshare.16822546
Nakahara, R., Tanaka, Y., Kojima, K., Miyashita, H., Sato, H., Asai, N., Yamashita, T., Bourne, Y., Kobayashi, M., Shackleton, C., et al. (2026) · Spinal Cord · doi:10.1038/s41393-026-01173-6
Mothers’ Emotion Regulation in Response to Guilt: A Qualitative Investigation
Prikhidko, A., Long, H., Rudyk, D., & Pathirana, M. (2026) · The Family Journal · doi:10.1177/10664807261440827
Nijs, T., Stark, T., & Boda, Z. (2026) · Social Networks · doi:10.1016/j.socnet.2026.06.005
Omuya, H., AlMahasis, S. O., Salihu, E. Y., Welch, L. L., Raňola, T. S., Manning, J., Mai, S., & Chewning, B. A. (2026) · Journal of Patient-Reported Outcomes · doi:10.1186/s41687-026-01145-7
KI-gestütztes kognitives Pretesting zur Interviewvorbereitung
Kempny, C., Annaç, K., Yılmaz-Aslan, Y., & Brzoska, P. (2026) · Springer eBooks · doi:10.1007/978-3-662-73089-8_7
ter Stege, M. H. P., Luong, K. P., Slijper, H. P., & Selles, R. W. (2026) · BMJ Open Quality · doi:10.1136/bmjoq-2026-004294
Processes Utilized by High School Students Reading Scientific Text
Clinger, A. F. (2014) · TigerPrints (Clemson University)
- Authors
- Priede, C., & Farrall, S.
- Affiliations
- University of Sheffield (GB)
- Corresponding author
- Priede, Camilla
- ORCID
- Farrall, Stephen
- Venue
- International Journal of Social Research Methodology
- Publisher
- Informa UK Limited
- Published
- 2011-07
- Volume
- 14
- Issue
- 4
- Pages
- 271-287
- ISSN
- 1364-5579 (ISSN-L)
- 1464-5300
- OpenAlex
- W2067474269
- Cited by
- 88
- References
- 22
- Citations by year
- 2026: 7 · 2025: 7 · 2024: 19 · 2023: 5 · 2022: 13 · 2021: 16 · 2020: 4 · 2019: 4 · 2018: 1 · 2017: 2 · 2016: 3 · 2015: 2 · 2014: 2 · 2013: 2
- FWCI
- 3.11
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Social Research Methodology (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Social Sciences › Sociology and Political Science › Focus Groups and Qualitative Methods
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- cognitive interviewing, think-aloud, questionnaire design, closed-ended questions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review