The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
The use of verbal report methods in the development and testing of survey questionnaires
Abstract
Increasingly, verbal report techniques are being used in the development and testing of survey questions. The present investigation examined the cognitive processes involved in responding to health survey questionnaires by conducting laboratory interviews which collected verbal reports. Analysis of these reports identified problems with questions that relate to the compre‐hension, recall, and decision processes the subjects used to answer those questions. This paper describes how questionnaire problems have been detected in the laboratory, and how these have been classified according to a cognitive model. We conclude that the laboratory verbal‐report techniques appear to be useful in detecting a variety of questionnaire flaws that are related to the operation of cognitive processes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Telling more than we can know: Verbal reports on mental processes.
Nisbett, R. E., & Wilson, T. D. (1977) · Psychological Review · doi:10.1037/0033-295x.84.3.231 · Cited by 11,317
Ericsson (1993) · doi:10.1037/0033-295x.87.3.215 · Cited by 4,539
Cognitive processes underlying context effects in attitude measurement.
Tourangeau, R., & Rasinski, K. A. (1988) · Psychological Bulletin · doi:10.1037//0033-2909.103.3.299 · Cited by 969
An Evaluation of a Cognitive Theory of Response-Order Effects in Survey Measurement
Krosnick, J. A., & Alwin, D. F. (1987) · Public Opinion Quarterly · doi:10.1086/269029 · Cited by 825
Cognitive Aspects of Survey Methodology: Building a Bridge Between Disciplines.
Schaible, W. L., Jabine, T. B., Straf, M. L., Tanur, J. M., & Tourangeau, R. (1987) · Journal of the American Statistical Association · doi:10.2307/2289187 · Cited by 618
Research on Interviewing Techniques
Cannell, C. F., Miller, P. V., & Oksenberg, L. (1981) · Sociological Methodology · doi:10.2307/270748 · Cited by 436
Cognitive Processes Used by Survey Respondents to Answer Behavioral Frequency Questions
Blair, E., & Burton, S. (1987) · Journal of Consumer Research · doi:10.1086/209112 · Cited by 335
The Design and Understanding of Survey Questions.
Morton-Williams, J., & Belson, W. A. (1984) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2981742 · Cited by 247
The Design and Understanding of Survey Questions
Cox, E. P., & Belson, W. A. (1982) · Journal of Marketing Research · doi:10.2307/3151631 · Cited by 121
Cognitive laboratory approach to designing questionnaires for surveys of the elderly.
Jobe, J. B., & Mingay, D. J. (1990) · Europe PMC (PubMed Central) · Cited by 106
Recall Strategies and Memory for Health-Care Visits
Jobe, J. B., White, A. A., Kelley, C. L., Mingay, D. J., Sanchez, M. J., & Loftus, E. F. (1990) · Milbank Quarterly · doi:10.2307/3350095 · Cited by 88
Cognitive psychology meets the national survey.
Loftus, E. F., Fienberg, S. E., & Tanur, J. M. (1985) · American Psychologist · doi:10.1037/0003-066x.40.2.175 · Cited by 58
Lessler, J. T., & Sirken, M. G. (1985) · The Milbank Memorial Fund Quarterly Health and Society · doi:10.2307/3349848 · Cited by 40
QUESTIONNAIRE DESIGN RESEARCH LABORATORY
Royston, P., Bercini, D., Sirken, M. G., & Mingay, D. J. (1985) · Cited by 19
Self-citation
Cited by
Research synthesis: the practice of cognitive interviewing
Beatty, P. C., & Willis, G. B. (2007) · Public Opinion Quarterly · doi:10.1093/poq/nfm006 · Cited by 1,615
Self-citationGrammar and Social Organization: Yes/No Interrogatives and the Structure of Responding
Raymond, G. (2003) · American Sociological Review · doi:10.1177/000312240306800607 · Cited by 1,167
Asking questions about behavior: cognition, communication, and questionnaire construction
Schwarz, N. (2001) · The American Journal of Evaluation · doi:10.1016/s1098-2140(01)00133-3 · Cited by 719
The Science of Asking Questions
Schaeffer, N. C., & Presser, S. (2003) · Annual Review of Sociology · doi:10.1146/annurev.soc.29.110702.110112 · Cited by 621
Warren, J. M., Ekelund, U., Besson, H., Mezzani, A., Geladas, N., & Vanhees, L. (2010) · European Journal of Cardiovascular Prevention & Rehabilitation · doi:10.1097/hjr.0b013e32832ed875 · Cited by 587
Metadata
- Authors
- Willis, G. B., Royston, P., & Bercini, D.
- Venue
- Applied Cognitive Psychology
- Publisher
- Wiley
- Published
- 1991-05
- Volume
- 5
- Issue
- 3
- Pages
- 251-267
- ISSN
- 0888-4080 (ISSN-L)
- 1099-0720
- OpenAlex
- W1967727461
- Cited by
- 290
- References
- 14
- FWCI
- 11.13
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.