The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
An Evaluation of a Cognitive Theory of Response-Order Effects in Survey Measurement
Abstract
Previous research has documented effects of the order in which response choices are offered to respondents using closed-ended survey items, but no theory of the psychological sources of these effects has yet been proposed. This paper offers such a theory drawn from a variety of psychological research. Using data from a split-ballot experiment in the 1984 General Social Survey involving a variant of Kohn's parental values measure, we test some predictions made by the theory about what kind of response order effect would be expected (a primacy effect) and among which respondents it should be strongest (those low in cognitive sophistication). These predictions are confirmed. We also test the “form-resistant correlation” hypothesis. Although correlations between items are altered by changes m response order, the presence and nature of the latent value dimension underlying these responses is essentially unaffected.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Significance tests and goodness of fit in the analysis of covariance structures.
Bentler, P. M., & Bonett, D. G. (1980) · Psychological Bulletin · doi:10.1037//0033-2909.88.3.588 · Cited by 19,023
The Framing of Decisions and the Psychology of Choice
Tversky, A., & Kahneman, D. (1981) · Science · doi:10.1126/science.7455683 · Cited by 18,497
(1973) · DigitalGeorgetown (Georgetown University Library) · Cited by 10,144
Human Inference: Strategies and Shortcomings of Social Judgment.
Cherniak, C., Nisbett, R., & Ross, L. (1983) · The Philosophical Review · doi:10.2307/2184495 · Cited by 4,196
Shackle, G. L. S., & Simon, H. A. (1959) · The Economic Journal · doi:10.2307/2228083 · Cited by 3,558
Confirmation, disconfirmation, and information in hypothesis testing
Klayman, J., & Ha, Y.-W. (1987) · Psychological Review · doi:10.1037/0033-295x.94.2.211 · Cited by 2,094
FORMING IMPRESSIONS OF PERSONALITY
Asch, S. E. (1961) · Documents of Gestalt Psychology · doi:10.1525/9780520313514-018 · Cited by 2,081
Psychology of Reasoning: Structure and Content
Wason, P. C., & Johnson-Laird, P. N. (1972) · Medical Entomology and Zoology · Cited by 1,784
Koriat, A., Lichtenstein, S., & Fischhoff, B. (1980) · Journal of Experimental Psychology: Human Learning and Memory · doi:10.1037/0278-7393.6.2.107 · Cited by 1,477
The Psychology of Social Norms.
Hankins, F. H., & Sherif, M. (1937) · American Sociological Review · doi:10.2307/2084385 · Cited by 1,462
Cited by
Common Method Bias in Marketing: Causes, Mechanisms, and Procedural Remedies
MacKenzie, S. B., & Podsakoff, P. M. (2012) · Journal of Retailing · doi:10.1016/j.jretai.2012.08.001 · Cited by 3,051
Response strategies for coping with the cognitive demands of attitude measures in surveys
Krosnick, J. A. (1991) · Applied Cognitive Psychology · doi:10.1002/acp.2350050305 · Cited by 2,460
Self-citationMode of questionnaire administration can have serious effects on data quality
Bowling, A. (2005) · Journal of Public Health · doi:10.1093/pubmed/fdi031 · Cited by 1,871
Krosnick, J. A. (1999) · Annual Review of Psychology · doi:10.1146/annurev.psych.50.1.537 · Cited by 1,852
Self-citationPretesting survey instruments: An overview of cognitive methods
Collins, D. (2003) · Quality of Life Research · doi:10.1023/a:1023254226592 · Cited by 1,506
The Design and Administration of Mail Surveys
Dillman, D. A. (1991) · Annual Review of Sociology · doi:10.1146/annurev.so.17.080191.001301 · Cited by 1,311
Tourangeau, R., & Smith, T. W. (1996) · Public Opinion Quarterly · doi:10.1086/297751 · Cited by 1,295
Dillman, D. A., Phelps, G., Tortora, R., Swift, K., Kohrell, J., Berck, J., & Messer, B. L. (2009) · Social Science Research · doi:10.1016/j.ssresearch.2008.03.007 · Cited by 850
Asking questions about behavior: cognition, communication, and questionnaire construction
Schwarz, N. (2001) · The American Journal of Evaluation · doi:10.1016/s1098-2140(01)00133-3 · Cited by 719
Research synthesis: AAPOR report on online panels
Prepared for the AAPOR Executive Council by a Task Force operating under the auspices of the AAPOR Standards Committee, W. M. I., Baker, R., Blumberg, S. J., Brick, J. M., Couper, M. P., Courtright, M., Dennis, J. M., Dillman, D., Frankel, M. R., Garland, P., et al. (2010) · Public Opinion Quarterly · doi:10.1093/poq/nfq048 · Cited by 584
Self-citationThe Mental Health Literacy Scale (MHLS): A New Scale-Based Measure of Mental Health Literacy
O’Connor, M., & Casey, L. (2015) · Psychiatry Research · doi:10.1016/j.psychres.2015.05.064 · Cited by 605
The search engine manipulation effect (SEME) and its possible impact on the outcomes of elections
Epstein, R., & Robertson, R. E. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1419828112 · Cited by 577
Bobo, L., & Licari, F. C. (1989) · Public Opinion Quarterly · doi:10.1086/269154 · Cited by 567
Hippler, H.-J., & Schwarz, N. (1987) · Recent Research in Psychology · doi:10.1007/978-1-4612-4798-2_6 · Cited by 514
Govindji, R., & Linley, P. A. (2007) · International Coaching Psychology Review · doi:10.53841/bpsicpr.2007.2.2.143 · Cited by 501
Designing Effective Web Surveys
Couper, M. P. (2008) · Cambridge University Press eBooks · doi:10.1017/cbo9780511499371 · Cited by 463
Total Survey Error: Design, Implementation, and Evaluation
Biemer, P. P. (2010) · Public Opinion Quarterly · doi:10.1093/poq/nfq058 · Cited by 450
Parents' Perceptions of Their Child's Weight and Health
Eckstein, K. C., Mikhail, L. M., Ariza, A. J., Thomson, J. S., Millard, S. C., Binns, H. J., & for the Pediatric Practice Research Group (2006) · Pediatrics · doi:10.1542/peds.2005-0910 · Cited by 425
Designing and Conducting Health Surveys
Aday, L. A. (1998) · Journal For Healthcare Quality · doi:10.1097/01445442-199805000-00015 · Cited by 391
Holbrook, A. L., Krosnick, J. A., & Pfent, A. (2007) · Advances in Telephone Survey Methodology · doi:10.1002/9780470173404.ch23 · Cited by 380
Self-citationInterviewer effects in public health surveys
Davis, R. E., Couper, M. P., Janz, N. K., Caldwell, C. H., & Resnicow, K. (2010) · Health Education Research · doi:10.1093/her/cyp046 · Cited by 348
Collective Preferences in Democratic Politics: Opinion Surveys and the Will of the People
Althaus, S. L. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9780511610042 · Cited by 338
Completion Time and Response Order Effects in Web Surveys
Malhotra, N. (2008) · Public Opinion Quarterly · doi:10.1093/poq/nfn050 · Cited by 332
Interview mode and measurement of sexual behaviors: Methodological issues
Gribble, J. N., Miller, H. G., Rogers, S. M., & Turner, C. F. (1999) · Journal of Sex Research · doi:10.1080/00224499909551963 · Cited by 319
Jehn, K. A., & Bezrukova, K. (2010) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2009.11.008 · Cited by 316
Understanding and Improving the Validity of Self-Report of Parenting
Morsbach, S. K., & Prinz, R. J. (2006) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-006-0001-5 · Cited by 302
Money, Time, and Political Knowledge: Distinguishing Quick Recall and Political Learning Skills
Prior, M., & Lupia, A. (2008) · American Journal of Political Science · doi:10.1111/j.1540-5907.2007.00306.x · Cited by 291
The use of verbal report methods in the development and testing of survey questionnaires
Willis, G. B., Royston, P., & Bercini, D. (1991) · Applied Cognitive Psychology · doi:10.1002/acp.2350050307 · Cited by 290
The impact of administration mode on response effects in survey measurement
Schwarz, N., Strack, F., Hippler, H., & Bishop, G. (1991) · Applied Cognitive Psychology · doi:10.1002/acp.2350050304 · Cited by 278
Collective preferences in democratic politics: opinion surveys and the will of the people
(2004) · Choice Reviews Online · doi:10.5860/choice.42-1221 · Cited by 274
Check-all-that-apply questions: Influence of attribute order on sensory product characterization
Ares, G., & Jaeger, S. R. (2013) · Food Quality and Preference · doi:10.1016/j.foodqual.2012.08.016 · Cited by 267
Comparing Check-All and Forced-Choice Question Formats in Web Surveys
Smyth, J. D. (2006) · Public Opinion Quarterly · doi:10.1093/poq/nfj007 · Cited by 265
Borgers, N., Sikkel, D., & Hox, J. (2004) · Quality and Quantity · doi:10.1023/b:ququ.0000013236.29205.a6 · Cited by 264
Designing and testing questionnaires for children
Bell, A. (2007) · Journal of Research in Nursing · doi:10.1177/1744987107079616 · Cited by 260
Innovations in Experimental Design in Attitude Surveys
Sniderman, P. M., & Grob, D. B. (1996) · Annual Review of Sociology · doi:10.1146/annurev.soc.22.1.377 · Cited by 260
Barthorpe, A., Winstone, L., Mars, B., & Moran, P. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.05.106 · Cited by 158
Cognition and survey measurement: History and overview
Jobe, J. B., & Mingay, D. J. (1991) · Applied Cognitive Psychology · doi:10.1002/acp.2350050303 · Cited by 127
Sidedness, commercial intent and expertise in blog advertising
Uribe, R., Buzeta, C., & Velásquez, M. (2016) · Journal of Business Research · doi:10.1016/j.jbusres.2016.04.102 · Cited by 109
Mode Effects in a Survey of Medicare Prostate Surgery Patients
Fowler, Jr., Roman, A. M., & Di, Z. X. (1998) · Public Opinion Quarterly · doi:10.1086/297829 · Cited by 70
“I Can’t Reply with That”: Characterizing Problematic Email Reply Suggestions
Robertson, R. E., Olteanu, A., Diaz, F., Shokouhi, M., & Bailey, P. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445557 · Cited by 43
A psychometric framework for evaluating and shaping personality traits in large language models
Serapio-García, G., Safdari, M., Crepy, C., Sun, L., Fitz, S., Romero, P., Abdulhai, M., Faust, A., & Matarić, M. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-025-01115-6 · Cited by 30
Metadata
- Authors
- Krosnick, J. A., & Alwin, D. F.
- Venue
- Public Opinion Quarterly
- Publisher
- Oxford University Press (OUP)
- Published
- 1987
- Volume
- 51
- Issue
- 2
- Pages
- 201
- ISSN
- 0033-362X (ISSN-L)
- OpenAlex
- W2112665044
- Cited by
- 825
- References
- 47
- FWCI
- 22.71
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.