The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Completion Time and Response Order Effects in Web Surveys
Open accessAbstract
The use of the World Wide Web to conduct surveys has grown rapidly over the past decade, raising concerns regarding data quality, questionnaire design, and sample representativeness. This research note focuses on an issue that has not yet been studied: Are respondents who complete self-administered Web surveys more quickly—perhaps taking advantage of participation benefits while minimizing effort—also more prone to response order effects, a manifestation of “satisficing”? I surveyed a random sample of the US adult population over the Web and manipulated the order in which respondents saw the response options. I then assessed whether primacy effects were moderated by the overall length of time respondents took to complete the questionnaires. I found that low-education respondents who filled out the questionnaire most quickly were most prone to primacy effects when completing items with unipolar rating scales. These results have important implications for various aspects of Web survey methodology including panel management, human–computer interaction, and response order randomization.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Response strategies for coping with the cognitive demands of attitude measures in surveys
Krosnick, J. A. (1991) · Applied Cognitive Psychology · doi:10.1002/acp.2350050305 · Cited by 2,460
Couper, M. P. (2000) · Public Opinion Quarterly · doi:10.1086/318641 · Cited by 2,078
Thinking About Answers: The Application of Cognitive Processes to Survey Methodology
Sudman, S., Bradburn, N. M., & Schwarz, N. (1995) · Cited by 1,586
Van Selm, M., & Jankowski, N. W. (2006) · Quality and Quantity · doi:10.1007/s11135-005-8081-8 · Cited by 905
An Evaluation of a Cognitive Theory of Response-Order Effects in Survey Measurement
Krosnick, J. A., & Alwin, D. F. (1987) · Public Opinion Quarterly · doi:10.1086/269029 · Cited by 825
Thinking about Answers: The Application of Cognitive Process to Survey Methodology
Aalbaum, G., Sudman, S., Bradburn, N. M., & Schwarz, N. (1996) · Journal of Marketing Research · doi:10.2307/3152133 · Cited by 783
Web Survey Design and Administration
COUPER, M. P., TRAUGOTT, M. W., & LAMIAS, M. J. (2001) · Public Opinion Quarterly · doi:10.1086/322199 · Cited by 776
Web Surveys: Perceptions of Burden
Crawford, S. D., Couper, M. P., & Lamias, M. J. (2001) · Social Science Computer Review · doi:10.1177/089443930101900202 · Cited by 571
Spacing, Position, and Order: Interpretive Heuristics for Visual Features of Survey Questions
Tourangeau, R. (2004) · Public Opinion Quarterly · doi:10.1093/poq/nfh035 · Cited by 400
Satisficing in surveys: Initial evidence
Krosnick, J. A., Narayan, S., & Smith, W. R. (1996) · New Directions for Evaluation · doi:10.1002/ev.1033 · Cited by 354
Cited by
Douglas, B. D., Ewell, P. J., & Brauer, M. (2023) · PLOS ONE · doi:10.1371/journal.pone.0279720 · Cited by 1,532
Berinsky, A. J., Margolis, M. F., & Sances, M. W. (2014) · American Journal of Political Science · doi:10.1111/ajps.12081 · Cited by 951
Data Collection in the Digital Age: Innovative Alternatives to Student Samples1
Steelman, Z. R., Hammer, B. I., & Limayem, M. (2014) · MIS Quarterly · doi:10.25300/misq/2014/38.2.02 · Cited by 405
Van Mol, C. (2017) · International Journal of Social Research Methodology · doi:10.1080/13645579.2016.1185255 · Cited by 293
Check-all-that-apply questions: Influence of attribute order on sensory product characterization
Ares, G., & Jaeger, S. R. (2013) · Food Quality and Preference · doi:10.1016/j.foodqual.2012.08.016 · Cited by 267
Metadata
- Authors
- Malhotra, N.
- Venue
- Public Opinion Quarterly
- Publisher
- Oxford University Press (OUP)
- Published
- 2008-12-01
- Volume
- 72
- Issue
- 5
- Pages
- 914-934
- ISSN
- 0033-362X (ISSN-L)
- 1537-5331
- OpenAlex
- W2134231299
- Cited by
- 332
- References
- 28
- FWCI
- 24.39
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Completion Time and Response Order Effects in Web Surveys. https://app.cochat.ai/papers/10.1093/poq/nfn050
- The paper
- Malhotra, N. (2008). Completion Time and Response Order Effects in Web Surveys. Public Opinion Quarterly. https://doi.org/10.1093/poq/nfn050
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.