Exploring the Effects of Removing “Too Fast” Responses and Respondents from Web Surveys
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
This paper addresses speeding, that is, “too fast” responses, in web surveys. Relying on the response process model, we argue that very short response times indicate low data quality, stemming from a lack of attention on the part of respondents. To identify speeding, prior research employed case-wise procedures. Using data from nine online surveys, we demonstrate that response behavior of individual respondents varies considerably during a survey. Thus, we use case- and page-wise procedures to capture speeding behavior that taps different, although related, phenomena. Moreover, page-specific speeding measures capture aspects of data quality that traditional quality measures do not cover. Employing both page-specific and case-wise speeding measures, we examine whether removing speeders makes a difference in substantive findings. The evidence indicates that removing “too fast” responses does not alter marginal distributions, irrespective of which speeder-correction technique is employed. Moreover, explanatory models yield, by and large, negligible coefficient differences (on average about one standard error). Only in exceptional cases differences exceed two standard errors. Our findings suggest that speeding primarily adds some random noise to the data and attenuate correlations, if it makes a difference at all. The paper concludes by discussing implications and limitations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Psychology of Survey Response
Tourangeau, R., Rips, L. J., & Rasinski, K. (2000) · doi:10.1017/cbo9780511819322 · Cited by 4,734
Research synthesis: AAPOR report on online panels
Prepared for the AAPOR Executive Council by a Task Force operating under the auspices of the AAPOR Standards Committee, W. M. I., Baker, R., Blumberg, S. J., Brick, J. M., Couper, M. P., Courtright, M., Dennis, J. M., Dillman, D., Frankel, M. R., Garland, P., et al. (2010) · Public Opinion Quarterly · doi:10.1093/poq/nfq048 · Cited by 584
Cited by
The value of online surveys: a look back and a look ahead
Evans, J. R., & Mathur, A. (2018) · Internet Research · doi:10.1108/intr-03-2018-0089 · Cited by 545
Du, J., Kerkhof, P., & van Koningsbruggen, G. M. (2019) · Cyberpsychology, Behavior, and Social Networking · doi:10.1089/cyber.2018.0730 · Cited by 96
Unrealistic Optimism Regarding Artificial Intelligence Opportunities in Human Resource Management
Weber, P. (2023) · International Journal of Knowledge Management · doi:10.4018/ijkm.317217 · Cited by 31
“As research indicates, the speed of finishing a survey (whether too fast or too slow) can affect the results (Greszki et al., 2015; Tourangeau et al., 2000).”
BackgroundBrummel, L., & de Blok, L. (2024) · Public Management Review · doi:10.1080/14719037.2024.2337843 · Cited by 17
“In line with Greszki, Meyer, and Schoen (2015), we excluded participants that responded 40% faster to our questionnaire than the median time.”
Public Opinion and Cyberterrorism
Shandler, R., Kostyuk, N., & Oppenheimer, H. (2023) · Public Opinion Quarterly · doi:10.1093/poq/nfad006 · Cited by 14
“Following best practice, we refrain from removing “speeders” who complete the survey particularly fast, since their removal does not alter marginal distributions in a meaningful way, and such paticipants are representative of a segment of the larger population who only partially absorb data before reaching political d…”
Method
Metadata
- Authors
- Greszki, R., Meyer, M., & Schoen, H.
- Venue
- Public Opinion Quarterly
- Publisher
- Oxford University Press (OUP)
- Published
- 2015
- Volume
- 79
- Issue
- 2
- Pages
- 471-503
- ISSN
- 0033-362X (ISSN-L)
- 1537-5331
- OpenAlex
- W2042492008
- Cited by
- 222
- References
- 2
- FWCI
- 18.83
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Exploring the Effects of Removing “Too Fast” Responses and Respondents from Web Surveys. https://app.cochat.ai/papers/10.1093/poq/nfu058
- The paper
- Greszki, R., Meyer, M., & Schoen, H. (2015). Exploring the Effects of Removing “Too Fast” Responses and Respondents from Web Surveys. Public Opinion Quarterly. https://doi.org/10.1093/poq/nfu058
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.