Completion rates and non-response error in online surveys: Comparing sweepstakes and pre-paid cash incentives in studies of online behavior
The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
This study aims to compare the effects of incentives and contact modes on survey completion rates, and examine how non-response rates might affect the quality of responses in online surveys. Two online surveys with different incentives and contact modes were conducted. In study 1, both pre-paid cash incentives and a sweepstakes offering of equal monetary value were more effective than no incentive but the pre-paid incentive were more effective than the sweepstakes. In study 2, respondents who received a pre-paid cash incentive via postal mail after initially failing to respond to an emailed sweepstakes offer differed from the initial respondents with respect to demographic and psychological characteristics previously found to be important in a widely cited study of social networking. Therefore, non-response error may indeed be a problem in online surveys, at least among those directed to college students and using a common method of recruitment in which offers of sweepstakes drawings are delivered via email. Not only do the levels of variables important to an understanding of online communication vary by survey method, but also the lawful relationships among variables differ between groups recruited by different methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
High self-control predicts good adjustment, less pathology, better grades, and interpersonal success
Tangney, J. P., Baumeister, R. F., & Boone, A. L. (2004) · Journal of Personality · doi:10.1111/j.0022-3506.2004.00263.x · Cited by 6,557
The Revised UCLA Loneliness Scale: concurrent and discriminant validity evidence
Russell, D., Peplau, L. A., & Cutrona, C. E. (1980) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.39.3.472 · Cited by 5,173
Robins, R. W., Hendin, H. M., & Trzesniewski, K. H. (2001) · Personality and Social Psychology Bulletin · doi:10.1177/0146167201272002 · Cited by 3,041
Nonresponse rates and nonresponse bias in household surveys
Groves, R. M. (2006) · Public Opinion Quarterly · doi:10.1093/poq/nfl033 · Cited by 2,420 · cited 2×
“Depression was adopted from Mirowsky and Ross (1992). Nine questions were asked on 4-point Likert-type scales with 0 (Rarely or none of the time (less than 1 day)) to 3 (All of the time (5–7 days).”
BackgroundMethodAcademic self-efficacy and first year college student performance and adjustment.
Chemers, M. M., Hu, L.-T., & Garcia, B. F. (2001) · Journal of Educational Psychology · doi:10.1037/0022-0663.93.1.55 · Cited by 2,031
Development and validation of a scale for measuring state self-esteem.
Heatherton, T. F., & Polivy, J. (1991) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.60.6.895 · Cited by 2,007
Hurtado, S., & Carter, D. F. (1997) · Sociology of Education · doi:10.2307/2673270 · Cited by 1,938
Social capital, self-esteem, and use of online social network sites: A longitudinal analysis.
Steinfield, C., Ellison, N. B., & Lampe, C. (2008) · Journal of Applied Developmental Psychology · doi:10.1016/j.appdev.2008.07.002 · Cited by 1,919
A Comparison of Web and Mail Survey Response Rates
Kaplowitz, M. D., Hadlock, T. D., & Levine, R. (2004) · Public Opinion Quarterly · doi:10.1093/poq/nfh006 · Cited by 1,661
Connection strategies: Social capital implications of Facebook-enabled communication practices
Ellison, N. B., Steinfield, C., & Lampe, C. (2011) · New Media & Society · doi:10.1177/1461444810385389 · Cited by 1,349
Assessing Response Rates and Nonresponse Bias in Web and Paper Surveys
Sax, L. J., Gilmartin, S. K., & Bryant, A. N. (2003) · Research in Higher Education · doi:10.1023/a:1024232915870 · Cited by 1,294
Reliability and Validity of a Brief Measure of Sensation Seeking
Hoyle, R. H., Stephenson, M. T., Palmgreen, P., Lorch, E. P., & Donohew, R. L. (2002) · Personality and Individual Differences · doi:10.1016/s0191-8869(01)00032-0 · Cited by 1,263
Comparing Response Rates from Web and Mail Surveys: A Meta-Analysis
Shih, T.-H., & Fan, X. (2008) · Field Methods · doi:10.1177/1525822x08317085 · Cited by 1,159 · cited 1×
“…yielded lower completion rates than conventional survey methods, especially when compared to surveys administered through postal mail (Börkan, 2010; Jones & Pitt, 1999; Manfreda, Bosniak, Berzelak, Haas, & Vehovar, 2008; Matz, 1999; Mertler, 2003; Sax, Gilmartin, & Bryant, 2003; Shih & Fan, 2008).”
Estimating the Effect of Incentives on Mail Survey Response Rates: A Meta-Analysis
Church, A. H. (1993) · Public Opinion Quarterly · doi:10.1086/269355 · Cited by 705 · cited 2×
“The nature of the incentives offered to potential survey respondents is a wellstudied and recognized important factor in improving completion rates (Church, 1993; Dillman et al., 2009; Ryu et al., 2005).”
BackgroundThe social costs of emotional suppression: a prospective study of the transition to college
Srivastava, S., Tamir, M., McGonigal, K. M., John, O. P., & Gross, J. J. (2009) · Journal of Personality and Social Psychology · doi:10.1037/a0014755 · Cited by 504
Effects of Internet use and social resources on changes in depression
Bessière, K., Kiesler, S., Kraut, R., & Boneva, B. S. (2008) · Information, Communication & Society · doi:10.1080/13691180701858851 · Cited by 316
Cited by
The value of online surveys: a look back and a look ahead
Evans, J. R., & Mathur, A. (2018) · Internet Research · doi:10.1108/intr-03-2018-0089 · Cited by 545
Loneliness and the Big Five Personality Traits: A Meta–Analysis
Buecker, S., Maes, M., Denissen, J. J. A., & Luhmann, M. (2020) · European Journal of Personality · doi:10.1002/per.2229 · Cited by 361
Strategies to improve response rates to web surveys: A literature review
Sammut, R., Griscti, O., & Norman, I. J. (2021) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2021.104058 · Cited by 343
Valenzuela, S., Halpern, D., Katz, J. E., & Miranda, J. P. (2019) · Digital Journalism · doi:10.1080/21670811.2019.1623701 · Cited by 307
Maes, M., Nelemans, S. A., Danneel, S., Fernández-Castilla, B., Van den Noortgate, W., Goossens, L., & Vanhalst, J. (2019) · Developmental Psychology · doi:10.1037/dev0000719 · Cited by 207
Metadata
- Authors
- LaRose, R., & Tsai, H.-Y. S.
- Venue
- Computers in Human Behavior
- Publisher
- Elsevier BV
- Published
- 2014-05
- Volume
- 34
- Pages
- 110-119
- ISSN
- 0747-5632 (ISSN-L)
- OpenAlex
- W2038753120
- Cited by
- 104
- References
- 16
- FWCI
- 11.89
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.