Participant Dropout as a Function of Survey Length in Internet-Mediated University Studies: Implications for Study Design and Voluntary Participation in Psychological Research
Open accessThe DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
Internet-mediated research has offered substantial advantages over traditional laboratory-based research in terms of efficiently and affordably allowing for the recruitment of large samples of participants for psychology studies. Core technical, ethical, and methodological issues have been addressed in recent years, but the important issue of participant dropout has received surprisingly little attention. Specifically, web-based psychology studies often involve undergraduates completing lengthy and time-consuming batteries of online personality questionnaires, but no known published studies to date have closely examined the natural course of participant dropout during attempted completion of these studies. The present investigation examined participant dropout among 1,963 undergraduates completing one of six web-based survey studies relatively representative of those conducted in university settings. Results indicated that 10% of participants could be expected to drop out of these studies nearly instantaneously, with an additional 2% dropping out per 100 survey items included in the study. For individual project investigators, these findings hold ramifications for study design considerations, such as conducting a priori power analyses. The present results also have broader ethical implications for understanding and improving voluntary participation in research involving human subjects. Nonetheless, the generalizability of these conclusions may be limited to studies involving similar design or survey content.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gosling, S. D., Vazire, S., Srivastava, S., & John, O. P. (2004) · American Psychologist · doi:10.1037/0003-066x.59.2.93 · Cited by 2,932 · cited 2×
“14–17 For example, in a multinational study of 361,703 participants, Gosling et al. 15 found that the results of web-based studies were fundamentally similar to those obtained from traditional paperand-pencil measures, with participant response sets having minimal impact.”
ResultHarvesting implicit group attitudes and beliefs from a demonstration web site.
Nosek, B. A., Banaji, M. R., & Greenwald, A. G. (2002) · Group Dynamics: Theory, Research, and Practice · doi:10.1037/1089-2699.6.1.101 · Cited by 1,321
Development of personality in early and middle adulthood: Set like plaster or persistent change?
Srivastava, S., John, O. P., Gosling, S. D., & Potter, J. (2003) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.84.5.1041 · Cited by 1,204
Kraut, R., Olson, J., Banaji, M., Bruckman, A., Cohen, J., & Couper, M. (2004) · American Psychologist · doi:10.1037/0003-066x.59.2.105 · Cited by 924
E‐Research: Ethics, Security, Design, and Control in Psychological Research on the Internet
Nosek, B. A., Banaji, M. R., & Greenwald, A. G. (2002) · Journal of Social Issues · doi:10.1111/1540-4560.00254 · Cited by 304
The Internet as Psychological Laboratory
Skitka, L. J., & Sargis, E. G. (2006) · Annual Review of Psychology · doi:10.1146/annurev.psych.57.102904.190048 · Cited by 293
Questionnaire Survey Nonresponse: A Comparison of Postal Mail and Internet Surveys
Hoonakker, P., & Carayon, P. (2009) · International Journal of Human–Computer Interaction · doi:10.1080/10447310902864951 · Cited by 173
Van Horn, P. S., Green, K. E., & Martinussen, M. (2009) · Educational and Psychological Measurement · doi:10.1177/0013164408324462 · Cited by 155
De Beuckelaer, A., & Lievens, F. (2009) · Applied Psychology · doi:10.1111/j.1464-0597.2008.00350.x · Cited by 149
When does haste make waste? Speed-accuracy tradeoff, skill level, and the tools of the trade.
Beilock, S. L., Bertenthal, B. I., Hoerger, M. P., & Carr, T. H. (2008) · Journal of Experimental Psychology Applied · doi:10.1037/a0012859 · Cited by 112
Self-citationIntroduction to Behavioral Research on the Internet
Birnbaum, M. H. (2000) · Medical Entomology and Zoology · Cited by 108
Immune neglect in affective forecasting
Hoerger, M. P., Quirk, S. W., Lucas, R. E., & Carr, T. H. (2008) · Journal of Research in Personality · doi:10.1016/j.jrp.2008.10.001 · Cited by 76
Self-citationFernandez, M. I., Varga, L. M., Perrino, T., Collazo, J. B., Subiaul, F., Rehbein, A., Torres, H., Castro, M., & Bowen, G. S. (2004) · AIDS Care · doi:10.1080/09540120412331292480 · Cited by 68
Mann, T. L. (1994) · Psychological Science · doi:10.1111/j.1467-9280.1994.tb00650.x · Cited by 66
Measurement Issues Related to Data Collection on the World Wide Web
Strickland, O. L., Moloney, M. F., Dietrich, A. S., Myerburg, S., Cotsonis, G., & Johnson, R. V. (2003) · Advances in Nursing Science · doi:10.1097/00012272-200310000-00003 · Cited by 65
The Internet: A Virtually Untapped Tool for Research
Murray, D. M., & Fisher, J. D. (2002) · Journal of Technology in Human Services · doi:10.1300/j017v19n02_02 · Cited by 64
Cognitive determinants of affective forecasting errors
Hoerger, M., Quirk, S. W., Lucas, R. E., & Carr, T. H. (2010) · Judgment and Decision Making · doi:10.1017/s1930297500002163 · Cited by 58
Self-citationAffective forecasting and the Big Five
Hoerger, M., & Quirk, S. W. (2010) · Personality and Individual Differences · doi:10.1016/j.paid.2010.08.007 · Cited by 57
Self-citationHow to Conduct Behavioral Research over the Internet: A Beginner's Guide to HTML and CGI/Perl
Fraley, R. C. (2004) · Medical Entomology and Zoology · Cited by 45
Evaluation of the Stability and Validity of Participant Samples Recruited over the Internet
Lieberman, D. Z. (2008) · CyberPsychology & Behavior · doi:10.1089/cpb.2007.0254 · Cited by 44
Stress and Emotion Recognition: An Internet Experiment Using Stress Induction
Hänggi, Y. (2004) · Swiss Journal of Psychology · doi:10.1024/1421-0185.63.2.113 · Cited by 36
Evaluation of the ability of clinical research participants to comprehend informed consent form
Bhansali, S., Shafiq, N., Malhotra, S., et al. (2009) · Contemporary Clinical Trials · doi:10.1016/j.cct.2009.03.005 · Cited by 31
Monnot, M. J., Quirk, S. W., Hoerger, M. P., & Brewer, L. (2009) · Psychological Assessment · doi:10.1037/a0015316 · Cited by 31
Self-citationEffects of situational demand upon social enjoyment and preference in schizotypy.
Quirk, S. W., Subramanian, L., & Hoerger, M. P. (2007) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.116.3.624 · Cited by 19
Self-citationLieberman, M. A. (2007) · CyberPsychology & Behavior · doi:10.1089/cpb.2007.9956 · Cited by 12 · cited 1×
“Additionally, investigators have studied patient factors associated with dropout during the course of multiple-stage longitudinal treatment studies conducted using web-based interventions.(22,23) In addressing dropout concerns, these studies hold important implications for online intervention research.”
Predictors of Drop-Out in an Internet Study of Men Who Have Sex with Men
Jain, A., & Ross, M. W. (2008) · CyberPsychology & Behavior · doi:10.1089/cpb.2007.0038 · Cited by 10
Ethics and Single Subject Research
Janosky, J., Leininger, S. L., Hoerger, M., & Libkuman, T. (2009) · Springer eBooks · doi:10.1007/978-90-481-2444-2_5 · Cited by 8
Self-citationMethodological Framework for Single Subject Designs
Janosky, J. E., Leininger, S. L., Hoerger, M. P., & Libkuman, T. M. (2009) · Springer eBooks · doi:10.1007/978-90-481-2444-2_3 · Cited by 7
Self-citationWesemann, D., Grunwald, A., & Grunwald, M. (2009) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2009.0026 · Cited by 1
Cited by
Development of the Yale Food Addiction Scale Version 2.0
Gearhardt, A. N., Corbin, W. R., & Brownell, K. D. (2016) · Psychology of Addictive Behaviors · doi:10.1037/adb0000136 · Cited by 740
Atanga, C., Jones, B. A., Krueger, L. E., & Lu, S. (2020) · Journal of Special Education Technology · doi:10.1177/0162643419864858 · Cited by 160
Users of the main smartphone operating systems (iOS, Android) differ only little in personality
Götz, F. M., Stieger, S., & Reips, U.-D. (2017) · PLOS ONE · doi:10.1371/journal.pone.0176921 · Cited by 127
Kurz und knapp – die Kurzskala des Fragebogens „Lernstrategien im Studium“ (LIST)
Klingsieck, K. B. (2018) · Zeitschrift für Pädagogische Psychologie · doi:10.1024/1010-0652/a000230 · Cited by 47
Metadata
- Authors
- Hoerger, M.
- Venue
- Cyberpsychology, Behavior, and Social Networking
- Publisher
- SAGE Publications
- Published
- 2010-12
- Volume
- 13
- Issue
- 6
- Pages
- 697-700
- ISSN
- 2152-2715 (ISSN-L)
- 2152-2723
- OpenAlex
- W1993814443
- Cited by
- 292
- References
- 29
- FWCI
- 15.65
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.