The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Improving web survey efficiency: the impact of an extra reminder and reminder content on web survey response
Open accessAbstract
With the growing possibilities for conducting web surveys, researchers increasingly use such surveys to recruit student samples for research purposes in a wide array of social science disciplines. Simultaneously, higher education students are recurrently asked to complete course and teacher evaluations online and to participate in small-scale research projects of fellow students, potentially leading to survey fatigue among student populations across the globe. One of the most frequently reported effects of over-surveying is a decrease in overall response rates. This situation has significant impacts on the generalizability and external validity of findings based on web surveys. The collection of reliable data is, nevertheless, crucial for researchers as well as educational practitioners and administrators, and strategies should be developed for achieving acceptable response rates. This paper reports on a methodological experiment (N = 15,651) conducted at the University of Antwerp, Belgium, in which possible strategies to improve survey response are explored. I specifically focus on the impact of an extra reminder as well as specific reminder contents on response rates. The results reveal that extra reminders are effective for increasing response rates, but not for diversifying the sample.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Social Influence: Compliance and Conformity
Cialdini, R. B., & Goldstein, N. J. (2004) · Annual Review of Psychology · doi:10.1146/annurev.psych.55.090902.142015 · Cited by 6,077
Nonresponse rates and nonresponse bias in household surveys
Groves, R. M. (2006) · Public Opinion Quarterly · doi:10.1093/poq/nfl033 · Cited by 2,420
Couper, M. P. (2000) · Public Opinion Quarterly · doi:10.1086/318641 · Cited by 2,078
Factors affecting response rates of the web survey: A systematic review
Fan, W., & Yan, Z. (2010) · Computers in Human Behavior · doi:10.1016/j.chb.2009.10.015 · Cited by 1,521
E-mail Survey Response Rates: A Review
Sheehan, K. B. (2006) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.2001.tb00117.x · Cited by 1,441
Survey Errors and Survey Costs.
Faulkenberry, G. D., & Groves, R. M. (1990) · Journal of the American Statistical Association · doi:10.2307/2289634 · Cited by 1,438
The Impact of Nonresponse Rates on Nonresponse Bias: A Meta-Analysis
Groves, R. M., & Peytcheva, E. (2008) · Public Opinion Quarterly · doi:10.1093/poq/nfn011 · Cited by 1,434
Effects of Questionnaire Length on Participation and Indicators of Response Quality in a Web Survey
Galesic, M., & Bosnjak, M. (2009) · Public Opinion Quarterly · doi:10.1093/poq/nfp031 · Cited by 1,297
Assessing Response Rates and Nonresponse Bias in Web and Paper Surveys
Sax, L. J., Gilmartin, S. K., & Bryant, A. N. (2003) · Research in Higher Education · doi:10.1023/a:1024232915870 · Cited by 1,294
Survey Errors and Survey Costs
Groves, R. M. (1989) · Wiley Series in Probability and Statistics · doi:10.1002/0471725277 · Cited by 1,062
The Role of Topic Interest in Survey Participation Decisions
Groves, R. M., Presser, S., & Dipko, S. (2004) · Public Opinion Quarterly · doi:10.1093/poq/nfh002 · Cited by 680
The SAGE Handbook of Online Research Methods
Fielding, N., Lee, R., & Blank, G. (2008) · SAGE Publications Ltd eBooks · doi:10.4135/9780857020055 · Cited by 632
Web Surveys: Perceptions of Burden
Crawford, S. D., Couper, M. P., & Lamias, M. J. (2001) · Social Science Computer Review · doi:10.1177/089443930101900202 · Cited by 571
Web Survey Methods: Introduction
Couper, M. P., & Miller, P. V. (2008) · Public Opinion Quarterly · doi:10.1093/poq/nfn066 · Cited by 560
Multiple surveys of students and survey fatigue
Porter, S. R., Whitcomb, M. E., & Weitzer, W. H. (2004) · New Directions for Institutional Research · doi:10.1002/ir.101 · Cited by 533
Spacing, Position, and Order: Interpretive Heuristics for Visual Features of Survey Questions
Tourangeau, R. (2004) · Public Opinion Quarterly · doi:10.1093/poq/nfh035 · Cited by 400
Sampling methods for web and e-mail surveys
Fricker, R. D. (2008) · The SAGE Handbook of Online Research Methods · doi:10.4135/9780857020055.n11 · Cited by 383
Callegaro, M., Manfreda, K. L., & Vehovar, V. (2015) · SAGE Publications Ltd eBooks · doi:10.4135/9781529799651 · Cited by 380
Non-response in student surveys: The Role of Demographics, Engagement and Personality
Porter, S. R., & Whitcomb, M. E. (2005) · Research in Higher Education · doi:10.1007/s11162-004-1597-2 · Cited by 344
Completion Time and Response Order Effects in Web Surveys
Malhotra, N. (2008) · Public Opinion Quarterly · doi:10.1093/poq/nfn050 · Cited by 332
Noncoverage and nonresponse in an Internet survey
Couper, M. P., Kapteyn, A., Schonlau, M., & Winter, J. (2007) · Social Science Research · doi:10.1016/j.ssresearch.2005.10.002 · Cited by 292
The Impact of Contact Type on Web Survey Response Rates
Porter, S. R., & Whitcomb, M. E. (2003) · Public Opinion Quarterly · doi:10.1086/378964 · Cited by 287
Student Survey Response Rates across Institutions: Why Do they Vary?
Porter, S. R., & Umbach, P. D. (2006) · Research in Higher Education · doi:10.1007/s11162-005-8887-1 · Cited by 239
Experiments in Producing Nonresponse Bias
Groves, R. M., Couper, M. P., Presser, S., Singer, E., Tourangeau, R., Acosta, G. P., & Nelson, L. (2006) · Public Opinion Quarterly · doi:10.1093/poq/nfl036 · Cited by 220
Lee, J. J. (2010) · Journal of Research in International Education · doi:10.1177/1475240909356382 · Cited by 218
Adams, M. J. D., & Umbach, P. D. (2012) · Research in Higher Education · doi:10.1007/s11162-011-9240-5 · Cited by 211
Raising response rates: What works?
Porter, S. R. (2004) · New Directions for Institutional Research · doi:10.1002/ir.97 · Cited by 192
Peytchev, A. (2009) · Public Opinion Quarterly · doi:10.1093/poq/nfp014 · Cited by 192
Said, D., Kypri, K., & Bowman, J. (2013) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-012-0574-x · Cited by 170
Muñoz-Leiva, F., Sánchez-Fernández, J., Montoro-Ríos, F., & Ibáñez-Zapata, J. Á. (2010) · Quality & Quantity · doi:10.1007/s11135-009-9256-5 · Cited by 159
Calder, J. (1998) · Medical Education · doi:10.1046/j.1365-2923.1998.00227.x · Cited by 150
Mental health literacy in an educational elite – an online survey among university students
Lauber, C., Ajdacic‐Gross, V., Fritschi, N., Stulz, N., & Wulf Rössler, A. (2005) · BMC Public Health · doi:10.1186/1471-2458-5-44 · Cited by 120
Vehovar, V., & Manfreda, K. L. (2008) · SAGE Publications Ltd eBooks · doi:10.4135/9780857020055.n10 · Cited by 112
The impact of progress indicators on task completion
Conrad, F. G., Couper, M. P., Tourangeau, R., & Peytchev, A. (2010) · Interacting with Computers · doi:10.1016/j.intcom.2010.03.001 · Cited by 95
Designing Scalar Questions for Web Surveys
Christian, L. M., Parsons, N. L., & Dillman, D. A. (2009) · Sociological Methods & Research · doi:10.1177/0049124108330004 · Cited by 94
Graduate Students and the Library
Kayongo, J., & Helm, C. (2010) · Reference & User Services Quarterly · doi:10.5860/rusq.49n4.341 · Cited by 67
Sánchez‐Fernández, J., Muñoz‐Leiva, F., Montoro-Ríos, F. J., & Ibáñez‐Zapata, J. (2008) · Quality & Quantity · doi:10.1007/s11135-008-9197-4 · Cited by 62
Spitzmueller, C., Glenn, D. M., Barr, C. D., Rogelberg, S. G., & Daniel, P. (2006) · Journal of Organizational Behavior · doi:10.1002/job.363 · Cited by 52
Internet Survey Methods: A Review of Strengths, Weaknesses, and Innovations
Smyth, J. D. (2018) · Routledge eBooks · doi:10.4324/9780203844922-2 · Cited by 43
Minimizing survey refusal and noncontact rates: do our efforts pay off?
Heerwegh, D., Abts, K., & Loosveldt, G. (2007) · Survey research methods · doi:10.18148/srm/2007.v1i1.46 · Cited by 41
Enhancing student engagement in student experience surveys: a mixed methods study
Webber, M., Lynch, S., & Oluku, J. (2013) · Educational Research · doi:10.1080/00131881.2013.767026 · Cited by 16
Cited by
Saleh, A., & Bista, K. (2017) · Journal of MultiDisciplinary Evaluation · doi:10.56645/jmde.v13i29.487 · Cited by 481
Strategies to improve response rates to web surveys: A literature review
Sammut, R., Griscti, O., & Norman, I. J. (2021) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2021.104058 · Cited by 343
Systemic inequalities for LGBTQ professionals in STEM
Cech, E. A., & Waidzunas, T. J. (2021) · Science Advances · doi:10.1126/sciadv.abe0933 · Cited by 319
The intersectional privilege of white able-bodied heterosexual men in STEM
Cech, E. A. (2022) · Science Advances · doi:10.1126/sciadv.abo1558 · Cited by 159
Bethel, A., Ward, C., & Fetvadjiev, V. H. (2020) · Frontiers in Education · doi:10.3389/feduc.2020.539950 · Cited by 89
Metadata
- Authors
- Van Mol, C.
- Venue
- International Journal of Social Research Methodology
- Publisher
- Informa UK Limited
- Published
- 2016-05-17
- Volume
- 20
- Issue
- 4
- Pages
- 317-327
- ISSN
- 1364-5579 (ISSN-L)
- 1464-5300
- OpenAlex
- W2396314455
- Cited by
- 293
- References
- 41
- FWCI
- 41.92
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.