The DOI matches its Crossref record; 76 of the 76 references it cites were found in a registry or an index.
Web Versus Other Survey Modes: An Updated and Extended Meta-Analysis Comparing Response Rates
Abstract
Do web surveys still yield lower response rates compared with other survey modes? To answer this question, we replicated and extended a meta-analysis done in 2008 which found that, based on 45 experimental comparisons, web surveys had an 11 percentage points lower response rate compared with other survey modes. Fundamental changes in internet accessibility and use since the publication of the original meta-analysis would suggest that people’s propensity to participate in web surveys has changed considerably in the meantime. However, in our replication and extension study, which comprised 114 experimental comparisons between web and other survey modes, we found almost no change: web surveys still yielded lower response rates than other modes (a difference of 12 percentage points in response rates). Furthermore, we found that prenotifications, the sample recruitment strategy, the survey’s solicitation mode, the type of target population, the number of contact attempts, and the country in which the survey was conducted moderated the magnitude of the response rate differences. These findings have substantial implications for web survey methodology and operations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
Conducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799
(2000) · Cited by 9,198
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Internet, Mail, and Mixed-Mode Surveys: The Tailored Design Method
Dillman, D. A., Smyth, J. D., & Christian, L. M. (2008) · Cited by 5,345
Losh-Hesselbart, S., & Fowler, F. J. (1985) · Journal of the American Statistical Association · doi:10.2307/2288598 · Cited by 4,764
Cited by
Response rates of online surveys in published research: A meta-analysis
Wu, M.-J., Zhao, K., & Fils-Aime, F. (2022) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2022.100206 · Cited by 1,135
Noble, J. M., Zamani, A., Gharaat, M., Merrick, D., Maeda, N., Lambe Foster, A., Nikolaidis, I., Goud, R., Stroulia, E., Agyapong, V. I. O., et al. (2022) · JMIR Research Protocols · doi:10.2196/33717 · Cited by 53
Lim, J., Leow, Z., Ong, J., Pang, L.-S., & Lim, E. (2020) · doi:10.2196/preprints.21757 · Cited by 33
Agyapong, B., da Luz Dias, R., Wei, Y., & Agyapong, V. I. O. (2024) · Frontiers in Public Health · doi:10.3389/fpubh.2024.1396461 · Cited by 21
Hinduja, S., & Patchin, J. W. (2026) · New Media & Society · doi:10.1177/14614448241284413 · Cited by 12
Metadata
- Authors
- Daikeler, J., Bošnjak, M., & Lozar Manfreda, K.
- Venue
- Journal of Survey Statistics and Methodology
- Publisher
- Oxford University Press (OUP)
- Published
- 2019-05-13
- Volume
- 8
- Issue
- 3
- Pages
- 513-539
- ISSN
- 2325-0984 (ISSN-L)
- 2325-0992
- OpenAlex
- W2946547311
- Cited by
- 411
- References
- 76
- FWCI
- 48.47
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Web Versus Other Survey Modes: An Updated and Extended Meta-Analysis Comparing Response Rates. https://app.cochat.ai/papers/10.1093/jssam/smz008
- The paper
- Daikeler, J., Bošnjak, M., & Lozar Manfreda, K. (2020). Web Versus Other Survey Modes: An Updated and Extended Meta-Analysis Comparing Response Rates. Journal of Survey Statistics and Methodology. https://doi.org/10.1093/jssam/smz008
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.