The DOI matches its Crossref record; 83 of the 83 references it cites were found in a registry or an index.
Comparing Response Rates from Web and Mail Surveys: A Meta-Analysis
Abstract
This study meta-analyzes thirty-nine study results published within last ten years that directly compared Web and mail survey modes. Although considerable variation exists across the studies, the authors' findings show that mail surveys have higher response rates than Web surveys in general. Two study features (i.e., population types and follow-up reminders) are shown to contribute statistically to the variation of response rate differences between Web and paper surveys in the comparative studies. College respondents appear to be more responsive to Web surveys, while some other respondents (e.g., medical doctors, school teachers, and general consumers) appear to prefer traditional mail surveys. Follow-up reminders appear to be less effective for Web survey respondents than for mail survey respondents. Other study features (i.e., implementation of random assignment of survey respondents, incentives, and publication year) are not statistically useful in accounting for the variation of response rate differences between Web and mail surveys.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This sample size was selected following review of expected response rates to unsolicited, non-incentivized, online medical research surveys [27,29-32] and in consultation with other large Australian-based surveys.”
From How Doctors View and Use Social Media: A National Survey (2014) · cites this paper as [31]
Citations
Cites
(1994) · Journal of the American Dietetic Association · doi:10.1016/0002-8223(94)92216-0 · Cited by 45,910
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552 · cited 1×
“For the field of meta-analysis, the random-effect model has also been widely used (e.g., Dersimonian and Laird 1986).”
MethodThe Practice of Social Research
Neustadtl, A., & Babbie, E. (1989) · Teaching Sociology · doi:10.2307/1318433 · Cited by 14,398
Estimating Nonresponse Bias in Mail Surveys
Armstrong, J. S., & Overton, T. S. (1977) · Journal of Marketing Research · doi:10.2307/3150783 · Cited by 12,222
Estimating nonresponse bias in mail surveys
Armstrong, J. S., & Overton, T. S. (1977) · Journal of Marketing Research · doi:10.1177/002224377701400320 · Cited by 10,390 · cited 1×
“…Claycomb, Porter, and Martin 2000; Dillman 2000) and how to estimate and/or correct for nonresponse bias (e.g., Baur 1947; Ferber 1948; Donald 1960; Armstrong and Overton 1977; Stinchcombe, Jones, and Sheatsley 1981; Pearl and Fairley 1985; McBroom 1988; Bickart and Schmittlein 1999; Groves 2002).”
BackgroundThe Practice of Social Research.
Williams, D. G., & Babbie, E. R. (1976) · Contemporary Sociology · doi:10.2307/2062956 · Cited by 7,194
Methods of Meta-Analysis: Correcting Error and Bias in Research Findings
Schmidt, F. L., & Hunter, J. E. (2015) · doi:10.4135/9781483398105 · Cited by 5,542
Practical Assessment, Research & Evaluation, 2000-2001.
Rudner, L. M., & Schafer, W. D. (2001) · Practical assessment, research & evaluation · Cited by 3,905
(1982) · Cited by 3,737
A Meta-Analysis of Response Rates in Web- or Internet-Based Surveys
Cook, C., Heath, F., & Thompson, R. L. (2000) · Educational and Psychological Measurement · doi:10.1177/00131640021970934 · Cited by 2,396 · cited 2×
“There have been meta-analytic studies focusing on response rates of Internet-based surveys (Cook, Heath, and Thompson 2000) and on paper surveys (Fox, Crask, and Kim 1988; Yammarino, Skinner, and Childers 1991; Church 1993).”
BackgroundResult
Research works printed but not linked: 17
- American Association for Public Opinion Research (AAPOR)., 2006, Standard definitions: Final dispositions of case codes and outcome rates for surveys
- Couper, M.P., 1999, Journal of Official Statistics, 15, 39
- Dillman, D.A., 2000, Mail and Internet surveys: The total design method
- Dillman, D.A., Paper presented at annual meeting of the American Statistical Association Joint Statistical Meetings
- Groves, R.M., 2002, Survey nonresponse
- Groves, R.M., and L.E. Lyberg. 1988. An overview of nonresponse issues in telephone surveys. In Telephone survey methodology, ed. R. M. Groves, P. P. Biemer, L. E. Lyberg, J. T. Massey, W. L. Nicholls , and J. Waksberg, 191-211. New York: John Wiley.
- James, D.C.S., 2005, The International Electronic Journal of Health Education, 8, 119
- Kennedy, J.M., 2000, Web and mail surveys: Preliminary results of comparisons based on a large-scale project
- Kwak, N., 2002, Journal of Official Statistics, 18, 257
- Mertler, C.A., 2003, Practical Assessment, Research & Evaluation, 8
- Parker, L., 1992, Training and Development, 46, 52
- Roberts, L.L., 2004, R.M. Research, 9, 13
- 10.1037/0033-2909.92.2.500 · doi:10.1037/0033-2909.92.2.500 · Paper page
- Tourangeau, R., Paper presented at the Federal Committee on Statistical Methodology Research conference
- Tse, A.C.B., 1995, Journal of the Market Research Society, 37, 441
- Weible, R., 1998, Market Research, 10, 19
- Wygant, S., 1999, Quirks Marketing Research Review
Cited by
Factors affecting response rates of the web survey: A systematic review
Fan, W., & Yan, Z. (2010) · Computers in Human Behavior · doi:10.1016/j.chb.2009.10.015 · Cited by 1,521
“First, types of populations were found to significantly affect the response rate according to several meta-analyses (Baruch, 2000; Cook et al., 2000; Heberlein & Baumgartner, 1978; Shih & Fan, 2008).”
BackgroundResponse rates of online surveys in published research: A meta-analysis
Wu, M.-J., Zhao, K., & Fils-Aime, F. (2022) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2022.100206 · Cited by 1,135
Dietary Assessment Methodology
Thompson, F. E., & Subar, A. F. (2017) · Nutrition in the Prevention and Treatment of Disease · doi:10.1016/b978-0-12-802928-2.00001-1 · Cited by 913
The Somatic Symptom Scale–8 (SSS-8): A Brief Measure of Somatic Symptom Burden
Gierk, B., Kohlmann, S., Kroenke, K., Spangenberg, L., Zenger, M., Brähler, E., & Löwe, B. (2014) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2013.12179 · Cited by 740
Revisiting technological pedagogical content knowledge: Exploring the TPACK framework
Archambault, L. M., & Barnett, J. H. (2010) · Computers & Education · doi:10.1016/j.compedu.2010.07.009 · Cited by 652
“While the response rate is modest, it is recognized as acceptable for a web-based survey (Manfreda, Bosnjak, Berzelak, Hass, & Vehovar, 2008; Shih & Fan, 2008).”
Background
Metadata
- Authors
- Shih, T.-H., & Fan, X.
- Affiliations
- University of Virginia (US)
- ORCID
- Xitao Fan
- Venue
- Field Methods
- Publisher
- SAGE Publications
- Published
- 2008-03-03
- Volume
- 20
- Issue
- 3
- Pages
- 249-271
- ISSN
- 1064-8631 (ISSN-L)
- 1525-822X
- 1552-3969
- OpenAlex
- W2098031768
- Cited by
- 1,159
- References
- 82
- Citations by year
- 2026: 22 · 2025: 42 · 2024: 51 · 2023: 54 · 2022: 49 · 2021: 64 · 2020: 71 · 2019: 66 · 2018: 69 · 2017: 89 · 2016: 96 · 2015: 119 · 2014: 109 · 2013: 85 · 2012: 62
- FWCI
- 20.54
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Field Methods (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Physical Sciences › Mathematics › Statistics and Probability › Survey Sampling and Estimation Techniques
- Social Sciences › Sociology and Political Science › Focus Groups and Qualitative Methods
- Keywords
- online surveys, mail surveys, survey response rates, survey mode comparison, follow-up reminders, university students, survey incentives, survey mode effects
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Comparing Response Rates from Web and Mail Surveys: A Meta-Analysis. https://app.cochat.ai/papers/10.1177/1525822x08317085
- The paper
- Shih, T.-H., & Fan, X. (2008). Comparing Response Rates from Web and Mail Surveys: A Meta-Analysis. Field Methods. https://doi.org/10.1177/1525822x08317085
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.