Internet Versus Mailed Questionnaires: A Controlled Comparison (2)
Open accessThe DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Low response rates among surgeons can threaten the validity of surveys. Internet technologies may reduce the time, effort, and financial resources needed to conduct surveys. OBJECTIVE: We investigated whether using Web-based technology could increase the response rates to an international survey. METHODS: We solicited opinions from the 442 surgeon-members of the Orthopaedic Trauma Association regarding the treatment of femoral neck fractures. We developed a self-administered questionnaire after conducting a literature review, focus groups, and key informant interviews, for which we used sampling to redundancy techniques. We administered an Internet version of the questionnaire on a Web site, as well as a paper version, which looked similar to the Internet version and which had identical content. Only those in our sample could access the Web site. We alternately assigned the participants to receive the survey by mail (n=221) or an email invitation to participate on the Internet (n=221). Non-respondents in the mail arm received up to three additional copies of the survey, while non-respondents in the Internet arm received up to three additional requests, including a final mailed copy. All participants in the Internet arm had an opportunity to request an emailed Portable Document Format (PDF) version. RESULTS: The Internet arm demonstrated a lower response rate (99/221, 45%) than the mail questionnaire arm (128/221, 58%) (absolute difference 13%, 95% confidence interval 4%-22%, P<0.01). CONCLUSIONS: Our Internet-based survey to surgeons resulted in a significantly lower response rate than a traditional mailed survey. Researchers should not assume that the widespread availability and potential ease of Internet-based surveys will translate into higher response rates.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Response rates to mail surveys published in medical journals
Asch, D. A., Jedrziewski, M. K., & Christakis, N. A. (1997) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(97)00126-1 · Cited by 2,110
Physician response to surveys A review of the literature
Kellerman, S. (2001) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(00)00258-0 · Cited by 956 · cited 4×
“Previous research has demonstrated that monetary incentives, stamped return envelopes, telephone reminders, shorter surveys, and high interest can sometimes increase response rates [1,2].”
BackgroundInfluentialFeinstein, A. R. (1987) · doi:10.2307/j.ctt1xp3vbc · Cited by 538
Cited by
Boulkedid, R., Abdoul, H., Loustau, M., Sibony, O., & Alberti, C. (2011) · PLoS ONE · doi:10.1371/journal.pone.0020476 · Cited by 2,045
Comparing Response Rates from Web and Mail Surveys: A Meta-Analysis
Shih, T.-H., & Fan, X. (2008) · Field Methods · doi:10.1177/1525822x08317085 · Cited by 1,159
Methodologies for Improving Response Rates in Surveys of Physicians: A Systematic Review
VanGeest, J. B., Johnson, T. P., & Welch, V. L. (2007) · Evaluation & the Health Professions · doi:10.1177/0163278707307899 · Cited by 695
Physician Confidence in Artificial Intelligence: An Online Mobile Survey
Oh, S., Kim, J. H., Choi, S.-W., Lee, H. J., Hong, J., & Kwon, S. H. (2019) · Journal of Medical Internet Research · doi:10.2196/12422 · Cited by 387
O’Meara, K., Kuvaeva, A., Nyunt, G., Waugaman, C., & Jackson, R. (2017) · American Educational Research Journal · doi:10.3102/0002831217716767 · Cited by 292
Metadata
- Authors
- Leece, P., Bhandari, M., Sprague, S., Swiontkowski, M. F., Schemitsch, E. H., Tornetta, P., Devereaux, P., & Guyatt, G. H.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2004-10-29
- Volume
- 6
- Issue
- 4
- Pages
- e39
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W2063390718
- Cited by
- 216
- References
- 3
- FWCI
- 34.19
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.