Response rates in postal surveys of healthcare professionals between 1996 and 2005: An observational study
Open accessThe DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Postal surveys are a frequently used method of data collection in health services research. Low response rates increase the potential for bias and threaten study validity. The objectives of this study were to estimate current response rates, to assess whether response rates are falling, to explore factors that might enhance response rates and to examine the potential for non-response bias in surveys mailed to healthcare professionals. METHODS: A random sample of postal or electronic surveys of healthcare workers (1996-2005) was identified from Medline, Embase or Psycinfo databases or Biomed Central. Outcome measures were survey response rate and non response analysis. Multilevel, multivariable logistic regression examined the relationship between response rate and publication type, healthcare profession, country and number of survey participants, questionnaire length and use of reminders. RESULTS: The analysis included 350 studies. Average response rate in doctors was 57.5% (95%CI: 55.2% to 59.8%) and significantly lower than the estimate for the prior 10 year period. Response rates were higher when reminders were sent (adjusted OR 1.3; 95%CI 1.1-1.6) but only half the studies did this. Response rates were also higher in studies with fewer than 1000 participants and in countries other than US, Canada, Australia and New Zealand. They were not significantly affected by publication type or healthcare profession (p > 0.05). Only 17% of studies attempted assessment of possible non-response bias. CONCLUSION: Response rates to postal surveys of healthcare professionals are low and probably declining, almost certainly leading to unknown levels of bias. To improve the informativeness of postal survey findings, researchers should routinely consider the use of reminders and assess potential for non-response bias.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Over the past 20 years, low response rates have been typical of healthcare professionals’ surveys, even with incorporation of recommended strategies to boost response rates like we used, such as multiple mailings and endorsement by local professional leaders [44–46].”
From Nurse Practitioners' Use of Communication Techniques: Results of a Maryland Oral Health Literacy Survey (2016) · cites this paper as [45]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,265
Mail and internet surveys : the tailored design method
Dillman, D. A. (2007) · Cited by 9,587
Statistical Analysis with Missing Data
Little, R. J. A., & Rubin, D. B. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/9781119013563 · Cited by 8,473
Analysis of Incomplete Multivariate Data
Schafer, J. L. (1997) · doi:10.1201/9781439821862 · Cited by 6,012
Analysis of Incomplete Multivariate Data
Booth, D. E. (2000) · Technometrics · doi:10.1080/00401706.2000.10486013 · Cited by 5,627
Multilevel and Longitudinal Modeling Using Stata
(2006) · Biometrics · doi:10.1111/j.1541-0420.2006.00588_16.x · Cited by 4,236
Mail and Internet Surveys: The Tailored Design Method
CHISNALL, P. M. (2007) · Journal of Advertising Research · doi:10.2501/s0021849907070237 · Cited by 3,435
Residuals and Influence in Regression
Ling, R. F. (1984) · Technometrics · doi:10.1080/00401706.1984.10487996 · Cited by 2,642
Response rates to mail surveys published in medical journals
Asch, D. A., Jedrziewski, M. K., & Christakis, N. A. (1997) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(97)00126-1 · Cited by 2,110
Research Methods in Health. Investigating health and health services
Bowling, A. (1997) · UCL Discovery (University College London) · Cited by 2,032
Physician response to surveys A review of the literature
Kellerman, S. (2001) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(00)00258-0 · Cited by 956 · cited 1×
“Two smaller systematic reviews of randomised controlled trials that specifically focused on healthcare professionals [10,11] found the use of monetary incentives, reply paid envelopes, shorter questionnaires, recorded delivery and survey personalisation to increase survey response.”
Research Methods in Health – Investigating Health and Health Services
Johnman, C. (2010) · Public Health · doi:10.1016/j.puhe.2010.01.006 · Cited by 874
McColl, E., Jacoby, A., Thomas, L., Soutter, J., Bamford, C., Steen, N., Thomas, R., Harvey, E., Garratt, A., & Bond, J. (2001) · Health Technology Assessment · doi:10.3310/hta5310 · Cited by 788
Reported response rates to mailed physician questionnaires.
Cummings, S., Konrad, T., & Savitz, L. A. (2020) · PubMed · doi:10.17615/e1d3-9q29 · Cited by 687
Residuals and Influence in Regression.
Chatterjee, S., Cook, R. D., & Weisberg, S. (1984) · Journal of the American Statistical Association · doi:10.2307/2288741 · Cited by 622
Methods to increase response rates to postal questionnaires
Edwards, P. J., Roberts, I. G., Clarke, M. J., DiGuiseppi, C., Wentz, R., Kwan, I., Cooper, R., Felix, L., & Pratap, S. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000008.pub3 · Cited by 387
Campbell, M. K., Mollison, J., & Grimshaw, J. M. (2001) · Statistics in Medicine · doi:10.1002/1097-0258(20010215)20:3<391::aid-sim800>3.0.co;2-z · Cited by 299
General practice postal surveys: a questionnaire too far?
McAvoy, B. R., & Kaner, E. F. S. (1996) · BMJ · doi:10.1136/bmj.313.7059.732 · Cited by 282
Sample size calculator for cluster randomized trials
Campbell, M. K., Thomson, S., Ramsay, C. R., MacLennan, G. S., & Grimshaw, J. M. (2004) · Computers in Biology and Medicine · doi:10.1016/s0010-4825(03)00039-8 · Cited by 220
Activity level and risk of overweight in male health professionals.
Ching, P. L., Willett, W. C., Rimm, E. B., Colditz, G. A., Gortmaker, S. L., & Stampfer, M. J. (1996) · American Journal of Public Health · doi:10.2105/ajph.86.1.25 · Cited by 186
Field, T. S., Cadoret, C. A., Brown, M. L., Ford, M., Greene, S. M., Hill, D., Hornbrook, M. C., Meenan, R. T., Jo White, M., & Zapka, J. M. (2002) · Medical Care · doi:10.1097/00005650-200207000-00006 · Cited by 174
Methods to increase response rates to postal questionnaires
Edwards, P. J., Roberts, I., Clarke, M. J., DiGuiseppi, C. G., Pratap, S., Wentz, R., Kwan, I., & Cooper, R. (2003) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000008.pub2 · Cited by 66
Moore, M., Post, K., & Smith, H. E. (1999) · PubMed · Cited by 12
Robust description of family practice. A look at the National Physician Survey.
Busing, N., & Newbery, P. (2005) · PubMed · Cited by 9
Cited by
Enhancing Surveys of Health Care Professionals: A Meta-Analysis of Techniques to Improve Response
Cho, Y. I., Johnson, T. P., & VanGeest, J. B. (2013) · Evaluation & the Health Professions · doi:10.1177/0163278713496425 · Cited by 489
Reporting Guidelines for Survey Research: An Analysis of Published Guidance and Reporting Practices
Bennett, C., Khangura, S., Brehaut, J. C., Graham, I. D., Moher, D., Potter, B. K., & M. Grimshaw, J. (2011) · PLoS Medicine · doi:10.1371/journal.pmed.1001069 · Cited by 397
Cook, J., Hislop, J., Adewuyi, T., Harrild, K., Altman, D., Ramsay, C., Fraser, C., Buckley, B., Fayers, P., Harvey, I., et al. (2014) · Health Technology Assessment · doi:10.3310/hta18280 · Cited by 194
Self-citationWilson, G. B., Lock, C. A., Heather, N., Cassidy, P., Christie, M. M., & Kaner, E. F. S. (2011) · Alcohol and Alcoholism · doi:10.1093/alcalc/agr067 · Cited by 112
Potthoff, S., Presseau, J., Sniehotta, F. F., Johnston, M., Elovainio, M., & Avery, L. (2017) · Implementation Science · doi:10.1186/s13012-017-0551-6 · Cited by 82
“The individual baseline response rate of 58% is higher than what was achieved in previous theorybased questionnaire surveys [54], possibly due to the recruitment of practices that may be more motivated (which may have reduced the representativeness) and the use of remuneration for time spent completing the questionnai…”
Metadata
- Authors
- Cook, J. V., Dickinson, H. O., & Eccles, M. P.
- Venue
- BMC Health Services Research
- Published
- 2009-09-14
- Volume
- 9
- Issue
- 1
- Pages
- 160-160
- ISSN
- 1472-6963 (ISSN-L)
- OpenAlex
- W2105519656
- Cited by
- 493
- References
- 24
- FWCI
- 71.64
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.