Exploring physician specialist response rates to web-based surveys
Open accessAbstract
BACKGROUND: Survey research in healthcare is an important tool to collect information about healthcare delivery, service use and overall issues relating to quality of care. Unfortunately, physicians are often a group with low survey response rates and little research has looked at response rates among physician specialists. For these reasons, the purpose of this project was to explore survey response rates among physician specialists in a large metropolitan Canadian city. METHODS: As part of a larger project to look at physician payment plans, an online survey about medical billing practices was distributed to 904 physicians from various medical specialties. The primary method for physicians to complete the survey was via the Internet using a well-known and established survey company (www.surveymonkey.com). Multiple methods were used to encourage survey response such as individual personalized email invitations, multiple reminders, and a draw for three gift certificate prizes were used to increase response rate. Descriptive statistics were used to assess response rates and reasons for non-response. RESULTS: Overall survey response rate was 35.0%. Response rates varied by specialty: Neurology/neurosurgery (46.6%); internal medicine (42.9%); general surgery (29.6%); pediatrics (29.2%); and psychiatry (27.1%). Non-respondents listed lack of time/survey burden as the main reason for not responding to our survey. CONCLUSIONS: Our survey results provide a look into the challenges of collecting healthcare research where response rates to surveys are often low. The findings presented here should help researchers in planning future survey based studies. Findings from this study and others suggest smaller monetary incentives for each individual may be a more appropriate way to increase response rates.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Studies show that psychiatrists are often reluctant to participate in opinion polls and generally present a low return to surveys, including in Brazil.
“Studies show that psychiatrists are often reluctant to participate in opinion polls29 and generally present a low return to surveys, including in Brazil.30”
From A preliminary survey on the religious profile of Brazilian psychiatrists and their approach to patients' religiosity in clinical practice (2016) · cites this paper as [29]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Mail and Telephone Surveys: The Total Design Method.
Babbie, E. R., & Dillman, D. A. (1982) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2068433 · Cited by 6,859 · see citing works
Canadian Institute for Health Information.
Lalonde, A. (1994) · PubMed · Cited by 4,730 · see citing works
A Meta-Analysis of Response Rates in Web- or Internet-Based Surveys
Cook, C., Heath, F. M., & Thompson, R. L. (2000) · Educational and Psychological Measurement · doi:10.1177/00131640021970934 · Cited by 2,398 · see citing works
Response rates to mail surveys published in medical journals
Asch, D. A., Jedrziewski, M. K., & Christakis, N. A. (1997) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(97)00126-1 · Cited by 2,110 · see citing works
Increasing response rates to postal questionnaires: systematic review
Edwards, P. J., Roberts, I., Clarke, M. J., DiGuiseppi, C. G., Pratap, S., Wentz, R., & Kwan, I. (2002) · BMJ · doi:10.1136/bmj.324.7347.1183 · Cited by 1,915 · see citing works
Factors affecting response rates of the web survey: A systematic review
Fan, W., & Yan, Z. (2009) · Computers in Human Behavior · doi:10.1016/j.chb.2009.10.015 · Cited by 1,535 · see citing works
E-mail Survey Response Rates: A Review
Sheehan, K. B. (2006) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.2001.tb00117.x · Cited by 1,441 · see citing works
A guide for the design and conduct of self-administered surveys of clinicians
Burns, K. E. A., Duffett, M., Kho, M. E., Meade, M., Adhikari, N. K. J., Sinuff, T., Cook, D. J., & for the ACCADEMY Group (2008) · Canadian Medical Association Journal · doi:10.1503/cmaj.080372 · Cited by 1,357 · see citing works
Physician response to surveys A review of the literature
Kellerman, S. (2001) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(00)00258-0 · Cited by 956 · see citing works
Development of a Standard E-Mail Methodology: Results of an Experiment
Schaefer, D. R., & Dillman, D. A. (1998) · Public Opinion Quarterly · doi:10.1086/297851 · Cited by 829 · see citing works
Reported response rates to mailed physician questionnaires.
Cummings, S., Konrad, T., & Savitz, L. (2020) · PubMed · doi:10.17615/e1d3-9q29 · Cited by 687 · see citing works
Using the Internet to conduct surveys of health professionals: a valid alternative?
Braithwaite, D., Emery, J. D., de Lusignan, S., & Sutton, S. R. (2003) · Family Practice · doi:10.1093/fampra/cmg509 · Cited by 475 · see citing works
Gosden, T., Forland, F., Kristiansen, I. S., Sutton, M., Leese, B., Giuffrida, A., Sergison, M., & Pedersen, L. L. (2000) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002215 · Cited by 426 · see citing works
Nakash, R. A., Hutton, J. L., Jørstad‐Stein, E. C., Gates, S., & Lamb, S. E. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-5 · Cited by 360 · see citing works
Barclay, S. (2002) · Family Practice · doi:10.1093/fampra/19.1.105 · Cited by 301 · see citing works
Comparison of E-mail, Fax, and Postal Surveys of Pediatricians
McMahon, S. R., Iwamoto, M., Massoudi, M. S., Yusuf, H. R., Stevenson, J. M., David, F., Chu, S. Y., & Pickering, L. K. (2003) · PEDIATRICS · doi:10.1542/peds.111.4.e299 · Cited by 284 · see citing works
Grava-Gubins, I., & Scott, S. E. (2008) · PubMed Central · Cited by 242 · see citing works
Problems in recruiting community-based physicians for health services research
Asch, S. M., Connor, S. E., Hamilton, E. G., & Fox, S. A. (2000) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2000.02329.x · Cited by 234 · see citing works
How to obtain excellent response rates when surveying physicians
Thorpe, C. F., Ryan, B. L., McLean, S., et al. (2008) · Family Practice · doi:10.1093/fampra/cmn097 · Cited by 204 · see citing works
Field, T. S., Cadoret, C. A., Brown, M. L., Ford, M. E., Greene, S. M., Hill, D. L., Hornbrook, M. C., Meenan, R. T., White, M. J., & Zapka, J. (2002) · Medical Care · doi:10.1097/00005650-200207000-00006 · Cited by 173 · see citing works
General Internists’ Preferences and Knowledge About the Care of Adult Survivors of Childhood Cancer
Suh, E., Daugherty, C. K., Wroblewski, K., et al. (2014) · Annals of Internal Medicine · doi:10.7326/m13-1941 · Cited by 168 · see citing works
Telephone versus postal surveys of general practitioners: methodological considerations.
Sibbald, B., Addington-Hall, J. M., Brenneman, D., et al. (1994) · PubMed · Cited by 162 · see citing works
Increasing response rates in physicians' mail surveys: an experimental study.
Maheux, B., Legault, C., & Lambert, J. (1989) · American Journal of Public Health · doi:10.2105/ajph.79.5.638 · Cited by 141 · see citing works
Mixing Web and Mail Methods in a Survey of Physicians
Beebe, T. J., Locke, G. R., Barnes, S. A., Davern, M. E., & Anderson, K. J. (2006) · Health Services Research · doi:10.1111/j.1475-6773.2006.00652.x · Cited by 132 · see citing works
Response Rate Comparisons of E-Mail- and Mail-Distributed Student Evaluations
Paolo, A. M., Bonaminio, G. A., Gibson, C., Partridge, T., & Kallail, K. (2000) · Teaching and Learning in Medicine · doi:10.1207/s15328015tlm1202_4 · Cited by 130 · see citing works
Current Pediatrician Practices in Identifying High-risk Behaviors of Adolescents
Henry-Reid, L. M., O’Connor, K. G., Klein, J. D., Cooper, E. R., Flynn, P. M., & Futterman, D. C. (2010) · PEDIATRICS · doi:10.1542/peds.2009-0271 · Cited by 126 · see citing works
Tambor, E. S., Chase, G. A., Faden, R., et al. (1993) · American Journal of Public Health · doi:10.2105/ajph.83.11.1599 · Cited by 116 · see citing works
James, K. M., Ziegenfuss, J. Y., Tilburt, J. C., Harris, A. M., & Beebe, T. J. (2010) · Health Services Research · doi:10.1111/j.1475-6773.2010.01181.x · Cited by 107 · see citing works
Physician response rates to a mail survey by specialty and timing of incentive
Delnevo, C. D., Abatemarco, D. J., & Steinberg, M. B. (2004) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2003.12.013 · Cited by 98 · see citing works
Grunfeld, E., Mant, D., Vessey, M. P., et al. (1995) · Family Practice · doi:10.1093/fampra/12.1.60 · Cited by 95 · see citing works
Rice, H. E., Frush, D. P., Harker, M. J., Farmer, D. L., & Waldhausen, J. H. T. (2007) · Journal of Pediatric Surgery · doi:10.1016/j.jpedsurg.2007.02.007 · Cited by 87 · see citing works
Response rates and representativeness: a lottery incentive improves physician survey return rates
Robertson, J., Walkom, E. J., & McGettigan, P. (2005) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1126 · Cited by 72 · see citing works
Internet systems for evaluation research
Watt, J. H. (1999) · New Directions for Evaluation · doi:10.1002/ev.1151 · Cited by 70 · see citing works
Randomized Trial of $20 Versus $50 Incentives to Increase Physician Survey Response Rates
Keating, N. L., Zaslavsky, A. M., Goldstein, J., West, D. W., & Ayanian, J. Z. (2008) · Medical Care · doi:10.1097/mlr.0b013e318178eb1d · Cited by 67 · see citing works
Physician attitudes toward regionalization of adult critical care: A national survey*
Kahn, J. M., Asch, R. J., Iwashyna, T. J., et al. (2009) · Critical Care Medicine · doi:10.1097/ccm.0b013e3181a009d0 · Cited by 56 · see citing works
Siddiqui, Z. K., Wu, A. W., Kurbanova, N., et al. (2014) · Journal of Hospital Medicine · doi:10.1002/jhm.2225 · Cited by 52 · see citing works
Physicians’ Experiences With BRCA1/2 Testing in Community Settings
Keating, N. L., Stoeckert, K. A., Regan, M. M., DiGianni, L. M., & Garber, J. E. (2008) · Journal of Clinical Oncology · doi:10.1200/jco.2008.17.8053 · Cited by 37 · see citing works
Clark, S. J., Adolphe, S., Davis, M. M., et al. (2006) · Infectious Diseases in Obstetrics and Gynecology · doi:10.1155/idog/2006/87040 · Cited by 27 · see citing works
Tamayo‐Sarver, J. H., & Baker, D. W. (2004) · Academic Emergency Medicine · doi:10.1197/j.aem.2004.01.010 · Cited by 22 · see citing works
Kline, M. W., & O’Connor, K. G. (2003) · PEDIATRICS · doi:10.1542/peds.112.5.e367 · Cited by 20 · see citing works
Afghani, B., Kong, V., & Wu, F. L. (2007) · Journal of Pediatric Orthopaedics · doi:10.1097/bpo/0b013e3181558981 · Cited by 20 · see citing works
Stankovic, C., Mahajan, P., Ye, H., et al. (2009) · Pediatric Emergency Care · doi:10.1097/pec.0b013e318196ea81 · Cited by 18 · see citing works
Howell, S. C., Quine, S., & Talley, N. J. (2003) · The Medical Journal of Australia · doi:10.5694/j.1326-5377.2003.tb05043.x · Cited by 18 · see citing works
Tamayo‐Sarver, J. H., & Baker, D. W. (2004) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2004.tb00776.x · Cited by 14 · see citing works
Canadian Physicians’ Choices for Their Own Colon Cancer Screening
Raza, M., Bernstein, C. N., & Ilnyckyj, A. (2006) · Canadian Journal of Gastroenterology · doi:10.1155/2006/969832 · Cited by 13 · see citing works
Highlights of the 2002 Canadian Neurological Society (CNS) Manpower Survey
Bailey, P., Warren, S., & Buske, L. (2005) · Canadian Journal of Neurological Sciences / Journal Canadien des Sciences Neurologiques · doi:10.1017/s0317167100004406 · Cited by 12 · see citing works
Knowledge of Lynch syndrome among obstetrician/gynecologists and general surgeons
Frey, M. K., Taylor, J. S., Pauk, S. J., et al. (2014) · International Journal of Gynecology & Obstetrics · doi:10.1016/j.ijgo.2014.02.024 · Cited by 12 · see citing works
DO PEOPLE ALWAYS RESPOND TO INCENTIVES? EXPERIENCE IN DATA GATHERING THROUGH FACE TO FACE INTERVIEWS
Tanasiuk, E., & Islam, S. (2012) · Cited by 4 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Ginestra, J. C., Giannini, H. M., Schweickert, W. D., Meadows, L., Lynch, M. J., Pavan, K., Chivers, C. J., Draugelis, M., Donnelly, P. J., Fuchs, B. D., et al. (2019) · Critical Care Medicine · doi:10.1097/ccm.0000000000003803 · Cited by 159 · see citing works
Implicit Gender Bias and the Use of Cardiovascular Tests Among Cardiologists
Daugherty, S. L., Blair, I. V., Havranek, E. P., Furniss, A., Dickinson, L. M., Karimkhani, E., Main, D. S., & Masoudi, F. A. (2017) · Journal of the American Heart Association · doi:10.1161/jaha.117.006872 · Cited by 150 · see citing works
Nishimura, Y., Ochi, K., Tokumasu, K., Obika, M., Hagiya, H., Kataoka, H., & Otsuka, F. (2021) · Journal of Medical Internet Research · doi:10.2196/25232 · Cited by 133 · see citing works
Laka, M., Milazzo, A., & Merlin, T. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18041901 · Cited by 78 · see citing works
Is <scp>COVID</scp>‐19 the straw that broke the back of the emergency nursing workforce?
Cornish, S., Klim, S., & Kelly, A. (2021) · Emergency Medicine Australasia · doi:10.1111/1742-6723.13843 · Cited by 68 · see citing works
Rasmussen, K., Bero, L., Redberg, R., Gøtzsche, P. C., & Lundh, A. (2018) · BMJ · doi:10.1136/bmj.k3654 · Cited by 74 · see citing works
Menegatti-Chequini, M. C., Gonçalves, J. P. B., Leão, F. C., Peres, M. F. P., & Vallada, H. (2016) · BJPsych Open · doi:10.1192/bjpo.bp.116.002816 · Cited by 65 · see citing works
Schroter, S., Montagni, I., Loder, E., Eikermann, M., Schäffner, E., & Kurth, T. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-036899 · Cited by 51 · see citing works
Cross, A. S., Helen Kemp, E., White, A., Walker, L., Meredith, S., Sachdev, P., Krone, N. P., Ross, R. J., Wright, N. P., & Elder, C. J. (2018) · Clinical Endocrinology · doi:10.1111/cen.13559 · Cited by 34 · see citing works
Yakovchenko, V., Morgan, T. R., Chinman, M. J., Powell, B. J., Gonzalez, R., Park, A., Malone, P. S., Chartier, M., Ross, D., & Rogal, S. S. (2021) · BMC Health Services Research · doi:10.1186/s12913-021-07312-4 · Cited by 27 · see citing works
Verhofstadt, M., Audenaert, K., Van den Broeck, K., Deliens, L., Mortier, F., Titeca, K., Pardon, K., & Chambaere, K. (2020) · BMC Psychiatry · doi:10.1186/s12888-020-02775-x · Cited by 28 · see citing works
Navinés, R., Olive, V., Hidalgo-Mazzei, D., Langohr, K., Vieta, E., & Martin-Santos, R. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1286101 · Cited by 15 · see citing works
Sidhu, S., Gonzalez, P. M., Petricone-Westwood, D., Brewis, C. S., Rabi, D. M., & Campbell, D. J. T. (2022) · Canadian Journal of Diabetes · doi:10.1016/j.jcjd.2021.09.125 · Cited by 5 · see citing works
- Authors
- Cunningham, C. T., Quan, H., Hemmelgarn, B., Noseworthy, T., Beck, C. A., Dixon, E., Samuel, S., Ghali, W. A., Sykes, L. L., & Jetté, N.
- Affiliations
- University of Calgary (CA)
- Corresponding author
- Cunningham, Ceara Tess
- ORCID
- Venue
- BMC Medical Research Methodology
- Published
- 2015-04-09
- Volume
- 15
- Issue
- 1
- Pages
- 32-32
- ISSN
- 1471-2288 (ISSN-L)
- PMC
- PMC4404667
- OpenAlex
- W1967747089
- Cited by
- 995
- References
- 48
- Citations by year
- 2026: 65 · 2025: 92 · 2024: 92 · 2023: 108 · 2022: 113 · 2021: 117 · 2020: 126 · 2019: 112 · 2018: 76 · 2017: 54 · 2016: 33 · 2015: 6
- FWCI
- 186.89
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- BMC Medical Research Methodology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- Alberta Innovates - Health Solutions
- Alberta Innovates
- Canadian Institutes of Health Research
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Physical Sciences › Mathematics › Statistics and Probability › Survey Sampling and Estimation Techniques
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Keywords
- survey response rates, online surveys, online survey participation, nonresponse, financial incentives, survey burden, specialty variation
- MeSH terms
- Adult, Canada, Female, Health Services Research, Humans, Male, Middle Aged, Physicians, Surveys and Questionnaires, Reimbursement Mechanisms, Chi-Square Distribution, Internet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
