Using the Internet to conduct surveys of health professionals: a valid alternative?
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: The purpose of this study was to examine whether Internet-based surveys of health professionals can provide a valid alternative to traditional survey methods. METHODS: (i) Systematic review of published Internet-based surveys of health professionals focusing on criteria of external validity, specifically sample representativeness and response bias. (ii) Internet-based survey of GPs, exploring attitudes about using an Internet-based decision support system for the management of familial cancer. RESULTS: The systematic review identified 17 Internet-based surveys of health professionals. Whilst most studies sampled from professional e-directories, some studies drew on unknown denominator populations by placing survey questionnaires on open web sites or electronic discussion groups. Twelve studies reported response rates, which ranged from nine to 94%. Sending follow-up reminders resulted in a substantial increase in response rates. In our own survey of GPs, a total of 268 GPs participated (adjusted response rate = 52.4%) after five e-mail reminders. A further 72 GPs responded to a brief telephone survey of non-respondents. Respondents to the Internet survey were more likely to be male and had significantly greater intentions to use Internet-based decision support than non-respondents. CONCLUSIONS: Internet-based surveys provide an attractive alternative to postal and telephone surveys of health professionals, but they raise important technical and methodological issues which should be carefully considered before widespread implementation. The major obstacle is external validity, and specifically how to obtain a representative sample and adequate response rate. Controlled access to a national list of NHSnet e-mail addresses of health professionals could provide a solution.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Communication breakdown in the outpatient referral process
Gandhi, T. K., Sittig, D. F., Franklin, M., Sussman, A. J., Fairchild, D. G., & Bates, D. W. (2000) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2000.91119.x · Cited by 371
Methods for the Design and Administration of Web-based Surveys
Schleyer, T. K. L., & Forrest, J. L. (2000) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2000.0070416 · Cited by 304
General practice postal surveys: a questionnaire too far?
McAvoy, B. R., & Kaner, E. F. S. (1996) · BMJ · doi:10.1136/bmj.313.7059.732 · Cited by 282
Wyatt, J. C. (2000) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2000.0070426 · Cited by 264
Survey of doctors’ experience of patients using the Internet
Potts, H. W. W., & Wyatt, J. C. (2002) · Journal of Medical Internet Research · doi:10.2196/jmir.4.1.e5 · Cited by 190
E-mail Versus Conventional Postal Mail Survey of Geriatric Chiefs
Raziano, D. B., Jayadevappa, R., Valenzula, D., Weiner, M. G., & Lavizzo‐Mourey, R. J. (2001) · The Gerontologist · doi:10.1093/geront/41.6.799 · Cited by 115
Health surveys via the Internet: Quick and dirty or rapid and robust?
Fischbacher, C., Chappel, D., Edwards, R., & Summerton, N. (2000) · Journal of the Royal Society of Medicine · doi:10.1177/014107680009300705 · Cited by 38
Braithwaite, D. (2002) · Family Practice · doi:10.1093/fampra/19.6.587 · Cited by 37
Self-citationEpidemiological data can be gathered with world wide web
Eysenbach, G., & Diepgen, T. L. (1998) · BMJ · doi:10.1136/bmj.316.7124.72 · Cited by 33
Cited by
A guide for the design and conduct of self-administered surveys of clinicians
Burns, K. E. A., Duffett, M., Kho, M. E., Meade, M. O., Adhikari, N. K. J., Sinuff, T., Cook, D. J., & for the ACCADEMY Group (2008) · Canadian Medical Association Journal · doi:10.1503/cmaj.080372 · Cited by 1,354
Web Surveys versus other Survey Modes: A Meta-Analysis Comparing Response Rates
Manfreda, K. L., Bosnjak, M., Berzelak, J., Haas, I., & Vehovar, V. (2008) · International Journal of Market Research · doi:10.1177/147078530805000107 · Cited by 1,000
Exploring physician specialist response rates to web-based surveys
Cunningham, C. T., Quan, H., Hemmelgarn, B., Noseworthy, T., Beck, C. A., Dixon, E., Samuel, S., Ghali, W. A., Sykes, L. L., & Jetté, N. (2015) · BMC Medical Research Methodology · doi:10.1186/s12874-015-0016-z · Cited by 995
Methodologies for Improving Response Rates in Surveys of Physicians: A Systematic Review
VanGeest, J. B., Johnson, T. P., & Welch, V. L. (2007) · Evaluation & the Health Professions · doi:10.1177/0163278707307899 · Cited by 695
Web-based Questionnaires: The Future in Epidemiology?
van Gelder, M. M. H. J., Bretveld, R. W., & Roeleveld, N. (2010) · American Journal of Epidemiology · doi:10.1093/aje/kwq291 · Cited by 580
Quality of life and psychological well being in polycystic ovary syndrome
Barnard, L., Ferriday, D., Guenther, N., Strauss, B., Balen, A. H., & Dye, L. (2007) · Human Reproduction · doi:10.1093/humrep/dem108 · Cited by 388
Cannesson, M., Pestel, G., Ricks, C., Hoeft, A., & Perel, A. (2011) · Critical Care · doi:10.1186/cc10364 · Cited by 310
Stress, coping, and barriers to wellness among psychology graduate students.
El-Ghoroury, N. H., Galper, D. I., Sawaqdeh, A., & Bufka, L. F. (2012) · Training and Education in Professional Psychology · doi:10.1037/a0028768 · Cited by 274
Surveying Clinicians by Web: Current Issues in Design and Administration
Dykema, J., Jones, N. R., Piché, T., & Stevenson, J. (2013) · Evaluation & the Health Professions · doi:10.1177/0163278713496630 · Cited by 232
“In general, technical inconsistencies or problems, such as the lack of compatibility across web browsers used by respondents, can be barriers to accessing, viewing, completing, or submitting a web questionnaire (Braithwaite et al., 2003; Guise, Chambers, Välimäki, & Makkonen, 2010; Leece et al., 2004).”
BackgroundFeasibility of Using Web-based Questionnaires in Large Population-based Epidemiological Studies
Ekman, A., Dickman, P. W., Klint, Å., Weiderpass, E., & Litton, J.-E. (2006) · European Journal of Epidemiology · doi:10.1007/s10654-005-6030-4 · Cited by 221
“Although a fast developing field where many research initiatives are undertaken, previous studies have not been population-based, respondents were often self-selected and the findings therefore difficult to generalize [5–13].”
BackgroundCook, D. A., Wittich, C. M., Daniels, W. L., West, C. P., Harris, A. M., & Beebe, T. J. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.6318 · Cited by 203
McRobert, C. J., Hill, J. C., Smale, T., Hay, E. M., & van der Windt, D. A. (2018) · PLOS ONE · doi:10.1371/journal.pone.0200184 · Cited by 125
Internet-based randomized controlled trials: a systematic review
Mathieu, E., McGeechan, K., Barratt, A., & Herbert, R. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-001175 · Cited by 98
Survey Methods to Optimize Response Rate in the National Dental Practice-Based Research Network
Funkhouser, E., Vellala, K., Baltuck, C., Cacciato, R., Durand, E., McEdward, D., Sowell, E., Theisen, S. E., Gilbert, G. H., & National Dental PBRN Collaborative Group (2017) · Evaluation & the Health Professions · doi:10.1177/0163278715625738 · Cited by 82
Measures of the Degree of Departure from Ignorable Sample Selection
Little, R. J. A., West, B. T., Boonstra, P. S., & Hu, J. (2020) · Journal of Survey Statistics and Methodology · doi:10.1093/jssam/smz023 · Cited by 47
Current Uses (and Potential Misuses) of Facebook: An Online Survey in Physiotherapy
Laliberté, M., Beaulieu-Poulin, C., Campeau Larrivée, A., Charbonneau, M., Samson, É., & Ehrmann Feldman, D. (2016) · Physiotherapy Canada · doi:10.3138/ptc.2014-41 · Cited by 20
Are They Still Friends? Friendship Stability of Adolescents With Chronic Pain: 1-Year Follow-Up
Forgeron, P. A., Dick, B. D., Chambers, C., Cohen, J., Lamontagne, C., & Finley, G. A. (2022) · Frontiers in Pain Research · doi:10.3389/fpain.2021.767236 · Cited by 12
“An additional advantage of using REDCap was that it permitted the direct export of data into the data analysis software and generated reports on open-ended questions (30).”
MethodHyperpersonal feedback and online romance fraud: an empirical examination
Wang, F., & Dickinson, T. (2025) · Journal of Crime and Justice · doi:10.1080/0735648x.2024.2376700 · Cited by 9
“Sending follow-up messages or emails has been found to significantly increase response rates in surveys and everyday communications (Braithwaite et al. 2003; Erdogan and Baker 2002; Smith et al. 2019; Sharma 2022).”
Participation Rates in 11 National Dental Practice-Based Research Network Surveys 2014–2022
Funkhouser, E., Mungia, R., Laws, R., Nyongesa, D. B., Gillespie, S., Leo, M. C., McBurnie, M. A., Gilbert, G. H., & National Dental PBRN Collaborative Group (2025) · Evaluation & the Health Professions · doi:10.1177/01632787241259186 · Cited by 5
“Although administering questionnaires to physicians on the telephone has not been successful, namely, low response rate [and expensive] (Cho et al., 2013), telephone reminders to non-responders have been effective in increasing participation (Barnhart et al., 2023; Braithwaite et al., 2003).”
Essel, K., Burke, M., Fischer, L., Weissman, M., & Dietz, W. (2024) · Children · doi:10.3390/children11091147 · Cited by 3
“Consistent with prior studies surveying physicians, we encountered a low response rate [41].”
Result
Metadata
- Authors
- Braithwaite, D., Emery, J., de Lusignan, S., & Sutton, S.
- Venue
- Family Practice
- Publisher
- Oxford University Press (OUP)
- Published
- 2003-10
- Volume
- 20
- Issue
- 5
- Pages
- 545-551
- ISSN
- 0263-2136 (ISSN-L)
- 1460-2229
- OpenAlex
- W2125172680
- Cited by
- 474
- References
- 9
- FWCI
- 46.26
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.