Advantages and Limitations of the e-Delphi Technique: Implications for Health Education Researchers
The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
Abstract
In the last 30 years, the application of the Delphi technique has been increasing. With the recent availability and established popularity of Internet-based research tools, the Internet has been identified as a means for mitigating Delphi limitations, maximizing its advantages, and expanding the breadth of its application. The discourse on the application of “e-Delphi” has been speculative in nature, however, with pragmatic analysis of Internet-based Delphi administration being limited in scope. Concomitantly, methodological guidance for conducting the e-Delphi in health education is limited, with best-practice implementation strategies yet to emerge. This paper advances the understanding of the e-Delphi technique, contributes to the evolution of this Internet-based research methodology, and provides guidance for the e-Delphi researcher in health education. Further, it offers a contribution to the discourse about Internet-based inquiry generally, and on using the e-Delphi technique in health education specifically. The authors illustrate that e-Delphi has a range of benefits that are effective and efficient in assuaging traditional Delphi limitations; nevertheless, a set of methodological issues remain unaddressed and make apparent the need for future research investments to better understand and alleviate challenges presented for e-Delphi research in health education.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Qualitative Data Analysis: A Sourcebook of New Methods
Lotto, L. S., Miles, M. B., & Huberman, A. M. (1986) · Educational Evaluation and Policy Analysis · doi:10.2307/1163741 · Cited by 10,315
Ellison, N. B., Steinfield, C., & Lampe, C. (2007) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.2007.00367.x · Cited by 9,939 · cited 2×
“Bargh and McKenna,6 Engelberg and Sjöberg,7 Fogel et al.8 and Kraut et al.9 investigated the psychological implications of the Internet as a social venue. quan-Haase and Wellman10 and Ellison et al.11 considered the impact of the Internet on social networking and social support for building social capital.”
BackgroundQualitative Research: Consensus methods for medical and health services research
Jones, J., & Hunter, D. (1995) · BMJ · doi:10.1136/bmj.311.7001.376 · Cited by 3,471
The Delphi technique: myths and realities
Powell, C. (2003) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2003.02537.x · Cited by 2,584
Wright, K. B. (2006) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.2005.tb00259.x · Cited by 2,550 · cited 1×
“The use of email or an “e-survey” to collect data are now readily accepted tools facilitating rapid, simple, and inexpensive communication portals for collecting and managing data and participants.(25,26,27,28) Online focus groups, e-conferences, and interviews are bridging geographical, fiscal, and social gaps which…”
MethodEysenbach, G. (2001) · Journal of Medical Internet Research · doi:10.2196/jmir.3.2.e20 · Cited by 2,449
The Delphi Method: Techniques and Applications
J., J. E., Linstone, H. A., & Turoff, M. (1976) · Technometrics · doi:10.2307/1268751 · Cited by 2,228
Kraut, R., Kiesler, S., Boneva, B., Cummings, J., Helgeson, V., & Crawford, A. (2002) · Journal of Social Issues · doi:10.1111/1540-4560.00248 · Cited by 2,202
Elwyn, G. (2006) · BMJ · doi:10.1136/bmj.38926.629329.ae · Cited by 1,824
Current validity of the Delphi method in social sciences
Landeta, J. (2006) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2005.09.002 · Cited by 1,353
Bargh, J. A., & McKenna, K. Y. A. (2004) · Annual Review of Psychology · doi:10.1146/annurev.psych.55.090902.141922 · Cited by 1,307
The Delphi technique in health sciences education research
de Villiers, M. R., de Villiers, P. J. T., & Kent, A. P. (2005) · Medical Teacher · doi:10.1080/13611260500069947 · Cited by 1,006
Internet Communication and Qualitative Research: A Handbook for Researching Online
Mann, C., & Stewart, F. A. (2000) · Cited by 853
Internet Communication and Qualitative Research
Mann, C., & Stewart, F. (2000) · SAGE Publications Ltd eBooks · doi:10.4135/9781849209281 · Cited by 767
Measurement in Nursing and Health Research
Albert, N. M., & Ludwick, R. (2011) · Clinical Nurse Specialist · doi:10.1097/nur.0b013e318233ead4 · Cited by 767
World-Wide Web survey research: Benefits, potential problems, and solutions
Schmidt, W. C. (1997) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03204826 · Cited by 620 · cited 1×
“The use of email or an “e-survey” to collect data are now readily accepted tools facilitating rapid, simple, and inexpensive communication portals for collecting and managing data and participants.(25,26,27,28) Online focus groups, e-conferences, and interviews are bridging geographical, fiscal, and social gaps which…”
MethodDoing Internet Research: Critical Issues and Methods for Examining the Net
Jones, S. (1999) · Sage eBooks · doi:10.4135/9781452231471 · Cited by 578
Psychological Experiments on the Internet
(2000) · Elsevier eBooks · doi:10.1016/b978-0-12-099980-4.x5000-x · Cited by 463
A Generic Toolkit for the Successful Management of Delphi Studies
Day, J., & Bobeva, M. (2005) · The Electronic Journal of Business Research Methods · Cited by 422
Library and information science research
Bawden, D. (2005) · Journal of Documentation · doi:10.1108/jd.2005.27861bae.001 · Cited by 402
The Delphi method and health research
de Meyrick, J. (2003) · Health Education · doi:10.1108/09654280310459112 · Cited by 397
Internet Inquiry: Conversations About Method
Markham, A., & Baym, N. (2009) · Sage eBooks · doi:10.4135/9781483329086 · Cited by 385
Internet Use, Social Skills, and Adjustment
Engelberg, E., & Sjöberg, L. (2004) · CyberPsychology & Behavior · doi:10.1089/109493104322820101 · Cited by 356
Internet Use for Health Information Among College Students
Escoffery, C., Miner, K. R., Adame, D. D., Butler, S., McCormick, L., & Mendell, E. (2005) · Journal of American College Health · doi:10.3200/jach.53.4.183-188 · Cited by 355
Moving best practice forward: Delphi characteristics, advantages, potential problems, and solutions
Donohoe, H. M., & Needham, R. D. (2009) · International Journal of Tourism Research · doi:10.1002/jtr.709 · Cited by 335
Self-citationLeung, L., & Lee, P. S. N. (2005) · Telematics and Informatics · doi:10.1016/j.tele.2004.04.003 · Cited by 331
Health Communication on the Internet: An Effective Channel for Health Behavior Change?
JACKS, M. M. C. C. (1998) · Journal of Health Communication · doi:10.1080/108107398127517 · Cited by 283
How Does the Internet Affect Social Capital?
Quan-Haase, A., & Wellman, B. (2004) · Social Capital and Information Technology · doi:10.7551/mitpress/6289.003.0007 · Cited by 271
Towards geographies of cyberspace
Kitchin, R. M. (1998) · Progress in Human Geography · doi:10.1191/030913298668331585 · Cited by 243
Participatory Epidemiology: Use of Mobile Phones for Community-Based Health Reporting
Freifeld, C. C., Chunara, R., Mekaru, S. R., Chan, E. H., Kass-Hout, T., Ayala Iacucci, A., & Brownstein, J. S. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000376 · Cited by 241
Health on the Internet: implications for health promotion
Korp, P. (2006) · Health Education Research · doi:10.1093/her/cyh043 · Cited by 222
Internet use and social support in women with breast cancer.
Fogel, J., Albert, S. M., Schnabel, F., Ditkoff, B. A., & Neugut, A. I. (2002) · Health Psychology · doi:10.1037//0278-6133.21.4.398 · Cited by 214
Internet-Based Data Collection: Promises and Realities
Benfield, J. A., & Szlemko, W. J. (2006) · Journal of research practice · Cited by 213
Orgad, S. (2009) · Sage eBooks · doi:10.4135/9781483329086.n4 · Cited by 202
Research techniques for the health sciences
Neutens, J. J., & Rubinson, L. G. (1987) · Cited by 186
Methodological Issues In Web‐based Research
Duffy, M. E. (2002) · Journal of Nursing Scholarship · doi:10.1111/j.1547-5069.2002.00083.x · Cited by 148
Introduction to psychological experiments on the internet
Birnbaum, M. H. (2000) · Elsevier eBooks · doi:10.1016/b978-012099980-4/50001-0 · Cited by 139
The Delphi Technique: An Empirical Evaluation of the Optimal Number of Rounds
Erffmeyer, R. C., Erffmeyer, E. S., & Lane, I. M. (1986) · Group & Organization Studies · doi:10.1177/105960118601100110 · Cited by 130
Brouwer, W., Oenema, A., Crutzen, R., de Nooijer, J., de Vries, N. K., & Brug, J. (2008) · Journal of Medical Internet Research · doi:10.2196/jmir.956 · Cited by 115 · cited 1×
“In the 46 articles where the Internet was used to support, facilitate, or enable Delphi inquiry, the primary Internet function was as an email portal through which surveys were delivered and responses were collected.(57,58,59) Two articles report using web pages for posting and sharing Delphi reports and resources wit…”
“Focus groups in cyberspace”: using the Internet for qualitative research
O’Connor, H., & Madge, C. (2003) · Qualitative Market Research: An International Journal · doi:10.1108/13522750310470190 · Cited by 108
An Experimental Comparison of Computer-Mediated and Face-to-Face Focus Groups
Underhill, C. M., & Olmsted, M. G. (2003) · Social Science Computer Review · doi:10.1177/0894439303256541 · Cited by 108
Using Internet Discussion Boards as Virtual Focus Groups
Moloney, M. F., Dietrich, A. S., Strickland, O. L., & Myerburg, S. (2003) · Advances in Nursing Science · doi:10.1097/00012272-200310000-00005 · Cited by 107
Witmer, D. F., Colman, R. W., & Katzman, S. L. (1999) · Sage eBooks · doi:10.4135/9781452231471.n7 · Cited by 105
Internet-delivered interventions aimed at adolescents: a Delphi study on dissemination and exposure
Crutzen, R., de Nooijer, J., Brouwer, W., Oenema, A., Brug, J., & de Vries, N. K. (2008) · Health Education Research · doi:10.1093/her/cym094 · Cited by 103
Ginossar, T., & Nelson, S. (2010) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.2009.01513.x · Cited by 84
Nurse practitioner practice and deployment: electronic mail Delphi study
Marsden, J., Dolan, B., & Holt, L. (2003) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2003.02758.x · Cited by 78
Banks, D. E., Shi, R., McLarty, J. W., Cowl, C. T., Smith, D. D., Tarlo, S. M., Daroowalla, F., Balmes, J. R., & Baumann, M. H. (2009) · CHEST Journal · doi:10.1378/chest.08-1345 · Cited by 76
The Cyber-Ethnographic (Re)Construction of Two Feminist Online Communities
Ward, K. J. (1999) · Sociological Research Online · doi:10.5153/sro.222 · Cited by 75
McBride, A. J., Pates, R. M., Ramadan, R., & McGowan, C. (2003) · Addiction · doi:10.1046/j.1360-0443.2003.00345.x · Cited by 67
MacEachren, A. M., Pike, W., Yu, C., Brewer, I., GAHEGAN, M. N., Weaver, S. D., & Yarnal, B. (2006) · Computers Environment and Urban Systems · doi:10.1016/j.compenvurbsys.2005.10.005 · Cited by 58
Snyder‐Halpern, R., Thompson, C. B., & Schaffer, J. (2000) · PubMed · Cited by 53
Health education and the Internet: the beginning of a revolution
Bernhardt, J. M. (2001) · Health Education Research · doi:10.1093/her/16.6.643 · Cited by 51
Suarez‐Balcazar, Y., Balcázar, F. E., & Taylor‐Ritzler, T. (2009) · Cultural Diversity & Ethnic Minority Psychology · doi:10.1037/a0013179 · Cited by 45
USING INTERNET-BASED SURVEYS FOR ACADEMIC RESEARCH: OPPORTUNITIES AND PROBLEMS
Roztocki, N. (2001) · Cited by 40
Online research to guide knowledge management planning
Atkinson, N. L., & Gold, R. S. (2001) · Health Education Research · doi:10.1093/her/16.6.747 · Cited by 33
Tjia, J., Field, T. S., Garber, L., Donovan, J. L., Kanaan, A. O., Raebel, M. A., Zhao, Y., Fuller, J. C., Gagne, S. J., Fischer, S. H., et al. (2010) · PubMed · Cited by 26
The Digital Divide in Health Education: Myth or Reality?
Stellefson, M., Chaney, B., & Chaney, D. (2008) · American Journal of Health Education · doi:10.1080/19325037.2008.10599023 · Cited by 23 · cited 2×
“and Stellefson et al.(16) examined the efficacy of ‘e-health’ applications for a variety of individuals and populations.”
BackgroundSelf-citationOestergaard, S., & Møldrup, C. (2010) · Public Health Genomics · doi:10.1159/000313467 · Cited by 10
Librarians' responses to “reading at risk”: A Delphi study
Du, Y. (2009) · Library & Information Science Research · doi:10.1016/j.lisr.2008.10.006 · Cited by 10
Research portals in the arts and humanities
Brown, S. C., & Greengrass, M. (2009) · Literary and Linguistic Computing · doi:10.1093/llc/fqp032 · Cited by 6
(1975) · Bibliothèque et Archives nationales du Québec (Québec government)
Cited by
Use of Delphi in health sciences research: A narrative review
Shang, Z. (2023) · Medicine · doi:10.1097/md.0000000000032829 · Cited by 657
Psychotherapy in 2022: A Delphi poll on its future.
Norcross, J. C., Pfund, R. A., & Prochaska, J. O. (2013) · Professional Psychology: Research and Practice · doi:10.1037/a0034633 · Cited by 162
Wallace, S. J., Worrall, L., Rose, T., & Le Dorze, G. (2016) · American Journal of Speech-Language Pathology · doi:10.1044/2016_ajslp-15-0150 · Cited by 54
Metadata
- Authors
- Donohoe, H., Stellefson, M., & Tennant, B.
- Venue
- American Journal of Health Education
- Publisher
- Informa UK Limited
- Published
- 2012-01
- Volume
- 43
- Issue
- 1
- Pages
- 38-46
- ISSN
- 1932-5037 (ISSN-L)
- 2168-3751
- OpenAlex
- W1777152392
- Cited by
- 282
- References
- 61
- FWCI
- 5.29
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.