The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Moving best practice forward: Delphi characteristics, advantages, potential problems, and solutions
Abstract
In the last 30 years, there has been increasing application of the Delphi technique to tourism research. However, mystification regarding Delphi characteristics and procedures is evident in the literature. Through critical examination, this paper seeks to demystify the Delphi and advance understanding of the technique, contribute to the evolution of methodological guidelines, and provide further guidance to tourism researchers. A generic Delphi procedure is introduced, a critical review of its advantages and potential problems is presented, and critical design decisions are identified. Expert panel design and management are emphasised through example and critical review. Copyright © 2008 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An Experimental Application of the DELPHI Method to the Use of Experts
Dalkey, N., & Helmer, O. (1963) · Management Science · doi:10.1287/mnsc.9.3.458 · Cited by 6,061
the delphi method: techniques and applications
Linstone, H. A., & Turoff, M. (1975) · Bibliothèque et Archives nationales du Québec (Québec government) · Cited by 5,231
The Delphi method as a research tool: an example, design considerations and applications
Okoli, C., & Pawlowski, S. D. (2004) · Information & Management · doi:10.1016/j.im.2003.11.002 · Cited by 4,771
Group Techniques for Program Planning: A Guide to Nominal Group and Delphi Processes
(1976) · The Journal of Applied Behavioral Science · doi:10.1177/002188637601200414 · Cited by 2,813
The Delphi technique: myths and realities
Powell, C. (2003) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2003.02537.x · Cited by 2,584
The Delphi Method: Techniques and Applications
J., J. E., Linstone, H. A., & Turoff, M. (1976) · Technometrics · doi:10.2307/1268751 · Cited by 2,228
The Delphi technique as a forecasting tool: issues and analysis
Rowe, G., & Wright, G. (1999) · International Journal of Forecasting · doi:10.1016/s0169-2070(99)00018-7 · Cited by 1,789
CRISP, J., PELLETIER, D., DUFFIELD, C., ADAMS, A., & NAGY, S. (1997) · Nursing Research · doi:10.1097/00006199-199703000-00010 · Cited by 1,388
Current validity of the Delphi method in social sciences
Landeta, J. (2006) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2005.09.002 · Cited by 1,353
Research Methods for Leisure and Tourism: A Practical Guide
Veal, A. J. (1997) · Cited by 1,118
Sustainability indicators for managing community tourism
Choi, H. C., & Sirakaya, E. (2006) · Tourism Management · doi:10.1016/j.tourman.2005.05.018 · Cited by 1,099
The Delphi technique in health sciences education research
de Villiers, M. R., de Villiers, P. J. T., & Kent, A. P. (2005) · Medical Teacher · doi:10.1080/13611260500069947 · Cited by 1,006
Infotopia How Many Minds Produce Knowledge
Sunstein, C. R. (2006) · doi:10.1093/oso/9780195189285.001.0001 · Cited by 913
Tourism: Change, Impacts and Opportunities
Wall, G. C., & Mathieson, A. (2007) · Cited by 756
Delphi: A reevaluation of research and theory
Rowe, G., Wright, G., & Bolger, F. (1991) · Technological Forecasting and Social Change · doi:10.1016/0040-1625(91)90039-i · Cited by 731
Miller, G. (2001) · Tourism Management · doi:10.1016/s0261-5177(00)00067-4 · Cited by 604
Turoff, M. (1970) · Technological Forecasting and Social Change · doi:10.1016/0040-1625(70)90161-7 · Cited by 597
Garrod, B., & Fyall, A. (2000) · Annals of Tourism Research · doi:10.1016/s0160-7383(99)00094-8 · Cited by 595
Mullen, P. M. (2003) · Journal of Health Organization and Management · doi:10.1108/14777260310469319 · Cited by 574
Qualitative Research in Tourism
(2004) · Routledge eBooks · doi:10.4324/9780203642986 · Cited by 496
Tsaur, S., Lin, Y.-C., & Lin, J.-H. (2005) · Tourism Management · doi:10.1016/j.tourman.2005.02.006 · Cited by 436
Travel, tourism and hospitality research: A handbook for managers and researchers
Getz, D. (1987) · Annals of Tourism Research · doi:10.1016/0160-7383(87)90077-6 · Cited by 403
The Delphi method and health research
de Meyrick, J. (2003) · Health Education · doi:10.1108/09654280310459112 · Cited by 397
The Delphi and nominal group techniques in health services research
Cantrill, J. A., Sibbald, B., & Buetow, S. (2011) · International Journal of Pharmacy Practice · doi:10.1111/j.2042-7174.1996.tb00844.x · Cited by 392
Cultural tourism: global and local perspectives
(2007) · Choice Reviews Online · doi:10.5860/choice.45-2102 · Cited by 356
Delphi Assessment: Expert Opinion, Forecasting, and Group Process
Sackman, H. (1974) · Defense Technical Information Center (DTIC) · Cited by 290
A Generic Toolkit for the Successful Management of Delphi Studies
Day, J., & Bobeva, M. (2005) · The Electronic Journal of Business Research Methods · Cited by 278
Twiss, B. C. (1979) · Long Range Planning · doi:10.1016/0024-6301(79)90130-4 · Cited by 260
An evaluation methodology for hotel electronic channels of distribution
O’Connor, P., & Frew, A. J. (2004) · International Journal of Hospitality Management · doi:10.1016/j.ijhm.2003.10.002 · Cited by 172
Participants' response to the Delphi method: An attitudinal perspective
Bardecki, M. (1984) · Technological Forecasting and Social Change · doi:10.1016/0040-1625(84)90006-4 · Cited by 164
The prediction of air travel and aircraft technology to the year 2000 using the Delphi method
English, J. M., & Kernan, G. L. (1976) · Transportation Research · doi:10.1016/0041-1647(76)90094-0 · Cited by 155
The Delphi technique in the measurement of tourism market potential
Kaynak, E., & Macaulay, J. A. (1984) · Tourism Management · doi:10.1016/0261-5177(84)90056-6 · Cited by 150
Linstone, H. A. (1985) · Springer eBooks · doi:10.1007/978-3-642-70634-9_22 · Cited by 148
Assessing the environmental impact of tourism development
Green, H., Hunter, C., & Moore, B. (1990) · Tourism Management · doi:10.1016/0261-5177(90)90026-6 · Cited by 122
The use of the Delphi as a research approach
Mead, D., & Moseley, L. G. (2001) · Nurse Researcher · doi:10.7748/nr2001.07.8.4.4.c6162 · Cited by 115
Relationship Marketing in 2015:
Bonnemaizon, A., Covà, B., & Louyot, M.-C. (2007) · European Management Journal · doi:10.1016/j.emj.2006.12.002 · Cited by 113
Perspectives on Tourism Policy
Johnson, P. E., & Thomas, B. (1993) · Cited by 110
Using the Delphi Technique to Predict Future Tourism Potential
Kaynak, E., Bloom, J. Z., & Leibold, M. (1994) · Marketing Intelligence & Planning · doi:10.1108/02634509410065537 · Cited by 109
Nature-based Tourism and Environmental Sustainability in South Africa
Spenceley, A. (2005) · Journal of Sustainable Tourism · doi:10.1080/09669580508668483 · Cited by 109
THE POLICY DELPHI: PURPOSE, STRUCTURE, AND APPLICATION
Needham, R. D., & de Loë, R. C. (1990) · Canadian Geographies / Géographies canadiennes · doi:10.1111/j.1541-0064.1990.tb01258.x · Cited by 108
Self-citationFive Open Questions About Prediction MarketsPreprint
Wolfers, J. J., & Zitzewitz, E. W. (2006) · SSRN Electronic Journal · doi:10.2139/ssrn.884483 · Cited by 83
Revisiting Delphi: the Delphi technique in tourism research.
(2005) · doi:10.1079/9780851999968.0085 · Cited by 82
Delphi study of the future of marketing of higher education
Hayes, T. (2007) · Journal of Business Research · doi:10.1016/j.jbusres.2006.12.009 · Cited by 82
Directions in Delphi developments: Dissertations and their quality
Rieger, W. (1986) · Technological Forecasting and Social Change · doi:10.1016/0040-1625(86)90063-6 · Cited by 82
Delphi Forecasts of Land Use: Transportation Interactions
Cavalli‐Sforza, V., & Ortolano, L. (1984) · Journal of Transportation Engineering · doi:10.1061/(asce)0733-947x(1984)110:3(324 · Cited by 80
Application of the Delphi technique in tourism
Green, H., Hunter, C., & Moore, B. (1990) · Annals of Tourism Research · doi:10.1016/0160-7383(90)90087-8 · Cited by 72
Managerial Judgment in Marketing: The Concept of Expertise
Larréché, J.-C., & Moinpour, R. (1983) · Journal of Marketing Research · doi:10.1177/002224378302000202 · Cited by 68
Scientific inquiry or political critique?
Goldschmidt, P. G. (1975) · Technological Forecasting and Social Change · doi:10.1016/0040-1625(75)90059-1 · Cited by 67
Application of the Delphi Technique to Rural Tourism Project Evaluation
Briedenhann, J., & Butts, S. (2006) · Current Issues in Tourism · doi:10.1080/13683500608668246 · Cited by 67
Stakeholders or subject matter experts, who should be consulted?
Alberts, D. J. (2006) · Energy Policy · doi:10.1016/j.enpol.2006.08.006 · Cited by 50
Absorptive capacity in European manufacturing: a Delphi study
Jung-Erceg, P., Pandža, K., Armbruster, H., & Dreher, C. (2007) · Industrial Management & Data Systems · doi:10.1108/02635570710719043 · Cited by 44
Assessing the environmental impact of tourism development: the use of the Delphi technique
Green, H., Hunter, C., & Moore, B. (1989) · International Journal of Environmental Studies · doi:10.1080/00207238908710549 · Cited by 36
An Integrative Approach to Tourism Forecasting: A Glance in the Rearview Mirror
Tideswell, C., Mules, T., & Faulkner, B. (2001) · Journal of Travel Research · doi:10.1177/004728750104000207 · Cited by 35
Hawaii tourism to the year 2000
Liu, J. C. (1988) · Tourism Management · doi:10.1016/0261-5177(88)90002-7 · Cited by 33
Commentaries on “The Delphi technique as a forecasting tool: issues and analysis” by Rowe and Wright
Ayton, P., Ferrell, W. R., & Stewart, T. R. (1999) · International Journal of Forecasting · doi:10.1016/s0169-2070(99)00013-8 · Cited by 32
Developing community participation and consensus : the delphi technique
Andranovich, G. (1995) · Research Exchange (Washington State University) · Cited by 29
Delphi methodologies: A review and critique
Murray, T. J. (1979) · Urban Systems · doi:10.1016/0147-8001(79)90013-5 · Cited by 28
The Opt‐in/Opt‐out Feature in a Multi‐Stage Delphi Method Study
Brown, C. A. (2007) · International Journal of Social Research Methodology · doi:10.1080/13645570701334084 · Cited by 23
Managing sustainable nature-based tourism in southern Africa: A practical assessment tool
Spenceley, A. (2003) · OpenGrey (Institut de l'Information Scientifique et Technique) · doi:10.13140/rg.2.1.4495.0889 · Cited by 11
Research works printed but not linked: 33
- 10.1016/0143-2516(80)90016-X · doi:10.1016/0143-2516(80)90016-x
- 10.1016/0016-3287(92)90033-C · doi:10.1016/0016-3287(92)90033-c
- Bramante AC, 1989, Recreation and Leisure Studies in Brazil: A Delphi Approach
- 10.1108/07363769810219125 · doi:10.1108/07363769810219125
- Donohoe H, 2007, Leisure in Context: Implications for Human Development and Well‐Being, 181
- Duboff RS, 2007, The wisdom of (expert) crowds, Harvard Business Review
- Garrod B, 2003, Marine Ecotourism: Issues and Experiences, 17, 10.21832/9781873150436-005 · doi:10.21832/9781873150436-005
- 10.1007/s002670010217 · doi:10.1007/s002670010217
- 10.1007/s11205-006-9022-1 · doi:10.1007/s11205-006-9022-1
- Hurd A, 2004, An analysis of the perceived competencies of CEOs in public park and recreation agencies, 96
- 10.1177/0047287506291595 · doi:10.1177/0047287506291595
- 10.1016/j.landusepol.2005.08.001 · doi:10.1016/j.landusepol.2005.08.001
- Lang T, 1995, An overview of four futures methodologies, Manoa, 7, 1
- 10.2307/3151678 · doi:10.2307/3151678
- Linstone HA, 2002, The Delphi Approach: Techniques and Applications, 559
- Linstone HA, 1977, Future Research: New Directions
- Linstone HA, 2002, The Delphi Approach: Techniques and Applications, 71
- 10.1177/004728750003800409 · doi:10.1177/004728750003800409
- 10.1016/0040-1625(80)90036-0 · doi:10.1016/0040-1625(80)90036-0
- McKercher B, 2002, The Partnership Between Tourism and Cultural Heritage Management, 11
- MillerGA.2001a.The development of indicators for the promotion of sustainable tourism. Unpublished Doctoral Thesis University of Surrey UK.
- MoellerGH1975.The Delphi technique: an approach to identifying events that will shape the future of outdoor recreation. Indicators of Change in the Recreation Environment: A National Research Symposium Conference Proceedings:211–218. Harrisburg Pennsylvania 1975.
- 10.1002/(SICI)1099-1603(199603)2:1<27::AID-PTH29>3.0.CO;2-P · doi:10.1002/(sici)1099-1603(199603)2:1<27::aid-pth29>3.0.co;2-p
- Ritchie JRB, 1994, Travel, Tourism and Hospitality Research
- Rosenthal EJ, 1976, Encyclopaedia of Educational Evaluation, 121
- Seely RL, 1980, Utilising the Delphi technique at international conferences: a method for forecasting international tourism conditions, Travel Research Journal, 1, 30
- Taylor RE, 1994, Tourism Marketing and Management Handbook, 535
- VaugeoisN RollinsR HammerK RandallC ClarkB BalmerK.2005.Realizing improved knowledge transfer in the leisure industry: a new agenda and strategies to link researchers and professionals. Travel and Tourism Research Association Canada Chapter Conference Proceedings (2005) Kelowna BC Canada 2005.
- 10.1177/0047287503257489 · doi:10.1177/0047287503257489
- 10.1016/0261-5177(90)90027-7 · doi:10.1016/0261-5177(90)90027-7
- WolfersJ ZitzewitzE(2004) Prediction Markets. NBER Working Paper No. W10504. Available at:http://ssrn.com/abstract=552109
- 10.1016/j.jclepro.2005.12.007 · doi:10.1016/j.jclepro.2005.12.007
- 10.1108/03090569010001051 · doi:10.1108/03090569010001051
Cited by
Ahmadi, A., Noetel, M., Parker, P., Ryan, R. M., Ntoumanis, N., Reeve, J., Beauchamp, M., Dicke, T., Yeung, A., Ahmadi, M., et al. (2023) · Journal of Educational Psychology · doi:10.1037/edu0000783 · Cited by 476
Forecasting tourism recovery amid COVID-19
Zhang, H., Song, H., Wen, L., & Liu, C. (2021) · Annals of Tourism Research · doi:10.1016/j.annals.2021.103149 · Cited by 402
The Delphi technique in ecology and biological conservation: applications and guidelines
Mukherjee, N., Hugé, J., Sutherland, W. J., McNeill, J., Van Opstal, M., Dahdouh‐Guebas, F., & Koedam, N. (2015) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12387 · Cited by 381
Consensus in the delphi method: What makes a decision change?
Barrios, M., Guilera, G., Nuño, L., & Gómez-Benito, J. (2021) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2020.120484 · Cited by 377
Smart destinations and the evolution of ICTs: a new scenario for destination management?
Ivars-Baidal, J. A., Celdrán-Bernabeu, M. A., Mazón, J.-N., & Perles-Ivars, Á. F. (2019) · Current Issues in Tourism · doi:10.1080/13683500.2017.1388771 · Cited by 364
Metadata
- Authors
- Donohoe, H. M., & Needham, R. D.
- Venue
- International Journal of Tourism Research
- Publisher
- Wiley
- Published
- 2008-12-02
- Volume
- 11
- Issue
- 5
- Pages
- 415-437
- ISSN
- 1099-2340 (ISSN-L)
- 1522-1970
- OpenAlex
- W2091344210
- Cited by
- 335
- References
- 59
- FWCI
- 17.42
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.