The DOI matches its Crossref record; 74 of the 74 references it cites were found in a registry or an index.
The Delphi technique in ecology and biological conservation: applications and guidelines
Open accessAbstract
Summary: Many areas of science, including conservation and environmental management, regularly require engaging stakeholders or experts to produce consensus or technical inputs. The Delphi technique is an iterative and anonymous participatory method used for gathering and evaluating such expert‐based knowledge. We outline the methodology of the Delphi technique and provide a taxonomy of its main variants. In addition, we refine the technique by providing suggestions to address common limitations (e.g. time consumption, attrition rate) in order to make the method more suitable for application in ecology and conservation. A comprehensive search for studies that have applied the Delphi technique in conservation and environmental management resulted in 36 papers. The Delphi technique has been applied to a range of issues, including developing decision support systems and predicting ecological impacts of climate change. The papers reviewed suggest that the Delphi technique is an efficient, inclusive, systematic and structured approach that can be used to address complex issues. A major strength compared to other group‐based techniques is the reduced influence of social pressures among respondents. The Delphi technique is relatively little used and seems undervalued. Given its wide range of possible applications, it could be applied more widely in evaluating evidence and providing expert judgments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1932) · Medical Entomology and Zoology · Cited by 9,568
An Experimental Application of the DELPHI Method to the Use of Experts
Dalkey, N., & Helmer, O. (1963) · Management Science · doi:10.1287/mnsc.9.3.458 · Cited by 6,061
Research guidelines for the Delphi survey technique
Hasson, F. (2000) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2000.01567.x · Cited by 5,951
Diamond, I. R., Grant, R. C., Feldman, B. M., Pencharz, P. B., Ling, S. C., Moore, A. M., & Wales, P. W. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.12.002 · Cited by 3,740
Methods of data collection in qualitative research: interviews and focus groups
Gill, P., Stewart, K., Treasure, E., & Chadwick, B. (2008) · British Dental Journal · doi:10.1038/bdj.2008.192 · Cited by 2,685
The Delphi technique: myths and realities
Powell, C. (2003) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2003.02537.x · Cited by 2,584
The halo effect: Evidence for unconscious alteration of judgments.
Nisbett, R. E., & Wilson, T. D. (1977) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.35.4.250 · Cited by 2,021
Consensus measurement in Delphi studies
von der Gracht, H. A. (2012) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2012.04.013 · Cited by 1,831 · cited 1×
“A recent review identified 15 types of indicators to measure consensus (von der Gracht 2012).”
BackgroundConsulting the oracle: ten lessons from using the Delphi technique in nursing research
Keeney, S., Hasson, F., & McKenna, H. (2006) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2006.03716.x · Cited by 1,511
Gazing into the oracle : the Delphi method and its application to social policy and public health
Ziglio, E., & Adler, M. E. (1996) · Jessica Kingsley Publishers eBooks · Cited by 1,429
Understanding and managing conservation conflicts
Redpath, S. M., Young, J., Evely, A., Adams, W. M., Sutherland, W. J., Whitehouse, A., Amar, A., Lambert, R. A., Linnell, J. D. C., Watt, A., et al. (2013) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2012.08.021 · Cited by 1,361
Self-citationCurrent validity of the Delphi method in social sciences
Landeta, J. (2006) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2005.09.002 · Cited by 1,353
Sustainability indicators for managing community tourism
Choi, H. C., & Sirakaya, E. (2006) · Tourism Management · doi:10.1016/j.tourman.2005.05.018 · Cited by 1,099
Hard choices: Making trade-offs between biodiversity conservation and human well-being
McShane, T. O., Hirsch, P. D., Trung, T. C., Songorwa, A. N., Kinzig, A., Monteferri, B., Mutekanga, D., Thang, H. V., Dammert, J. L., Pulgar-Vidal, M., et al. (2011) · Biological Conservation · doi:10.1016/j.biocon.2010.04.038 · Cited by 907
Sinha, I. P., Smyth, R. L., & Williamson, P. R. (2011) · PLoS Medicine · doi:10.1371/journal.pmed.1000393 · Cited by 891
Eliciting Expert Knowledge in Conservation Science
MARTIN, T. G., BURGMAN, M. A., FIDLER, F., KUHNERT, P. M., LOW‐CHOY, S., MCBRIDE, M., & MENGERSEN, K. (2012) · Conservation Biology · doi:10.1111/j.1523-1739.2011.01806.x · Cited by 829
Enhancing rigour in the Delphi technique research
Hasson, F., & Keeney, S. (2011) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2011.04.005 · Cited by 760
Advice taking in decision making: egocentric discounting and reputation formation
Yaniv, I., & Kleinberger, E. (2000) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.2000.2909 · Cited by 701
O'Faircheallaigh, C. (2010) · Environmental Impact Assessment Review · doi:10.1016/j.eiar.2009.05.001 · Cited by 636
Turoff, M. (1970) · Technological Forecasting and Social Change · doi:10.1016/0040-1625(70)90161-7 · Cited by 597
Woudenberg, F. (1991) · Technological Forecasting and Social Change · doi:10.1016/0040-1625(91)90002-w · Cited by 520
Beauty is talent: Task evaluation as a function of the performer's physical attractiveness.
Landy, D., & Sigall, H. (1974) · Journal of Personality and Social Psychology · doi:10.1037/h0036018 · Cited by 442
A guide to eliciting and using expert knowledge in Bayesian ecological models
Kuhnert, P. M., Martin, T. G., & Griffiths, S. P. (2010) · Ecology Letters · doi:10.1111/j.1461-0248.2010.01477.x · Cited by 441
Ecological vulnerability in risk assessment — A review and perspectives
De Lange, H. J., Sala, S., Vighi, M., & Faber, J. H. (2010) · Science of The Total Environment · doi:10.1016/j.scitotenv.2009.11.009 · Cited by 418
The Delphi technique: Past, present, and future prospects — Introduction to the special issue
Rowe, G., & Wright, G. (2011) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2011.09.002 · Cited by 408
Sutherland, W. J., Fleishman, E., Mascia, M. B., Pretty, J., & Rudd, M. A. (2011) · Methods in Ecology and Evolution · doi:10.1111/j.2041-210x.2010.00083.x · Cited by 372
Self-citationMoving best practice forward: Delphi characteristics, advantages, potential problems, and solutions
Donohoe, H. M., & Needham, R. D. (2009) · International Journal of Tourism Research · doi:10.1002/jtr.709 · Cited by 335
Burgman, M. A., McBride, M., Ashton, R., Speirs-Bridge, A., Flander, L., Wintle, B., Fidler, F., Rumpff, L., & Twardy, C. (2011) · PLoS ONE · doi:10.1371/journal.pone.0022998 · Cited by 314
Predicting the ecological consequences of environmental change: a review of the methods*
SUTHERLAND, W. J. (2006) · Journal of Applied Ecology · doi:10.1111/j.1365-2664.2006.01182.x · Cited by 307
Self-citationAssets and liabilities in group problem solving: The need for an integrative function.
Maier, N. R. (1967) · Psychological Review · doi:10.1037/h0024737 · Cited by 306
Fischer, A., & Young, J. C. (2007) · Biological Conservation · doi:10.1016/j.biocon.2006.11.024 · Cited by 304
Review of Delphi-based scenario studies: Quality and design considerations
Nowack, M., Endrikat, J., & Guenther, E. (2011) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2011.03.006 · Cited by 268
Acknowledging Conservation Trade‐Offs and Embracing Complexity
HIRSCH, P. D., ADAMS, W. M., BROSIUS, J. P., ZIA, A., BARIOLA, N., & DAMMERT, J. L. (2011) · Conservation Biology · doi:10.1111/j.1523-1739.2010.01608.x · Cited by 267
Redefining expertise and improving ecological judgment
Burgman, M., Carr, A., Godden, L., Gregory, R., McBride, M., Flander, L., & Maguire, L. (2011) · Conservation Letters · doi:10.1111/j.1755-263x.2011.00165.x · Cited by 224
Mukherjee, N., Sutherland, W. J., Dicks, L., Hugé, J., Koedam, N., & Dahdouh-Guebas, F. (2014) · PLoS ONE · doi:10.1371/journal.pone.0107706 · Cited by 213
Self-citationTapio, P. (2003) · Technological Forecasting and Social Change · doi:10.1016/s0040-1625(01)00177-9 · Cited by 207
Brucker, K. D., Macharis, C., & Verbeke, A. C. (2012) · European Journal of Operational Research · doi:10.1016/j.ejor.2012.02.021 · Cited by 189
McBride, M. F., Garnett, S. T., Szabo, J. K., Burbidge, A. H., Butchart, S. H. M., Christidis, L., Dutson, G., Ford, H. A., Loyn, R. H., Watson, D. M., et al. (2012) · Methods in Ecology and Evolution · doi:10.1111/j.2041-210x.2012.00221.x · Cited by 186
Rauch, W. (1979) · Technological Forecasting and Social Change · doi:10.1016/0040-1625(79)90011-8 · Cited by 184
Rowe, G., Wright, G., & McColl, A. (2004) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2004.03.004 · Cited by 179
Quantifying the development of agreement among experts in Delphi studies
Meijering, J. V., Kampen, J. K., & Tobi, H. (2013) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2013.01.003 · Cited by 173
A dissensus based online Delphi approach: An explorative research tool
Steinert, M. (2009) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2008.10.006 · Cited by 172
Hussler, C., Müller, P., & Rondé, P. (2011) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2011.07.008 · Cited by 166
Murphy, D. D., & Noon, B. R. (1992) · Ecological Applications · doi:10.2307/1941885 · Cited by 166
The unholy marriage? Integrating qualitative and quantitative information in Delphi processes
Tapio, P., Paloniemi, R., Varho, V., & Vinnari, M. (2011) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2011.03.016 · Cited by 164
Scolozzi, R., Morri, E., & Santolini, R. (2012) · Ecological Indicators · doi:10.1016/j.ecolind.2011.07.019 · Cited by 163
The Delphi process – an expert‐based approach to ecological modelling in data‐poor environments
MacMillan, D. C., & Marshall, K. (2006) · Animal Conservation · doi:10.1111/j.1469-1795.2005.00001.x · Cited by 161
Orsi, F., Geneletti, D., & Newton, A. C. (2010) · Ecological Indicators · doi:10.1016/j.ecolind.2010.06.001 · Cited by 150
Redpath, S., Arroyo, B., Leckie, F., Bacon, P., Bayfield, N., Gutiérrez, R. J., & Thirgood, S. (2004) · Conservation Biology · doi:10.1111/j.1523-1739.2004.00421.x · Cited by 144
Planning open spaces for wildlife
Hess, G. R., & King, T. J. (2002) · Landscape and Urban Planning · doi:10.1016/s0169-2046(01)00230-4 · Cited by 139
Group-based forecasting?: A social psychological analysis
Kerr, N. L., & Tindale, R. S. (2010) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2010.02.001 · Cited by 130
How can local and traditional knowledge be effectively incorporated into international assessments?
Sutherland, W. J., Gardner, T. A., Haider, L. J., & Dicks, L. V. (2013) · Oryx · doi:10.1017/s0030605313001543 · Cited by 128
Self-citationHutchings, A., & Raine, R. (2006) · Journal of Health Services Research & Policy · doi:10.1258/135581906777641659 · Cited by 128
Benitez‐Capistros, F., Hugé, J., & Koedam, N. E. (2013) · Ecological Indicators · doi:10.1016/j.ecolind.2013.10.019 · Cited by 115
Self-citationModels of Bounded Rationality: Economic Analysis and Public Policy
Simon, H. A. (1984) · Cited by 105
Mukherjee, N., Sutherland, W. J., Khan, M. N. I., Berger, U., Schmitz, N., Dahdouh‐Guebas, F., & Koedam, N. E. (2014) · Ecology and Evolution · doi:10.1002/ece3.1085 · Cited by 103
Self-citationThe use of Delphi methodology in agrifood policy development: Some lessons learned
Frewer, L. J., Fischer, A. R. H., Wentholt, M. T. A., Marvin, H. J. P., Ooms, B. W., Coles, D. G. H., & Rowe, G. (2011) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2011.05.005 · Cited by 99
A case study of long-term Delphi accuracy
Parenté, R., & Anderson-Parenté, J. (2011) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2011.07.005 · Cited by 98
Lemieux, C. J., & Scott, D. J. (2011) · Environmental Management · doi:10.1007/s00267-011-9700-x · Cited by 92
Diversity in Current Ecological Thinking: Implications for Environmental Management
Moore, S. A., Wallington, T., Hobbs, R. J., Ehrlich, P. R., Holling, C. S., Levin, S. A., Lindenmayer, D. B., Pahl‐Wostl, C., Possingham, H. P., Turner, M. G., et al. (2008) · Environmental Management · doi:10.1007/s00267-008-9187-2 · Cited by 91
Hilbert, M., Miles, I. D., & Othmer, J. (2009) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2009.01.001 · Cited by 89
Using expert knowledge to assess uncertainties in future polar bear populations under climate change
O’Neill, S. J., Osborn, T. J., Hulme, M., Lorenzoni, I., & Watkinson, A. R. (2008) · Journal of Applied Ecology · doi:10.1111/j.1365-2664.2008.01552.x · Cited by 85
Proposed Conservation Landscape for Giant Pandas in the Minshan Mountains, China
Shen, G., Feng, C., Xie, Z., Ouyang, Z., Li, J., & Marty, P. (2008) · Conservation Biology · doi:10.1111/j.1523-1739.2008.01038.x · Cited by 66
Spenceley, A. (2008) · Tourism Geographies · doi:10.1080/14616680802236295 · Cited by 65
Sustainability indicators for clean development mechanism projects in Vietnam
Hugé, J., Le Trinh, H., Hai, P. H., Kuilman, J., & Hens, L. (2010) · Environment, Development and Sustainability · doi:10.1007/s10668-009-9211-6 · Cited by 64
Self-citationA multi-criterion index for the evaluation of local tropical forest conditions in Mexico
Ochoa‐Gaona, S., Kampichler, C., de Jong, B., et al. (2010) · Forest Ecology and Management · doi:10.1016/j.foreco.2010.05.018 · Cited by 63
Eycott, A. E., Marzano, M., & Watts, K. (2011) · Landscape and Urban Planning · doi:10.1016/j.landurbplan.2011.08.014 · Cited by 49
Glass, J. H., Scott, A. J., & Price, M. F. (2012) · Land Use Policy · doi:10.1016/j.landusepol.2012.03.024 · Cited by 45
Review by quality not quantity for better policy
Sutherland, W. J. (2013) · Nature · doi:10.1038/503167a · Cited by 36
Self-citationEcology, Values, and Objectivity: Advancing the Debate
Wallington, T., & Moore, S. A. (2005) · BioScience · doi:10.1641/0006-3568(2005)055[0873:evaoat]2.0.co;2 · Cited by 35
Crabbe, M. J. C., Martínez, E., Garcia, C., Chub, J., Castro, L., & Guy, J. (2009) · Society & Natural Resources · doi:10.1080/08941920802409593 · Cited by 33
Commentaries on “The Delphi technique as a forecasting tool: issues and analysis” by Rowe and Wright
Ayton, P., Ferrell, W. R., & Stewart, T. R. (1999) · International Journal of Forecasting · doi:10.1016/s0169-2070(99)00013-8 · Cited by 32
The Delphi approach to the mediation of environmental disputes
Miller, A., & Cuff, W. (1986) · Environmental Management · doi:10.1007/bf01867255 · Cited by 28
Gobbi, M., Riservato, E., Bragalanti, N., & Lencioni, V. (2012) · Journal for Nature Conservation · doi:10.1016/j.jnc.2012.05.003 · Cited by 17
Cited by
O.Nyumba, T., Wilson, K., Derrick, C. J., & Mukherjee, N. (2018) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12860 · Cited by 2,619
Self-citationOutstanding Challenges in the Transferability of Ecological Models
Yates, K. L., Bouchet, P. J., Caley, M. J., Mengersen, K., Randin, C. F., Parnell, S., Fielding, A. H., Bamford, A. J., Ban, S., Barbosa, A. M., et al. (2018) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2018.08.001 · Cited by 789
A global-scale expert assessment of drivers and risks associated with pollinator decline
Dicks, L. V., Breeze, T. D., Ngo, H. T., Senapathi, D., An, J., Aizen, M. A., Basu, P., Buchori, D., Galetto, L., Garibaldi, L. A., et al. (2021) · Nature Ecology & Evolution · doi:10.1038/s41559-021-01534-9 · Cited by 589
Horizon scan of global conservation issues for 2011
Sutherland, W. J., Bardsley, S., Bennun, L., Clout, M., Côté, I. M., Depledge, M. H., Dicks, L. V., Dobson, A. P., Fellman, L., & Fleishman, E. (2011) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2010.11.002 · Cited by 550
Self-citationInvasion Science: A Horizon Scan of Emerging Challenges and Opportunities
Ricciardi, A., Blackburn, T. M., Carlton, J. T., Dick, J. T. A., Hulme, P. E., Iacarella, J. C., Jeschke, J. M., Liebhold, A. M., Lockwood, J. L., MacIsaac, H. J., et al. (2017) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2017.03.007 · Cited by 458
“Issues were identified and evaluated using a modified iterative Delphi technique [8] and methods of expert consultation,”
MethodSelf-citation
Metadata
- Authors
- Mukherjee, N., Hugé, J., Sutherland, W. J., McNeill, J., Van Opstal, M., Dahdouh‐Guebas, F., & Koedam, N.
- Venue
- Methods in Ecology and Evolution
- Publisher
- Wiley
- Published
- 2015-04-28
- Volume
- 6
- Issue
- 9
- Pages
- 1097-1109
- ISSN
- 2041-210X (ISSN-L)
- OpenAlex
- W2123195536
- Cited by
- 381
- References
- 74
- FWCI
- 48.72
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.