Improving the practical application of the Delphi method in group-based judgment: a six-step prescription for a well-founded and defensible process
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Advantages of the Delphi method include practicality, anonymity, and iteration.
“Advantages of this method include practicality (it can be done online, asynchronously, without specialist tools), anonymity (participants know the average group score but not individuals' scores), and iteration (through feedback, outliers are prompted to either defend their response to the group or change it) (42, 43).”
From Planning and Evaluating Remote Consultation Services: A New Conceptual Framework Incorporating Complexity and Practical Ethics (2021) · cites this paper as [43]
Cites
Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195 · see citing works
Research guidelines for the Delphi survey technique
Hasson, F. (2000) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2000.01567.x · Cited by 5,951 · see citing works
the delphi method: techniques and applications
Linstone, H. A., & Turoff, M. (1975) · Bibliothèque et Archives nationales du Québec (Québec government) · Cited by 5,236 · see citing works
Likert scales, levels of measurement, and the “laws” of statistics
Norman, G. (2010) · Advances in Health Sciences Education · doi:10.1007/s10459-010-9222-y · Cited by 4,850 · see citing works
The Delphi method as a research tool: an example, design considerations and applications
Okoli, C., & Pawlowski, S. D. (2004) · Information & Management · doi:10.1016/j.im.2003.11.002 · Cited by 4,771 · see citing works
The Delphi Technique: Making Sense of Consensus
Hsu, C.-C., & Sandford, B. A. (2007) · University of Massachusetts Amherst · doi:10.7275/pdz9-th90 · Cited by 4,500 · see citing works
Mokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, P. W., Knol, D. L., Bouter, L. M., & de Vet, H. C. W. (2010) · Quality of Life Research · doi:10.1007/s11136-010-9606-8 · Cited by 4,260 · see citing works
Diamond, I. R., Grant, R. C., Feldman, B. M., Pencharz, P. B., Ling, S. C., Moore, A. M., & Wales, P. W. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.12.002 · Cited by 3,740 · see citing works
The Delphi technique as a forecasting tool: issues and analysis
Rowe, G., & Wright, G. (1999) · International Journal of Forecasting · doi:10.1016/s0169-2070(99)00018-7 · Cited by 2,515 · see citing works
Self-citationResponse strategies for coping with the cognitive demands of attitude measures in surveys
Krosnick, J. A. (1991) · Applied Cognitive Psychology · doi:10.1002/acp.2350050305 · Cited by 2,487 · see citing works
Likert scales: how to (ab)use them
Jamieson, S. (2004) · Medical Education · doi:10.1111/j.1365-2929.2004.02012.x · Cited by 2,423 · see citing works
The Delphi Method: Techniques and Applications
J., J. E., Linstone, H. A., & Turoff, M. (1976) · Technometrics · doi:10.2307/1268751 · Cited by 2,245 · see citing works
Preston, C. C., & Colman, A. M. (2000) · Acta Psychologica · doi:10.1016/s0001-6918(99)00050-5 · Cited by 2,106 · see citing works
Boulkedid, R., Abdoul, H., Loustau, M., Sibony, O., & Alberti, C. (2011) · PLoS ONE · doi:10.1371/journal.pone.0020476 · Cited by 2,045 · see citing works
Consensus measurement in Delphi studies
von der Gracht, H. A. (2012) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2012.04.013 · Cited by 1,831 · see citing works
Elwyn, G. (2006) · BMJ · doi:10.1136/bmj.38926.629329.ae · Cited by 1,824 · see citing works
Generalization in quantitative and qualitative research: Myths and strategies
Polit, D. F., & Beck, C. T. (2010) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2010.06.004 · Cited by 1,767 · see citing works
Consulting the oracle: ten lessons from using the Delphi technique in nursing research
Keeney, S., Hasson, F., & McKenna, H. (2006) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2006.03716.x · Cited by 1,511 · see citing works
How to use the nominal group and Delphi techniques
McMillan, S. S., King, M. A., & Tully, M. P. (2016) · International Journal of Clinical Pharmacy · doi:10.1007/s11096-016-0257-x · Cited by 1,500 · see citing works
Crisp, J., Pelletier, D., Duffield, C. M., Adams, A. M. N., & Nagy, S. A. (1997) · Nursing Research · doi:10.1097/00006199-199703000-00010 · Cited by 1,388 · see citing works
Current validity of the Delphi method in social sciences
Landeta, J. (2006) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2005.09.002 · Cited by 1,353 · see citing works
A critical review of the Delphi technique as a research methodology for nursing
Keeney, S., Hasson, F., & McKenna, H. (2001) · International Journal of Nursing Studies · doi:10.1016/s0020-7489(00)00044-4 · Cited by 1,333 · see citing works
Armstrong, J. S. (2001) · International series in management science/operations research/International series in operations research & management science · doi:10.1007/978-0-306-47630-3 · Cited by 1,189 · see citing works
Managing Delphi Surveys Using Nonparametric Statistical Techniques*
Schmidt, R. C. (1997) · Decision Sciences · doi:10.1111/j.1540-5915.1997.tb01330.x · Cited by 1,153 · see citing works
The Delphi technique: a worthwhile research approach for nursing?
McKenna, H. (1994) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.1994.tb01207.x · Cited by 1,151 · see citing works
van der Steen, J. T., Radbruch, L., Hertogh, C. M., de Boer, M. E., Hughes, J. C., Larkin, P., Francke, A. L., Jünger, S., Gove, D., Firth, P., et al. (2014) · Palliative Medicine · doi:10.1177/0269216313493685 · Cited by 997 · see citing works
The Delphi technique: a methodological discussion
Williams, P. L., & Webb, C. (1994) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.1994.tb01066.x · Cited by 933 · see citing works
Qualitative Research: Application of the Delphi Method to CEM Research
Hallowell, M. R., & Gambatese, J. (2009) · Journal of Construction Engineering and Management · doi:10.1061/(asce)co.1943-7862.0000137 · Cited by 931 · see citing works
The Delphi technique: a critique
Goodman, C. (1987) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.1987.tb01376.x · Cited by 928 · see citing works
Group Techniques for Program Planning
de Ven, A. V., & Delbecq, A. L. (1975) · Cited by 916 · see citing works
Sinha, I. P., Smyth, R. L., & Williamson, P. R. (2011) · PLoS Medicine · doi:10.1371/journal.pmed.1000393 · Cited by 891 · see citing works
Delphi: a technique to harness expert opinion for critical decision‐making tasks in education
Clayton, M. J. (1997) · Educational Psychology · doi:10.1080/0144341970170401 · Cited by 850 · see citing works
Ensuring the Quality of the Findings of Qualitative Research: Looking at Trustworthiness Criteria
Anney, V. N. (2014) · Cited by 840 · see citing works
Weijters, B., Cabooter, E., & Schillewaert, N. (2010) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2010.02.004 · Cited by 813 · see citing works
Expert Opinions in Forecasting: The Role of the Delphi Technique
Rowe, G., & Wright, G. (2001) · International series in management science/operations research/International series in operations research & management science · doi:10.1007/978-0-306-47630-3_7 · Cited by 778 · see citing works
Self-citationAnalyzing ordinal data with metric models: What could possibly go wrong?
Liddell, T. M., & Kruschke, J. K. (2018) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2018.08.009 · Cited by 773 · see citing works
Delphi methodology in health research: how to do it?
Trevelyan, E., & Robinson, N. (2015) · European Journal of Integrative Medicine · doi:10.1016/j.eujim.2015.07.002 · Cited by 747 · see citing works
Delphi: A reevaluation of research and theory
Rowe, G., Wright, G., & Bolger, F. (1991) · Technological Forecasting and Social Change · doi:10.1016/0040-1625(91)90039-i · Cited by 733 · see citing works
Self-citationWilcox, J. B., Rossi, P. H., Wright, J. D., & Anderson, A. B. (1985) · Journal of Marketing Research · doi:10.2307/3151558 · Cited by 708 · see citing works
Scale Construction and Psychometrics for Social and Personality Psychology
Furr, R. M. (2011) · SAGE Publications Ltd eBooks · doi:10.4135/9781446287866 · Cited by 652 · see citing works
Planning and Conducting Needs Assessments: A Practical Guide
Witkin, B. R., & Altschuld, J. W. (1995) · Cited by 554 · see citing works
An exploration of the use of simple statistics to measure consensus and stability in Delphi studies
Holey, E. A., Feeley, J. L., Dixon, J., & Whittaker, V. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-52 · Cited by 531 · see citing works
Woudenberg, F. (1991) · Technological Forecasting and Social Change · doi:10.1016/0040-1625(91)90002-w · Cited by 530 · see citing works
An introduction to reading and appraising qualitative research
Kuper, A., Reeves, S., & Levinson, W. (2008) · BMJ · doi:10.1136/bmj.a288 · Cited by 519 · see citing works
The Delphi technique: Past, present, and future prospects — Introduction to the special issue
Rowe, G., & Wright, G. (2011) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2011.09.002 · Cited by 421 · see citing works
Self-citationRT Delphi: An efficient, “round-less” almost real time Delphi method
Gordon, T. J., & Pease, A. (2005) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2005.09.005 · Cited by 420 · see citing works
Weng, L. (2004) · Educational and Psychological Measurement · doi:10.1177/0013164404268674 · Cited by 413 · see citing works
The Delphi method and health research
de Meyrick, J. (2003) · Health Education · doi:10.1108/09654280310459112 · Cited by 406 · see citing works
Assessing Three Sources of Misresponse to Reversed Likert Items
Swain, S. D., Weathers, D., & Niedrich, R. W. (2008) · Journal of Marketing Research · doi:10.1509/jmkr.45.1.116 · Cited by 386 · see citing works
Applying the Delphi technique in a study of GPs’ information requirements
Green, B. F., Jones, M. L., Hughes, D., et al. (1999) · Health & Social Care in the Community · doi:10.1046/j.1365-2524.1999.00176.x · Cited by 384 · see citing works
Treating ordinal scales as interval scales: an attempt to resolve the controversy.
Knapp, T. R. (1990) · PubMed · Cited by 375 · see citing works
Stability and agreement criteria for the termination of Delphi studies
Dajani, J. S., Sincoff, M. Z., & Talley, W. K. (1979) · Technological Forecasting and Social Change · doi:10.1016/0040-1625(79)90007-6 · Cited by 365 · see citing works
Wiley StatsRef: Statistics Reference Online
(2015) · Choice Reviews Online · doi:10.5860/choice.190902 · Cited by 363 · see citing works
The Delphi technique: a comparison of results obtained using two expert panels
Duffield, C. M. (1993) · International Journal of Nursing Studies · doi:10.1016/0020-7489(93)90033-q · Cited by 338 · see citing works
Dimensions of Internet science
Reips, U., & Bošnjak, M. (2001) · Cited by 319 · see citing works
Gnatzy, T., Warth, J., von der Gracht, H. A., & Darkow, I. (2011) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2011.04.006 · Cited by 303 · see citing works
Cicchetti, D. V., Shoinralter, D., & Tyrer, P. J. (1985) · Applied Psychological Measurement · doi:10.1177/014662168500900103 · Cited by 290 · see citing works
A Generic Toolkit for the Successful Management of Delphi Studies
Day, J., & Bobeva, M. (2005) · The Electronic Journal of Business Research Methods · Cited by 282 · see citing works
Using the Delphi method to engage stakeholders: A comparison of two studies
Geist, M. (2009) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2009.06.006 · Cited by 272 · see citing works
Treating Ordinal Scales as Interval Scales: An Attempt To Resolve the Controversy
KNAPP, T. R. (1990) · Nursing Research · doi:10.1097/00006199-199003000-00019 · Cited by 271 · see citing works
de Loë, R. C., Melnychuk, N., Murray, D., & Plummer, R. (2016) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2015.12.009 · Cited by 255 · see citing works
Scenarios for the logistics services industry: A Delphi-based analysis for 2025
von der Gracht, H. A., & Darkow, I. (2010) · International Journal of Production Economics · doi:10.1016/j.ijpe.2010.04.013 · Cited by 252 · see citing works
Idea Generation and Exploration: Benefits and Limitations of the Policy Delphi Research Method
Franklin, K. K., & Hart, J. K. (2006) · Innovative Higher Education · doi:10.1007/s10755-006-9022-8 · Cited by 244 · see citing works
The use of Delphi and Nominal Group Technique in nursing education: A review
Foth, T., Efstathiou, N., Vanderspank‐Wright, B., Ufholz, L., Dütthorn, N., Zimansky, M., & Humphrey-Murto, S. M. (2016) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2016.04.015 · Cited by 234 · see citing works
Futures research methodology—Version 2.0
Linstone, H. A. (2003) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2003.11.002 · Cited by 230 · see citing works
Mapping the future of supply chain management: a Delphi study
Melnyk, S. A., Lummus, R. R., Vokurka, R. J., et al. (2008) · International Journal of Production Research · doi:10.1080/00207540802014700 · Cited by 226 · see citing works
The delphi technique: an exposition and application
Mitchell, V. (1991) · Technology Analysis and Strategic Management · doi:10.1080/09537329108524065 · Cited by 225 · see citing works
Hybrid Delphi: A methodology to facilitate contribution from experts in professional contexts
Rodríguez, J. L., Güenaga, J. B., & Lertxundi, A. L. (2011) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2011.03.009 · Cited by 224 · see citing works
Biases in future-oriented Delphi studies: A cognitive perspective
Winkler, J., & Moser, R. (2016) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2016.01.021 · Cited by 219 · see citing works
TENTS guidelines: development of post-disaster psychosocial care guidelines through a Delphi process
Bisson, J. I., Tavakoly, B., Witteveen, A. B., Ajduković, D., Jehel, L., Johansen, V. A., Nordanger, D. Ø., García, F. O., Punamäki, R., Schnyder, U., et al. (2009) · The British Journal of Psychiatry · doi:10.1192/bjp.bp.109.066266 · Cited by 212 · see citing works
What Are the Components of CBT for Psychosis? A Delphi Study
Morrison, A. P., & Barratt, S. (2010) · Schizophrenia Bulletin · doi:10.1093/schbul/sbp118 · Cited by 212 · see citing works
Hung, H. S., Altschuld, J. W., & Lee, Y. (2008) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2008.02.005 · Cited by 205 · see citing works
Improving the Delphi process: Lessons from social psychological research
Bolger, F., & Wright, G. (2011) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2011.07.007 · Cited by 201 · see citing works
Self-citationUsing the Theory of Satisficing to Evaluate the Quality of Survey Data
Barge, S., & Gehlbach, H. (2011) · Research in Higher Education · doi:10.1007/s11162-011-9251-2 · Cited by 171 · see citing works
The UK technology foresight programme
Georghiou, L. (1996) · Futures · doi:10.1016/0016-3287(96)00013-4 · Cited by 158 · see citing works
Real-Time Delphi in practice — A comparative analysis of existing software-based tools
Aengenheyster, S., Cuhls, K. E., Gerhold, L., et al. (2017) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2017.01.023 · Cited by 157 · see citing works
Using the Delphi Technique in Normative Planning Research: Methodological Design Considerations
Novakowski, N., & Wellar, B. S. (2008) · Environment and Planning A Economy and Space · doi:10.1068/a39267 · Cited by 153 · see citing works
Assessing the validity of the Delphi technique
Ono, R., & Wedemeyer, D. J. (1994) · Futures · doi:10.1016/0016-3287(94)90016-7 · Cited by 149 · see citing works
The Delphi method—more research please
Humphrey-Murto, S. M., & de Wit, M. P. T. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.10.011 · Cited by 137 · see citing works
Hussler, C., Müller, P., & Rondé, P. (2011) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2011.07.008 · Cited by 135 · see citing works
Who is a Delphi ‘expert’? Reflections on a bioeconomy expert selection procedure from Ireland
Devaney, L., & Henchion, M. M. (2018) · Futures · doi:10.1016/j.futures.2018.03.017 · Cited by 130 · see citing works
Financial incentives, personal information and drop-out in online studies
Frick, A., Bächtiger, M.-T., & Reips, U. (2001) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-19758 · Cited by 129 · see citing works
Factors Influencing Success and Failure of Health Informatics Systems
Ammenwerth, E., Nykänen, P., Talmon, J. L., & Brender, J. (2006) · Methods of Information in Medicine · doi:10.1055/s-0038-1634049 · Cited by 128 · see citing works
Group Confidence Pressures in Iterative Decisions
Bøje, D. M., & Murnighan, J. K. (1982) · Management Science · doi:10.1287/mnsc.28.10.1187 · Cited by 116 · see citing works
People consultation to construct the future: A Delphi application
Rodríguez, J. L., & Barrutia, J. (2010) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2010.04.001 · Cited by 108 · see citing works
The Delphi Technique: An Empirical Evaluation of the Optimal Number of Rounds
Erffmeyer, R. C., Erffmeyer, E. S., & Lane, I. M. (1986) · Group & Organization Studies · doi:10.1177/105960118601100110 · Cited by 102 · see citing works
Czaplicka-Kolarz, K., Stańczyk, K., & Kapusta, K. (2008) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2008.05.007 · Cited by 101 · see citing works
Factors influencing success and failure of health informatics systems--a pilot Delphi study.
Brender, J., Ammenwerth, E., Nykänen, P., & Talmon, J. L. (2006) · PubMed · Cited by 100 · see citing works
Terminating Sequential Delphi Survey Data Collection
Kalaian, S. A., & Kasim, R. (2020) · doi:10.7275/g48q-je05 · Cited by 99 · see citing works
The use of Delphi methodology in agrifood policy development: Some lessons learned
Frewer, L. J., Fischer, A. R. H., Wentholt, M. T. A., Marvin, H. J. P., Ooms, B. W., Coles, D. G. H., & Rowe, G. (2011) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2011.05.005 · Cited by 99 · see citing works
A case study of long-term Delphi accuracy
Parenté, R., & Anderson-Parenté, J. (2011) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2011.07.005 · Cited by 95 · see citing works
The construction of Delphi event statements
Salancik, J. R., Wenger, W., & Helfer, E. (1971) · Technological Forecasting and Social Change · doi:10.1016/s0040-1625(71)80004-5 · Cited by 94 · see citing works
Advanced methods for conducting online behavioral research.
(2010) · American Psychological Association eBooks · doi:10.1037/12076-000 · Cited by 92 · see citing works
An Investigation of the Effect of Lotteries on Web Survey Response Rates
Heerwegh, D. (2006) · Field Methods · doi:10.1177/1525822x05285781 · Cited by 88 · see citing works
Spickermann, A., Zimmermann, M., & von der Gracht, H. A. (2013) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2013.04.009 · Cited by 87 · see citing works
Goluchowicz, K., & Blind, K. (2011) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2011.04.014 · Cited by 82 · see citing works
Evaluation of explicit criteria for total hip joint replacement
Quintana, J. M., Aróstegui, I., Azkárate, J., et al. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00244-4 · Cited by 81 · see citing works
Pforr, K., Blohm, M., Blom, A. G., Erdel, B., Felderer, B., Fräßdorf, M., Hajek, K., Helmschrott, S., Kleinert, C., Koch, A., et al. (2015) · Public Opinion Quarterly · doi:10.1093/poq/nfv014 · Cited by 79 · see citing works
Duru, O., Bulut, E., & Yoshida, S. (2011) · Expert Systems with Applications · doi:10.1016/j.eswa.2011.07.082 · Cited by 76 · see citing works
The Methods of Futures Research
Gordon, T. J. (1992) · The Annals of the American Academy of Political and Social Science · doi:10.1177/0002716292522001003 · Cited by 76 · see citing works
Technological Forecasting for Industry and Government
Cantley, M. F. (1970) · Journal of the Operational Research Society · doi:10.1057/jors.1970.56 · Cited by 74 · see citing works
Establishing key components of yoga interventions for musculoskeletal conditions: a Delphi survey
Ward, L., Stebbings, S. M., Sherman, K. J., Cherkin, D. C., & Baxter, D. G. (2014) · BMC Complementary and Alternative Medicine · doi:10.1186/1472-6882-14-196 · Cited by 72 · see citing works
Melander, L. (2017) · Futures · doi:10.1016/j.futures.2017.11.007 · Cited by 72 · see citing works
Policy experts' propensity to change their opinion along Delphi rounds
Makkonen, M., Hujala, T., & Uusivuori, J. (2016) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2016.05.020 · Cited by 66 · see citing works
Bolger, F., Stranieri, A., Wright, G., & Yearwood, J. L. (2011) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2011.06.002 · Cited by 65 · see citing works
Self-citationTurnbull, A. E., Dinglas, V. D., Friedman, L. A., Chessare, C. M., Sepúlveda, K. A., Bingham, C. O., & Needham, D. M. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.06.007 · Cited by 63 · see citing works
The future of foresight professionals: Results from a global Delphi study
Gary, J. E., & von der Gracht, H. A. (2015) · Futures · doi:10.1016/j.futures.2015.03.005 · Cited by 62 · see citing works
Application of the Delphi Technique to Rural Tourism Project Evaluation
Briedenhann, J., & Butts, S. (2006) · Current Issues in Tourism · doi:10.1080/13683500608668246 · Cited by 62 · see citing works
Toma, C., & Picioreanu, I. (2016) · International Journal of Public Health Research · Cited by 57 · see citing works
Developing a Checklist: Consensus Via a Modified Delphi Technique
Ogden, S. R., Culp, W. C., Villamaria, F. J., & Ball, T. R. (2016) · Journal of Cardiothoracic and Vascular Anesthesia · doi:10.1053/j.jvca.2016.02.022 · Cited by 52 · see citing works
Misco, T. J. (2007) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 50 · see citing works
Delphi, the issue of reliability
Kastein, M. R., Jacobs, M., van der Hell, R. H., et al. (1993) · Technological Forecasting and Social Change · doi:10.1016/0040-1625(93)90075-i · Cited by 49 · see citing works
Meijering, J. V., & Tobi, H. (2015) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2015.11.008 · Cited by 49 · see citing works
Göritz, A. S. (2010) · American Psychological Association eBooks · doi:10.1037/12076-014 · Cited by 49 · see citing works
Technology foresight in China: Academic studies, governmental practices and policy applications
Li, N., Chen, K., & Kou, M. (2016) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2016.08.010 · Cited by 49 · see citing works
Wright, G., & Rowe, G. (2010) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2010.05.012 · Cited by 48 · see citing works
Self-citationThe Long-Term Effect of Material Incentives on Participation in Online Panels
Göritz, A. S. (2008) · Field Methods · doi:10.1177/1525822x08317069 · Cited by 45 · see citing works
Practical Considerations for Conducting Delphi Studies: The Oracle Enters a New Age
Eggers, R. M., & Jones, C. M. (1998) · Educational research quarterly · Cited by 38 · see citing works
Do We Agree? Using a Delphi Technique to Develop Consensus on Skills of Hand Expression
Becker, G. E., & Roberts, T. E. (2009) · Journal of Human Lactation · doi:10.1177/0890334409333679 · Cited by 36 · see citing works
Innovations for our Future: Delphi ’98: New Foresight on Science and Technology
Cuhls, K. E., Blind, K., Grupp, H., et al. (2001) · DIAL (Catholic University of Leuven) · doi:10.1007/978-3-642-57472-6 · Cited by 33 · see citing works
COLLINS, J. A., Hanlon, A. J., More, S. J., et al. (2010) · Equine Veterinary Journal · doi:10.2746/042516409x471458 · Cited by 30 · see citing works
Nonparametric Statistics for Applied Research
Linebach, J. A., Tesch, B. P., & Kovacsiss, L. M. (2013) · Springer eBooks · doi:10.1007/978-1-4614-9041-8 · Cited by 24 · see citing works
Futuribles of learning 2030 - Delphi supports the reform of the core curricula in Finland
Airaksinen, T., Halinen, I., & Linturi, H. (2016) · European Journal of Futures Research · doi:10.1007/s40309-016-0096-y · Cited by 23 · see citing works
Kim, C. H., Park, J. O., Park, C. B., et al. (2014) · Journal of Korean Medical Science · doi:10.3346/jkms.2014.29.1.122 · Cited by 17 · see citing works
Agell, N., van Ganzewinkel, C. J., Sánchez, M., et al. (2015) · Applied Soft Computing · doi:10.1016/j.asoc.2015.03.024 · Cited by 14 · see citing works
Roadmapping: Comparing cases in China and Germany
Cuhls, K. E., de Vries, M., Li, H., et al. (2015) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2015.03.008 · Cited by 12 · see citing works
A national energy-conservation policy Delphi: report of the findings
Setty, K. P. S., Padmanabhan, S., & Natarajan, R. (1987) · Technological Forecasting and Social Change · doi:10.1016/0040-1625(87)90014-x · Cited by 8 · see citing works
Consensus and the Delphi Process.
Uhl, N. P. (1975) · Cited by 6 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Beiderbeck, D., Frevel, N., von der Gracht, H. A., Schmidt, S. L., & Schweitzer, V. M. (2021) · MethodsX · doi:10.1016/j.mex.2021.101401 · Cited by 642 · see citing works
Greenhalgh, T., Rosen, R., Shaw, S. E., Byng, R., Faulkner, S., Finlay, T., Grundy, E., Husain, L., Hughes, G., Leone, C., et al. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.726095 · Cited by 173 · see citing works
“Advantages of this method include practicality (it can be done online, asynchronously, without specialist tools), anonymity (participants know the average group score but not individuals’ scores), and iteration (through feedback, outliers are prompted to either defend their response to the group or change it) (42, 43).”
MethodBoel, A., Navarro-Compán, V., Landewé, R., & van der Heijde, D. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.09.034 · Cited by 118 · see citing works
Wehrle, M., Birkel, H., von der Gracht, H. A., & Hartmann, E. (2022) · Journal of Purchasing and Supply Management · doi:10.1016/j.pursup.2021.100732 · Cited by 49 · see citing works
- Authors
- Belton, I., MacDonald, A., Wright, G., & Hamlin, I.
- Affiliations
- University of Strathclyde (GB)
- Corresponding author
- Belton, Ian
- Venue
- Technological Forecasting and Social Change
- Publisher
- Elsevier BV
- Published
- 2019-10
- Volume
- 147
- Pages
- 72-82
- ISSN
- 0040-1625 (ISSN-L)
- OpenAlex
- W2964311550
- Cited by
- 474
- References
- 128
- Citations by year
- 2026: 77 · 2025: 93 · 2024: 94 · 2023: 81 · 2022: 65 · 2021: 39 · 2020: 24 · 2019: 1
- FWCI
- 60.79
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Technological Forecasting and Social Change (publishedVersion)
- Strathprints: The University of Strathclyde institutional repository (University of Strathclyde) (acceptedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Social Sciences › Decision Sciences › Management Science and Operations Research › Multi-Criteria Decision Making
- Social Sciences › Decision Sciences › Management Science and Operations Research › Forecasting Techniques and Applications
- Keywords
- Delphi method, respondent selection, response scales, technology forecasting
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review