The Delphi Technique: Making Sense of Consensus
Open accessThe DOI matches its DataCite record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
The Delphi technique is a widely used and accepted method for gathering data from respondents within their domain of expertise. The technique is designed as a group communication process which aims to achieve a convergence of opinion on a specific real-world issue. The Delphi process has been used in various fields of study such as program planning, needs assessment, policy determination, and resource utilization to develop a full range of alternatives, explore or expose underlying assumptions, as well as correlate judgments on a topic spanning a wide range of disciplines. The Delphi technique is well suited as a method for consensus-building by using a series of questionnaires delivered using multiple iterations to collect data from a panel of selected subjects. Subject selection, time frames for conducting and completing a study, the possibility of low response rates, and unintentionally guiding feedback from the respondent group are areas which should be considered when designing and implementing a Delphi study. Accessed 68,465 times on https://pareonline.net from August 30, 2007 to December 31, 2019. For downloads from January 1, 2020 forward, please click on the PlumX Metrics link to the right.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“factors with a level of agreement ≥ 70% were extracted and included in the present review [19].”
From Healthcare professionals’ perspectives on artificial intelligence in patient care: a systematic review of hindering and facilitating factors on different levels (2025) · cites this paper as [19]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“To narrow the list into a usable checklist, we then used a three-step Delphi survey process [31].”
From PRISMA-S: an extension to the PRISMA Statement for Reporting Literature Searches in Systematic Reviews (2021) · cites this paper as [31]
The cited source says what the claim attributes to it.
In the citing paper
“The iteration characteristics of the Delphi technique have intrinsic limitations and might lead to groupthink, where participants might conform to dominant opinions of the group, which could affect objectivity.197”
From Definition and diagnostic criteria of clinical obesity (2025) · cites this paper as [197]
In the citing paper
“This anonymous and iterative group technique is designed to gather individual opinions from experts and transform these into a group consensus 6.”
From Diagnosis and treatment of chronic bacterial prostatitis and chronic prostatitis/chronic pelvic pain syndrome: a consensus guideline (2015) · cites this paper as [6]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Foundations of Behavioral Research
Stockton, R., & Kerlinger, F. N. (1974) · American Educational Research Journal · doi:10.2307/1162206 · Cited by 7,347
An Experimental Application of the DELPHI Method to the Use of Experts
Dalkey, N., & Helmer, O. (1963) · Management Science · doi:10.1287/mnsc.9.3.458 · Cited by 6,061
Research guidelines for the Delphi survey technique
Hasson, F. (2000) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2000.01567.x · Cited by 5,951 · cited 1×
“As such, Ludwig (1994) specifically addresses subject motivation as the key to the successful implementation of a Delphi study and investigators need to play an active role in this area to help ensure as high a response rate as possible.”
The Delphi Method: An Experimental Study of Group Opinion
(1969) · RAND Corporation eBooks · doi:10.7249/rm5888 · Cited by 1,628
Gazing into the oracle : the Delphi method and its application to social policy and public health
Ziglio, E., & Adler, M. E. (1996) · Jessica Kingsley Publishers eBooks · Cited by 1,429
Group Techniques for Program Planning
de Ven, A. V., & Delbecq, A. L. (1975) · Cited by 907
Technological forecasting for decision making
Martino, J. P. (1972) · Cited by 813
Experimental Study of Channel Patterns
SCHUMM, S. A., & KHAN, H. R. (1972) · Geological Society of America Bulletin · doi:10.1130/0016-7606(1972)83[1755:esocp]2.0.co;2 · Cited by 776
An experimental study of group opinion
Dalkey, N. (1969) · Futures · doi:10.1016/s0016-3287(69)80025-x · Cited by 750
Miller, G. (2001) · Tourism Management · doi:10.1016/s0261-5177(00)00067-4 · Cited by 604
Research works printed but not linked: 7
- Adams, S. J. (2001). Projecting the next decade in safety management: A Delphi technique study. Professional Safety, 46 (10), 26-29.
- Green, P. J. (1982, March). The content of a college-level outdoor leadership course. Paper presented at the Conference of the Northwest District Association for the American Alliance for Health, Physical Education, Recreation, and Dance, Spokane, WA.
- Jones, C. G. (1975). A Delphi evaluation of agreement between organizations. In H. A. Linstone, & M. Turoff (Eds.). The Delphi method: Techniques and applications (pp. 160-167). Reading, MA: Addison-Wesley Publishing Company.
- Kaplan, L. M. (1971). The use of the Delphi method in organizational communication: A case study. Unpublished master's thesis, The Ohio State University, Columbus.
- Linstone, H. A., & Turoff, M. (1975). Introduction. In H. A. Linstone, & M. Turoff (Eds.). The Delphi method: Techniques and applications (pp. 3-12). Reading, MA: Addison-Wesley Publishing Company.
- Ludlow, J. (1975). Delphi inquiries and knowledge utilization. In H. A. Linstone, & M. Turoff (Eds.). The Delphi method: Techniques and applications (pp. 102-123). Reading, MA: Addison-Wesley Publishing Company.
- Scheibe, M., Skutsch, M., & Schofer, J. (1975). Experiments in Delphi methodology. In H. A. Linstone, & M. Turoff (Eds.). The Delphi method: Techniques and applications (pp. 262-287). Reading, MA: Addison-Wesley Publishing Company.
Cited by
Items 601–700 of 1,013
Beehler, G. P., Funderburk, J. S., Possemato, K., & Vair, C. L. (2013) · Implementation Science · doi:10.1186/1748-5908-8-19 · Cited by 41
“An advantage to this approach is that it provides anonymity, thereby decreasing the likelihood that some participants will modify their responses based on the opinions of highl y nfluential experts [35].”
BackgroundLarson, S., Davis, L. E., Stevens, A., El‐Ibiary, S. Y., Grice, G. R., Pogge, E. K., Raney, E. C., & Storjohann, T. D. (2019) · American Journal of Health-System Pharmacy · doi:10.1093/ajhp/zxz183 · Cited by 41
An international Delphi consensus for pelvic stereotactic ablative radiotherapy re-irradiation
Slevin, F., Aitken, K. L., Alongi, F., Arcangeli, S., Chadwick, E., Chang, A. R., Cheung, P., Crane, C. H., Gückenberger, M., Jereczek‐Fossa, B. A., et al. (2021) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2021.09.010 · Cited by 41
Delphi-based future scenarios: A bibliometric analysis of climate change case studies
Calleo, Y., & Pilla, F. (2023) · Futures · doi:10.1016/j.futures.2023.103143 · Cited by 47
Wyss, T. R., Giardini, M., Sörelius, K., Adam, D. J., Assadian, O., Beck, A. W., Bérard, X., Boutoille, D., Budtz-Lilly, J. W., Chakfé, N., et al. (2023) · European Journal of Vascular and Endovascular Surgery · doi:10.1016/j.ejvs.2023.12.008 · Cited by 47
An Expert Consensus Statement on Biomarkers of Aging for Use in Intervention Studies
Perri, G., French, C., Agostinis‐Sobrinho, C., Anand, A., Antarianto, R. D., Arai, Y., Baur, J. A., Cauli, O., Clivaz-Duc, M., Colloca, G. A., et al. (2024) · The Journals of Gerontology Series A · doi:10.1093/gerona/glae297 · Cited by 56
“Fourthly, anonymity of the panel members was maintained across all rounds, which allowed individuals to express and change their responses privately without peer pressure (25,45,46).”
Operationalisation of quality of life for adults with severe disabilities
Gómez, L. E., Martínez, B. A., Alonso, M. Á. V., Tassé, M. J., & Brown, I. (2015) · Journal of Intellectual Disability Research · doi:10.1111/jir.12204 · Cited by 59
Julsrud, T. E., & Uteng, T. P. (2015) · European Journal of Futures Research · doi:10.1007/s40309-015-0069-6 · Cited by 50
Evaluating expert opinion and spatial scale in an amphibian model
Charney, N. (2012) · Ecological Modelling · doi:10.1016/j.ecolmodel.2012.05.026 · Cited by 48
“It is possible that a consensus-seeking elicitation technique, such as the Delphi method (Hsu and Sandford, 2007) would have produced a better set of resistance values.”
Löfmark, A., & Mårtensson, G. (2016) · Nurse Education Today · doi:10.1016/j.nedt.2016.12.009 · Cited by 48
Core outcome set for research studies evaluating treatments for twin–twin transfusion syndrome
Perry, H., Duffy, J. M., Reed, K., Baschat, A., Deprest, J. A., Hecher, K., Lewi, L., Lopriore, E., Oepkes, D., & Khalil, A. A. (2019) · Ultrasound in Obstetrics and Gynecology · doi:10.1002/uog.20183 · Cited by 44
A Hybrid Tool for Visual Pollution Assessment in Urban Environments
Wakil, K., Naeem, M. A., Anjum, G. A., Waheed, A., Thaheem, M. J., Hussnain, M. Q. U., & Nawaz, R. (2019) · Sustainability · doi:10.3390/su11082211 · Cited by 41
“The relevant literature contains several weighing methods and techniques (e.g. Delphie method, ordering method [42–44]) that have experts evaluation at their core but possess respective pros and cons.”
Validation of mouse welfare indicators: a Delphi consultation survey
Luna, I. M. C., Miller, A. L., Beard, A. P., & Leach, M. C. (2019) · Scientific Reports · doi:10.1038/s41598-019-45810-y · Cited by 44
Applying the Delphi method to determine best practices for outsourcing logistics in disaster relief
Gossler, T., Sigala, I. F., Wakolbinger, T., & Buber, R. (2019) · Journal of Humanitarian Logistics and Supply Chain Management · doi:10.1108/jhlscm-06-2018-0044 · Cited by 51
Aifah, A. A., Okeke, N. L., Rentrope, C. R., Schexnayder, J. K., Bloomfield, G. S., Bosworth, H. B., Grover, K. K., Hileman, C. O., Muiruri, C., Oakes, M. M., et al. (2020) · Progress in Cardiovascular Diseases · doi:10.1016/j.pcad.2020.02.013 · Cited by 47
Hospital disaster and emergency preparedness (HDEP) in Lebanon: A national comprehensive assessment
Al‐Hajj, S., Abou‐El‐Hassan, H., Khalil, L. E., Kaafarani, H. M. A., & Sayed, M. J. E. (2020) · International Journal of Disaster Risk Reduction · doi:10.1016/j.ijdrr.2020.101889 · Cited by 52
Agrawal, A., Kumar, C., & Mukti, S. K. (2020) · Journal of the Knowledge Economy · doi:10.1007/s13132-020-00694-6 · Cited by 54
“The Delphi technique may be deemed as a method for structuring the group communication process of gathering opinions of experts, is designed to achieve a convergence of opinions and a specific real-world issue (Hsu and Sandford 2007).”
MethodFallah, M., & Ocampo, L. A. (2020) · Environment Systems & Decisions · doi:10.1007/s10669-020-09790-z · Cited by 47
“In conducting a Delphi study, the selection of the subject, the timing for completing the study, the possibility of low response rates of respondents, and accidental control of the feedback from the panel member must be considered in the planning and implementation stages (Hsu and Sandford 2007).”
BackgroundConstruction of evidence-based practice competencies for nurses in China: A modified Delphi study
Chen, L.-L., Wu, Y., Wang, S., Zhao, H., & Zhou, C. (2021) · Nurse Education Today · doi:10.1016/j.nedt.2021.104927 · Cited by 41
Rural and Remote Area Service Provision for People Aging With Intellectual Disability
Wark, S., Hussain, R., & Edwards, H. E. (2013) · Journal of Policy and Practice in Intellectual Disabilities · doi:10.1111/jppi.12017 · Cited by 41
Pierre, P. S., Millett, P. J., Abboud, J. A., Cordasco, F. A., Cuff, D. J., Dines, D. M., Dornan, G. J., Duralde, X. A., Galatz, L. M., Jobin, C. M., et al. (2021) · Journal of Shoulder and Elbow Surgery · doi:10.1016/j.jse.2021.05.012 · Cited by 42
Kunst, N., Siu, A., Drummond, M., Grimm, S. E., Grutters, J. P. C., Husereau, D., Koffijberg, H., Rothery, C., Wilson, E., & Heath, A. (2023) · Value in Health · doi:10.1016/j.jval.2023.06.014 · Cited by 46
Clinical Guidelines for Fecal Microbiota Transplantation in Companion Animals
Winston, J. A., Suchodolski, J. S., Gaschen, F. P., Busch, K., Marsilio, S., Costa, M., Chaitman, J., Coffey, E. L., Dandrieux, J. R. S., Gal, A., et al. (2024) · Advances in Small Animal Care · doi:10.1016/j.yasa.2024.06.006 · Cited by 53
The development of individual cognitive stimulation therapy (iCST) for dementia
Yates, L., Leung, P., Orgeta, V., Spector, A. E., & Orrell, M. W. (2014) · Clinical Interventions in Aging · doi:10.2147/cia.s73844 · Cited by 63
Teacher design teams as a strategy for professional development: the role of the facilitator
Becuwe, H., Tondeur, J., Roblin, N. P., Thys, J., & Castelein, E. (2016) · Educational Research and Evaluation · doi:10.1080/13803611.2016.1247724 · Cited by 67
Equitable leadership on the ground: Converging on high-leverage practices
Galloway, M. K., & Ishimaru, A. M. (2017) · Education Policy Analysis Archives · doi:10.14507/epaa.25.2205 · Cited by 40
“…technique is particularly useful when seeking group communication and consensus-building around a complex problem (Linstone & Turoff, 2002) and has a long history in health fields and in guiding policy determination (Ager, Stark, Akesson, & Boothby, 2010; Hsu & Sandford, 2007; Keeney et al., 2011).”
MethodThe competencies of Registered Nurses working in care homes: a modified Delphi study
Stanyon, M. R., Goldberg, S. E., Astle, A., Griffiths, A., & Gordon, A. L. (2016) · Age and Ageing · doi:10.1093/ageing/afw244 · Cited by 40
“The Delphi study was administered according to published guidelines [9, 30].”
MethodCreating a Toolkit to Reduce Disparities in Patient Engagement
Keddem, S., Agha, A. Z., Long, J. A., Werner, R. M., & Shea, J. A. (2017) · Medical Care · doi:10.1097/mlr.0000000000000748 · Cited by 42
“To narrow the universe of patient engagement practices and resources identified through qualitative analyses, a modified Delphi method was used, a technique used to build consensus through surveys and group communication.(31) The Delphi method utilizes experts on a particular topic to guide researchers on how to addre…”
MethodNew labour rights indicators: Method and trends for 2000–15
Kučera, D., & Sari, D. (2018) · International Labour Review · doi:10.1111/ilr.12084 · Cited by 40
“This clearly leaves room for improvement, and the use of the Delphi method to construct evaluation criteria weights represents our efforts in this regard (for more on the Delphi method, see Hsu and Sandford, 2007).”
MethodTrajectories of rewilding: A taxonomy of wildland management
Deary, H., & Warren, C. R. (2018) · Journal of Environmental Planning and Management · doi:10.1080/09640568.2018.1425134 · Cited by 47
“The Delphi method is a structured communication technique which distils the anonymous judgements of a panel of experts who, through an iterative procedure, develop their views and reasoning in the light of feedback from each successive round of the process (Hsu and Sandford, 2007; Glass et al., 2013).”
BackgroundMethodInternational definition of a point-of-care test in family practice: a modified e-Delphi procedure
Schols, A. M. R., Dinant, G., Hopstaken, R., Price, C. P., Kusters, R., & Cals, J. (2017) · Family Practice · doi:10.1093/fampra/cmx134 · Cited by 48
The construction and validation of a usability evaluation survey for mobile learning environments
Parsazadeh, N., Ali, R., Rezaei, M., & Tehrani, S. Z. (2018) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2018.06.002 · Cited by 53
Fetene, N. W., & Bezuidenhout, M. C. (2019) · Journal of Multidisciplinary Healthcare · doi:10.2147/jmdh.s193370 · Cited by 62
Expert opinions on the authenticity of moulage in simulation: a Delphi study
Stokes-Parish, J. B., Duvivier, R. J., & Jolly, B. C. (2019) · Advances in Simulation · doi:10.1186/s41077-019-0103-z · Cited by 46
“Despite planned administrative processes and clear objectives, the administration of this Delphi was time-consuming [42].”
The Role of Value Deliberation to Improve Stakeholder Participation in Issues of Water Governance
Pigmans, K., Aldewereld, H., Dignum, V., & Doorn, N. (2019) · Water Resources Management · doi:10.1007/s11269-019-02316-6 · Cited by 54
“This method is further able to determine a range of alternatives around a given discussion topic, and can also be used 4070 The Role of Value Deliberation to Improve Stakeholder Participation... to delineate the underlying assumptions they are based on (Hsu and Sandford 2007).”
MethodCorporate Social Responsibility on Disaster Resilience Issues by International Contractors
Lim, H. W., Zhang, F., Fang, D., Pena-Mora, F. A., & Liao, P. (2020) · Journal of Management in Engineering · doi:10.1061/(asce)me.1943-5479.0000861 · Cited by 40
Early Detection and Prognostic Assessment of Cutaneous Melanoma
Kashani–Sabet, M., Leachman, S. A., Stein, J., Arbiser, J. L., Berry, E., Celebi, J. T., Curiel‐Lewandrowski, C. N., Ferris, L. K., Grant-Kels, J. M., Grossman, D., et al. (2023) · JAMA Dermatology · doi:10.1001/jamadermatol.2023.0127 · Cited by 41
Murray, C. E., Crowe, A., & Akers, W. P. (2015) · Journal of Family Violence · doi:10.1007/s10896-015-9768-9 · Cited by 40
A MODEL OF SUCCESS FACTORS FOR E GOVERNMENT ADOPTION THE CASE OF POLAND
Ziemba, E. W., Papaj, T., & Żelazny, R. (2013) · Issues in Information Systems · doi:10.48009/2_iis_2013_87-100 · Cited by 41
“These were: a critical review of literature, action research [29, 51], brainstorming [76], the Delphi technique [53, 24, 40] and logical deduction.”
MethodWhitham, D., Turzanski, J., Bradshaw, L. E., Clarke, M. J., Culliford, L. A., Duley, L., Shaw, L. C., Skea, Z. C., Treweek, S. P., Walker, K. F., et al. (2018) · Trials · doi:10.1186/s13063-018-2940-9 · Cited by 39
“This can result in a false impression of how much consensus really exists [4], and may be due to participants losing interest, having insufficient time or holding minority views [13].”
BackgroundConsensus‐Based Technical Recommendations for Clinical Translation of Renal Phase Contrast MRI
de Boer, A., Villa, G., Bane, O., Bock, M., Cox, E. F., Dekkers, I. A., Eckerbom, P., Fernández‐Seara, M. A., Francis, S., Haddock, B., et al. (2020) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.27419 · Cited by 39
Giménez, M., Gallix, B., Costamagna, G., Vauthey, J., Moche, M., Wakabayashi, G., Bale, R. J., Swanström, L. L., Fütterer, J. J., Geller, D. A., et al. (2020) · Annals of Surgery Open · doi:10.1097/as9.0000000000000021 · Cited by 39
McCombe, G., Murtagh, S., Lazarus, J. V., Hout, M. C. V., Bachmann, M. O., Jaffar, S. S., Garrib, A. V., Ramaiya, K. L., Sewankambo, N. K., Mfinanga, S., et al. (2021) · BMC Health Services Research · doi:10.1186/s12913-021-07073-0 · Cited by 38
Attitudes on fertility issues in breast cancer patients: an Italian survey
Biglia, N., Torrisi, R., D’Alonzo, M., Codacci-Pisanelli, G., Rota, S., & Peccatori, F. A. (2015) · Gynecological Endocrinology · doi:10.3109/09513590.2014.1003293 · Cited by 39
Integrating Religion and Spirituality Into Counselor Education: Barriers and Strategies
Adams, C. M., Puig, A., Baggs, A. S., & Wolf, C. P. (2015) · Counselor Education and Supervision · doi:10.1002/j.1556-6978.2015.00069.x · Cited by 39
Identification of competencies for patient education in physiotherapy using a Delphi approach
Forbes, R., Mandrusiak, A., Smith, M. D., & Russell, T. G. (2017) · Physiotherapy · doi:10.1016/j.physio.2017.06.002 · Cited by 47
Chandra, D., & Kumar, D. (2017) · Expert Review of Vaccines · doi:10.1080/14760584.2018.1403322 · Cited by 41
“The Delphi process is a commonly used and accredited method for collecting information from respondents within their discipline of skills [13].”
MethodParson, L. J., Childs, B. S., & Elzie, P. (2018) · Health Professions Education · doi:10.1016/j.hpe.2018.03.008 · Cited by 63
Jones, C., Sung, B., & Moyle, W. (2018) · Journal of Advanced Nursing · doi:10.1111/jan.13717 · Cited by 50
O'Donnell, C. M., Black, N. D., McCourt, K. C., McBrien, M. E., Clarke, M. J., Patterson, C. C., Blackwood, B., McAuley, D. F., & Shields, M. O. (2018) · British Journal of Anaesthesia · doi:10.1016/j.bja.2018.08.017 · Cited by 41
Making teacher dispositions explicit: A participatory approach
Fonseca-Chacana, J. (2018) · Teaching and Teacher Education · doi:10.1016/j.tate.2018.10.018 · Cited by 47
Novel entities and technologies: Environmental benefits and risks
Bierbaum, R., Leonard, S. A., Rejeski, D. W., Whaley, C., Barra, R. O., & Libre, C. (2019) · Environmental Science & Policy · doi:10.1016/j.envsci.2019.11.002 · Cited by 47
Soukup, T., Morbi, A. H. M., Lamb, B. W., Gandamihardja, T., Hogben, K. R., Noyes, K., Skolarus, T. A., Darzi, A. W., Sevdalis, N., & Green, J. S. A. (2020) · Cancer Medicine · doi:10.1002/cam4.3026 · Cited by 44
dos Santos, N. O., Predebon, M. L., Bierhals, C. C. B. K., Day, C. B., Machado, D. D. O., & Paskulin, L. M. G. (2020) · Revista Brasileira de Enfermagem · doi:10.1590/0034-7167-2018-0894 · Cited by 39
Hughes, D. A., Aguiar, P., Deegan, P. B., Ezgü, F. S., Frustaci, A., Lidove, O., Linhart, A., Lubanda, J.-C., Moon, J., Nicholls, K., et al. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-035182 · Cited by 39
International consensus definition of low anterior resection syndrome
Keane, C., Fearnhead, N. S., Bordeianou, L., Christensen, P., Espín, E., Laurberg, S., Mellgren, A. F., Messick, C. A., Orangio, G. R., Verjee, A., et al. (2020) · ANZ Journal of Surgery · doi:10.1111/ans.15421 · Cited by 44
Knighting, K., O'Brien, M. R., Roe, B. H., Gandy, R. J., Lloyd‐Williams, M., Nolan, M., & Jack, B. (2015) · BMC Palliative Care · doi:10.1186/s12904-015-0010-6 · Cited by 44
“There is no consensus in the literature as to the appropriate number of subjects to involve in a Delphi study [39].”
BackgroundZhang, X., Xue, F., & He, M. (2023) · International Journal of Physical Distribution & Logistics Management · doi:10.1108/ijpdlm-11-2022-0346 · Cited by 52
Challenges of maritime human resource management for the transition to shipping digitalization
Theotokas, I., Lagoudis, I. N., & Raftopoulou, K. (2024) · Journal of Shipping and Trade · doi:10.1186/s41072-024-00165-0 · Cited by 85
“In every round, group members can reassess and modify their answers until their opinions converge (Hsu and Sandford 2007).”
BackgroundDeveloping nature-based tourism products with customers by utilising the Delphi method
Konu, H. (2015) · Tourism Management Perspectives · doi:10.1016/j.tmp.2015.03.003 · Cited by 45
Phillips, J. T., Erwin, A. A., Agrella, S., Kremenchutzky, M., Kramer, J. F., Darkes, M. J. M., Kendter, J., Abourjaily, H. M., Rana, J., & Fox, R. J. (2015) · Neurology and Therapy · doi:10.1007/s40120-015-0037-x · Cited by 38
“Key study attributes were the inclusion of health care professionals based on their high level of experience using DMF and whose number (n = 56) far exceeded that initially suggested and tested for such surveys to obtain consensus (n = 15–30) [8, 9, 12].”
BackgroundMethodPublish, Perish, or Salami Slice? Authorship Ethics in an Emerging Field
Pfleegor, A. G., Katz, M., & Bowers, M. T. (2017) · Journal of Business Ethics · doi:10.1007/s10551-017-3578-3 · Cited by 46
Araújo, A., Carvalho, A. A. S., Cavalcanti, E. B. U., Saute, J. A. M., de Carvalho, E. H. T., França, M. C., Martínez, A., Navarro, M. D. M. M., Nucci, A., de Resende, M. B. D., et al. (2017) · Arquivos de Neuro-Psiquiatria · doi:10.1590/0004-282x20170112 · Cited by 42
Inkoom, J. N., Frank, S., Greve, K., & Fürst, C. (2018) · Journal of Environmental Management · doi:10.1016/j.jenvman.2017.12.027 · Cited by 38
Marino, L. V., Johnson, M. J., Hall, N. J., Davies, N. J., Kidd, C. S., Daniels, M. L., Robinson, J. E., Richens, T., Bharucha, T., & Darlington, A. (2018) · Cardiology in the Young · doi:10.1017/s1047951118000549 · Cited by 43
“A larger group of experts are likely to deliver a broader range of expertise, in turn making it more challenging to achieve consensus.(81) Paediatric dietitians are usually the key healthcare professionals involved in the nutritional care of infants with CHD, and thus using their nutritional expertise for this modifie…”
Brazilian consensus on Duchenne muscular dystrophy. Part 2: rehabilitation and systemic care
Araújo, A., Nardes, F., Fortes, C. P. D. D., Pereira, J. A., Rebel, M. F., Dias, C. M., Barbosa, R. D. C. G. D. A., Lopes, M. V. R., Langer, A. L., Neves, F. R., et al. (2018) · Arquivos de Neuro-Psiquiatria · doi:10.1590/0004-282x20180062 · Cited by 38
Talking to Teens about Pain: A Modified Delphi Study of Adolescent Pain Science Education
Leake, H. B., Heathcote, L. C., Simons, L. E., Stinson, J., Kamper, S. J., Williams, C. M., Burgoyne, L. L., Craigie, M. J., Kammers, M. P. M., Moen, D., et al. (2019) · Canadian Journal of Pain · doi:10.1080/24740527.2019.1682934 · Cited by 46
“and expertise of the panelists is considered more important than the number.(23) G.”
BackgroundSustainable human resource management and employee engagement: A holistic assessment instrument
Diaz‐Carrion, R., López‐Fernández, M., & Romero‐Fernandez, P. M. (2020) · Corporate Social Responsibility and Environmental Management · doi:10.1002/csr.1921 · Cited by 38
Elucidation of big data analytics in banking: a four-stage Delphi study
Delgosha, M. S., Hajiheydari, N., & Fahimi, S. M. (2020) · Journal of Enterprise Information Management · doi:10.1108/jeim-03-2019-0097 · Cited by 64
A framework for the evaluation of InsurTech
Xu, X. L., & Zweifel, P. S. (2020) · Risk Management and Insurance Review · doi:10.1111/rmir.12161 · Cited by 53
Farr, E. R., Johnson, M. R., Nelson, M., Hare, J. A., Morrison, W. E., Lettrich, M. D., Vogt, B., Meaney, C., Howson, U. A., Auster, P. J., et al. (2021) · PLoS ONE · doi:10.1371/journal.pone.0260654 · Cited by 47
“Scoring was a two-step process similar to the Delphi approach [108, 109].”
Hazza, M. H. F. A., Abdel-Wahed, A., Ali, M. Y., & Sidek, A. A. (2022) · International Journal of Technology · doi:10.14716/ijtech.v13i1.4700 · Cited by 38
“Its goal is to converge their opinions about the specific issue (Hsu and Sandford, 2007).”
BackgroundMethodZolfani, S. H., Görçün, Ö. F., Kundu, P., & Küçükönder, H. (2022) · Computers & Industrial Engineering · doi:10.1016/j.cie.2022.108376 · Cited by 42
Ayres, B. D., Donnenfeld, E. D., Farid, M., Gaddie, I. B., Gupta, P. K., Holland, E. J., Karpecki, P. M., Lindstrom, R. L., Nichols, K. K., Pflugfelder, S. C., et al. (2023) · Eye · doi:10.1038/s41433-023-02500-4 · Cited by 44
Rossi, L. A., Frank, R. M., Wilke, D., Provencher, M. T., Millett, P. J., Romeo, A. A., Walch, G., Lo, I. K. Y., Yamamoto, N., Bokor, D. J., et al. (2021) · Arthroscopy The Journal of Arthroscopic and Related Surgery · doi:10.1016/j.arthro.2020.12.237 · Cited by 37
A Maturity Model for Scaling Agile Development
Stojanov, I., Türetken, O., & Trienekens, J. J. M. (2015) · Euromicro Conference on Software Engineering and Advanced Applications (SEAA) · doi:10.1109/seaa.2015.29 · Cited by 37
Soon, J. M., Davies, W. P., Chadd, S. A., & Baines, R. N. (2012) · Expert Systems with Applications · doi:10.1016/j.eswa.2012.01.189 · Cited by 39
“It could also be used to seek out information which may generate a consensus from the respondent group or to explore underlying assumptions or information leading to different judgements (Hsu & Sandford, 2007; Linstone & Murray, 2002, p. 3).”
BackgroundInappropriate prescribing in patients accessing specialist palliative day care services
Todd, A., Nazar, H., Pearson, S., Andrew, I., Baker, L., & Husband, A. (2014) · International Journal of Clinical Pharmacy · doi:10.1007/s11096-014-9932-y · Cited by 37
“Consensus for medication inappropriateness was defined according to agreement of seven of the ten respondents in line with previous Delphi processes [14].”
MethodDeveloping a core set of patient-reported outcomes in pancreatic cancer: A Delphi survey
Gerritsen, A., Jacobs, M., Henselmans, I., van Hattum, J. W., Efficace, F., Creemers, G., de Hingh, I. H. J. T., Koopman, M., Molenaar, I. Q., Wilmink, H. W., et al. (2016) · European Journal of Cancer · doi:10.1016/j.ejca.2016.01.001 · Cited by 37
“In a Delphi survey, a panel of experts are asked for their opinion on a question and subsequently re-polled with controlled feedback regarding the polled opinions, to encourage consensusbetween the (groupsof) experts [9].”
BackgroundRahaghi, F., Feldman, J. P., Allen, R. P., Tapson, V. F., Safdar, Z., Balasubramanian, V. P., Shapiro, S., Mathier, M. A., Elwing, J., Chakinala, M. M., et al. (2016) · Pulmonary Circulation · doi:10.1086/690109 · Cited by 38
Hadie, S. N. H., Hassan, A., Ismail, Z. I. M., Asari, M. A., Khan, A. A., Kasim, F., Yusof, N. A. M., Sulong, H. A. M., Muda, T. F. M. T., Arifin, W. N., et al. (2017) · Anatomical Sciences Education · doi:10.1002/ase.1683 · Cited by 54
Corbie-Smith, G. M., Wynn, M. R., Richmond, A., Rennie, S., Green, M. J., Hoover, S., Watson, S., & Nisbeth, K. S. (2018) · PLoS ONE · doi:10.1371/journal.pone.0199451 · Cited by 51
Expert consensus on a train‐the‐trainer curriculum for robotic colorectal surgery
Ruiz, M. G., Alfieri, S., Becker, T., Bergmann, M. M., Boggi, U., Collins, J. W., Figueiredo, N., Gögenür, I., Matzel, K. E., Mišković, D., et al. (2019) · Colorectal Disease · doi:10.1111/codi.14637 · Cited by 37
Tiede, A., Giangrande, P. L. F., Teitel, J. M., Amano, K., Benson, G. M., Nemes, L., Jiménez‐Yuste, V., d’Oiron, R., Fegoun, S. B. E., & Kessler, C. M. (2019) · Haemophilia · doi:10.1111/hae.13844 · Cited by 37
Cooper, A. M., Shope, A. J., Javid, M., Parsa, A., Chinoy, M. A., & Parvizi, J. (2019) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.19.00572 · Cited by 37
Core Set of Radiographic Parameters for Shoulder Arthroplasty Monitoring
Durchholz, H., Salomonsson, B., Moroder, P., Lambert, S. M., Page, R. S., Audigé, L., on behalf of the Shoulder Arthroplasty (SA) Monitoring Steering Group, Sperling, J. W., & Schwyzer, H. (2019) · JBJS Open Access · doi:10.2106/jbjs.oa.19.00025 · Cited by 37
Consensus Definition of Fetal Growth Restriction in Intrauterine Fetal Death: A Delphi Procedure
Beune, I. M., Damhuis, S. E., Ganzevoort, W., Hutchinson, J. C., Khong, T. Y., Mooney, E. E., Sebire, N. J., & Gordijn, S. J. (2020) · Archives of Pathology & Laboratory Medicine · doi:10.5858/arpa.2020-0027-oa · Cited by 46
Holmes, T. Q., & Brown, A. F. (2022) · Animals · doi:10.3390/ani12091186 · Cited by 54
“To address this issue, the structured elicitation of expert judgement using the Delphi method can be useful to obtain a consensus and informed decision-making [65,66].”
MethodChinedu, C. C., Saleem, A., & Muda, W. H. N. W. (2023) · Sustainability · doi:10.3390/su15032543 · Cited by 93
Ponting, S. S.-A., & Dillette, A. K. (2023) · International Journal of Contemporary Hospitality Management · doi:10.1108/ijchm-11-2022-1503 · Cited by 36
Exploring the Idea of Task in the Context of the Young Language Learner Classroom
Timpe‐Laughlin, V., Roters, B., & Butler, Y. G. (2024) · ETS Research Report Series · doi:10.1002/ets2.12389 · Cited by 42
Balance outcome measures in cerebellar ataxia: a Delphi survey
Winser, S. J., Smith, C., Hale, L. A., Claydon, L. S., & Whitney, S. L. (2014) · Disability and Rehabilitation · doi:10.3109/09638288.2014.913709 · Cited by 38
“Use of internet-based submission [30], blinding of the principal investigator, and an interdisciplinary approach for participant recruitment added strength to the survey findings [31].”
BackgroundGrand challenges for the Indian construction industry
Sawhney, A., Agnihotri, R., & Paul, V. K. (2014) · Built Environment Project and Asset Management · doi:10.1108/bepam-10-2013-0055 · Cited by 36
Fefer, J. P., Stone, S. D.-U., Daigle, J. J., & Silka, L. (2016) · SAGE Open · doi:10.1177/2158244016643141 · Cited by 49
“The approach used for this study is considered the classic Delphi, where descriptive statistics and facilitated dialogue are used to encourage idea generation and assess movement toward consensus among experts using three separate rounds of questionnaires (Hsu & Sanford, 2007).”
MethodStacey, D., Légaré, F., Lyddiatt, A., Giguere, A. M. C., Yoganathan, M., Saarimaki, A., Pardo, J. P., Rader, T., & Tugwell, P. (2016) · Patient · doi:10.1007/s40271-016-0177-9 · Cited by 42
A Causal Model of BIM Adoption in the Thai Architectural and Engineering Design Industry
Ngowtanasuwan, G. (2017) · Procedia Engineering · doi:10.1016/j.proeng.2017.04.240 · Cited by 36
Rice, D. B., Cañedo-Ayala, M., Turner, K. A., Gumuchian, S. T., Malcarne, V. L., Hagedoorn, M., & Thombs, B. D. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-019726 · Cited by 41
Adam, L., Jones, T. J., & Brömmelstroet, M. T. (2018) · Transportation · doi:10.1007/s11116-018-9878-3 · Cited by 36
“It has been used previously for policy investigation (Hsu and Sandford 2007). The Delphi technique is used in diverse types of futures research to achieve a convergence of opinion based on the real-world knowledge of experts in a specific field. It is applied to predict future events or scenarios where imperfect or li…”
InfluentialThe Global Spine Care Initiative: classification system for spine-related concerns
Haldeman, S., Johnson, C. D., Chou, R., Nordin, M. C., Côté, P., Hurwitz, E. L., Green, B. N., Kopansky-Giles, D. R., Cedraschi, C., Aartun, E., et al. (2018) · European Spine Journal · doi:10.1007/s00586-018-5724-8 · Cited by 36
Creissen, H. E., Jones, P., Tranter, R., Girling, R. D., Jess, S., Burnett, F. J., Gaffney, M. T., Thorne, F. S., & Kildea, S. (2019) · Pest Management Science · doi:10.1002/ps.5428 · Cited by 36
Metadata
- Authors
- Hsu, C.-C., & Sandford, B. A.
- Venue
- University of Massachusetts Amherst
- Publisher
- University of Massachusetts Amherst
- Published
- 2007
- Volume
- 12
- Issue
- 10
- Pages
- 10
- OpenAlex
- W2583504027
- Cited by
- 4,500
- References
- 40
- Citations by year
- 2026: 160 · 2025: 361 · 2024: 381 · 2023: 406 · 2022: 373 · 2021: 381 · 2020: 383 · 2019: 375 · 2018: 358 · 2017: 287 · 2016: 298 · 2015: 240 · 2014: 176 · 2013: 129 · 2012: 91
- FWCI
- 516.01
- Type
- journal article
- Language
- en
- Open access
- Licence
- cc-by-nc-nd
- Locations
- ScholarWorks@UMassAmherst (University of Massachusetts Amherst) (submittedVersion, cc-by-nc-nd)
- University of Massachusetts (UMass) Amherst
- Practical assessment, research & evaluation
- Topics
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Social Sciences › Decision Sciences › Management Science and Operations Research › Multi-Criteria Decision Making
- Social Sciences › Sociology and Political Science › Focus Groups and Qualitative Methods
- Keywords
- Delphi method, consensus building, expert opinion, participant selection, response rate, needs assessment, program planning, policy determination
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.