The Delphi Technique: Making Sense of Consensus
Open accessThe DOI matches its DataCite record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
The Delphi technique is a widely used and accepted method for gathering data from respondents within their domain of expertise. The technique is designed as a group communication process which aims to achieve a convergence of opinion on a specific real-world issue. The Delphi process has been used in various fields of study such as program planning, needs assessment, policy determination, and resource utilization to develop a full range of alternatives, explore or expose underlying assumptions, as well as correlate judgments on a topic spanning a wide range of disciplines. The Delphi technique is well suited as a method for consensus-building by using a series of questionnaires delivered using multiple iterations to collect data from a panel of selected subjects. Subject selection, time frames for conducting and completing a study, the possibility of low response rates, and unintentionally guiding feedback from the respondent group are areas which should be considered when designing and implementing a Delphi study. Accessed 68,465 times on https://pareonline.net from August 30, 2007 to December 31, 2019. For downloads from January 1, 2020 forward, please click on the PlumX Metrics link to the right.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“factors with a level of agreement ≥ 70% were extracted and included in the present review [19].”
From Healthcare professionals’ perspectives on artificial intelligence in patient care: a systematic review of hindering and facilitating factors on different levels (2025) · cites this paper as [19]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“To narrow the list into a usable checklist, we then used a three-step Delphi survey process [31].”
From PRISMA-S: an extension to the PRISMA Statement for Reporting Literature Searches in Systematic Reviews (2021) · cites this paper as [31]
The cited source says what the claim attributes to it.
In the citing paper
“The iteration characteristics of the Delphi technique have intrinsic limitations and might lead to groupthink, where participants might conform to dominant opinions of the group, which could affect objectivity.197”
From Definition and diagnostic criteria of clinical obesity (2025) · cites this paper as [197]
In the citing paper
“This anonymous and iterative group technique is designed to gather individual opinions from experts and transform these into a group consensus 6.”
From Diagnosis and treatment of chronic bacterial prostatitis and chronic prostatitis/chronic pelvic pain syndrome: a consensus guideline (2015) · cites this paper as [6]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Foundations of Behavioral Research
Stockton, R., & Kerlinger, F. N. (1974) · American Educational Research Journal · doi:10.2307/1162206 · Cited by 7,347
An Experimental Application of the DELPHI Method to the Use of Experts
Dalkey, N., & Helmer, O. (1963) · Management Science · doi:10.1287/mnsc.9.3.458 · Cited by 6,061
Research guidelines for the Delphi survey technique
Hasson, F. (2000) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2000.01567.x · Cited by 5,951 · cited 1×
“As such, Ludwig (1994) specifically addresses subject motivation as the key to the successful implementation of a Delphi study and investigators need to play an active role in this area to help ensure as high a response rate as possible.”
The Delphi Method: An Experimental Study of Group Opinion
(1969) · RAND Corporation eBooks · doi:10.7249/rm5888 · Cited by 1,628
Gazing into the oracle : the Delphi method and its application to social policy and public health
Ziglio, E., & Adler, M. E. (1996) · Jessica Kingsley Publishers eBooks · Cited by 1,429
Group Techniques for Program Planning
de Ven, A. V., & Delbecq, A. L. (1975) · Cited by 907
Technological forecasting for decision making
Martino, J. P. (1972) · Cited by 813
Experimental Study of Channel Patterns
SCHUMM, S. A., & KHAN, H. R. (1972) · Geological Society of America Bulletin · doi:10.1130/0016-7606(1972)83[1755:esocp]2.0.co;2 · Cited by 776
An experimental study of group opinion
Dalkey, N. (1969) · Futures · doi:10.1016/s0016-3287(69)80025-x · Cited by 750
Miller, G. (2001) · Tourism Management · doi:10.1016/s0261-5177(00)00067-4 · Cited by 604
Research works printed but not linked: 7
- Adams, S. J. (2001). Projecting the next decade in safety management: A Delphi technique study. Professional Safety, 46 (10), 26-29.
- Green, P. J. (1982, March). The content of a college-level outdoor leadership course. Paper presented at the Conference of the Northwest District Association for the American Alliance for Health, Physical Education, Recreation, and Dance, Spokane, WA.
- Jones, C. G. (1975). A Delphi evaluation of agreement between organizations. In H. A. Linstone, & M. Turoff (Eds.). The Delphi method: Techniques and applications (pp. 160-167). Reading, MA: Addison-Wesley Publishing Company.
- Kaplan, L. M. (1971). The use of the Delphi method in organizational communication: A case study. Unpublished master's thesis, The Ohio State University, Columbus.
- Linstone, H. A., & Turoff, M. (1975). Introduction. In H. A. Linstone, & M. Turoff (Eds.). The Delphi method: Techniques and applications (pp. 3-12). Reading, MA: Addison-Wesley Publishing Company.
- Ludlow, J. (1975). Delphi inquiries and knowledge utilization. In H. A. Linstone, & M. Turoff (Eds.). The Delphi method: Techniques and applications (pp. 102-123). Reading, MA: Addison-Wesley Publishing Company.
- Scheibe, M., Skutsch, M., & Schofer, J. (1975). Experiments in Delphi methodology. In H. A. Linstone, & M. Turoff (Eds.). The Delphi method: Techniques and applications (pp. 262-287). Reading, MA: Addison-Wesley Publishing Company.
Cited by
Items 901–1,000 of 1,013
Galipeau, J., Cobey, K. D., Barbour, V., Baskin, P. K., Bell-Syer, S. E., Deeks, J. J., Garner, P., Shamseer, L., Sharon, S., Tugwell, P., et al. (2017) · F1000Research · doi:10.12688/f1000research.12400.1 · Cited by 27
Musey, P. I., Lee, J. A., Hall, C. L., & Kline, J. A. (2018) · BMC Emergency Medicine · doi:10.1186/s12873-018-0161-x · Cited by 33
“, including both expert consensus and a modified Delphi technique [5, 6].”
MethodSurgical procedural map scoring for decision-making in laparoscopic cholecystectomy
Hashimoto, D. A., Axelsson, C. G. S., Jones, C. B., Phitayakorn, R., PETRUSA, E. R., McKinley, S. K., Gee, D. W., & Pugh, C. M. (2018) · The American Journal of Surgery · doi:10.1016/j.amjsurg.2018.11.011 · Cited by 27
Agarwala, A. V., Lane-Fall, M. B., Greilich, P. E., Burden, A. R., Ambardekar, A. P., Banerjee, A., Barbeito, A., Bryson, T. D., Greenberg, S., Lorinc, A. N., et al. (2019) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000004118 · Cited by 31
Change Orders on Road Maintenance Contracts: Causes and Preventive Measures
Shrestha, K. K., & Shrestha, P. P. (2019) · Journal of Legal Affairs and Dispute Resolution in Engineering and Construction · doi:10.1061/(asce)la.1943-4170.0000299 · Cited by 37
Tousignant‐Laflamme, Y., Cook, C. E., Mathieu, A., Naye, F., Wellens, F., Wideman, T. H., Martel, M. O., & Lam, O. T. (2019) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.13190 · Cited by 30
A tool for measuring environmental resilience to floods in Tanzania water supply systems
Sweya, L. N., & Wilkinson, S. J. (2020) · Ecological Indicators · doi:10.1016/j.ecolind.2020.106165 · Cited by 27
US primary care in 2029: A Delphi survey on the impact of machine learning
Blease, C., Kharko, A., Locher, C., DesRoches, C. M., & Mandl, K. D. (2020) · PLOS ONE · doi:10.1371/journal.pone.0239947 · Cited by 27
Elgabry, M., Nesbeth, D., & Johnson, S. D. (2020) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2020.571672 · Cited by 29
Virgara, R., Phillips, A., Lewis, L. K., Richardson, M., & Maher, C. A. (2021) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-020-01061-z · Cited by 26
“3, rather than the usual 15–20 that are used in Delphi surveys [25].”
BackgroundEvangelidis, N., Sautenet, B., Madero, M., Tong, A., Ashuntantang, G., Cortés–Sanabria, L., de Boer, I. H., Fung, S. K. S., Gallego, D., Levey, A. S., et al. (2021) · Trials · doi:10.1186/s13063-021-05574-1 · Cited by 29
Validation of Lean Manufacturing Implementation Framework Using Delphi Technique
Nordin, N., Deros, B. M., Wahab, D. A., & Rahman, M. N. A. (2012) · Jurnal Teknologi · doi:10.11113/jt.v59.1596 · Cited by 40
“Delphi technique is a process of gathering opinions of experts, which designed to achieve a convergence of opinions on a specific real-world issue [19].”
BackgroundMethodResultInfluentialDefining recovery from anorexia nervosa: a Delphi study to determine expert practitioners’ views
Dawson, L., Rhodes, P., & Touyz, S. W. (2015) · Advances in Eating Disorders · doi:10.1080/21662630.2015.1009145 · Cited by 31
“This process encourages panel members to gradually expand their insights, clarify their positions, and become more thoughtful and solution-oriented over time (Hsu & Sandford, 2007).”
BackgroundMidlöv, P., Höglund, P., Eriksson, T., Diehl, A., & Edgren, G. (2015) · Basic & Clinical Pharmacology & Toxicology · doi:10.1111/bcpt.12436 · Cited by 30
EFP Delphi study on the trends in Periodontology and Periodontics in Europe for the year 2025
Madianos, P., Papaioannou, W., Herrera, D., Sanz, M., Bäumer, A., Bogren, A., Bouchard, P., Chomyszyn‐Gajewska, M., Demirel, K., Gašperšič, R., et al. (2016) · Journal Of Clinical Periodontology · doi:10.1111/jcpe.12551 · Cited by 27
Denisa, L., & Ďaďo, J. (2013) · Journal of Competitiveness · doi:10.7441/joc.2013.04.02 · Cited by 27
Complications to evaluate adult trauma care
Moore, L., Lauzier, F., Stelfox, H. T., Sage, N. L., Bourgeois, G., Clément, J., Shemilt, M., & Turgeon, A. F. (2014) · The Journal of Trauma: Injury, Infection, and Critical Care · doi:10.1097/ta.0000000000000366 · Cited by 26
Parameter Values for Epidemiological Models of Foot-and-Mouth Disease in Swine
Kinsley, A. C., Patterson, G., VanderWaal, K. L., Craft, M. E., & Perez, A. M. (2016) · Frontiers in Veterinary Science · doi:10.3389/fvets.2016.00044 · Cited by 27
Weise, J. C., Fisher, K. R., & Trollor, J. N. (2017) · Journal of Applied Research in Intellectual Disabilities · doi:10.1111/jar.12407 · Cited by 32
A participatory sustainability assessment for integrated watershed management in urban China
Brombal, D., Niu, Y., Pizzol, L., Moriggi, A., Wang, J., Critto, A., Jiang, X., Liu, B., & Marcomini, A. (2018) · Environmental Science & Policy · doi:10.1016/j.envsci.2018.03.020 · Cited by 32
International consensus on laryngeal preservation strategies in laryngeal and hypopharyngeal cancer
Ferrari, M., Mularoni, F., Smussi, D., Gaudioso, P., Bonomo, P., Friborg, J., Ghi, M. G., Grégoire, V., Harrington, K. J., Hunter, K. D., et al. (2025) · The Lancet Oncology · doi:10.1016/s1470-2045(25)00020-8 · Cited by 40
Akers, A. L., Albanese, J. S., Alcazar‐Félix, R. J., Salman, R. A., Awad, I. A., Connolly, E. S., Danehy, A. R., Flemming, K. D., Gordon, E. L., Hage, S. F., et al. (2025) · Neurosurgery · doi:10.1227/neu.0000000000003459 · Cited by 39
Ramsey, J. W., & Edwards, M. C. (2011) · Journal of Agricultural Education · doi:10.5032/jae.2011.02082 · Cited by 26
“Twenty–four skills, for which less than 51% of the respondents scored the item a “5” or “6,” were removed from further investigation as a result of round two (Hsu & Sandford, 2007; Jenkins, 2009).”
BackgroundMethodChronic Pain in the Newborn: Toward a Definition
van Ganzewinkel, C., Anand, K. J. S., Kramer, B. W. W., & Andriessen, P. (2013) · Clinical Journal of Pain · doi:10.1097/ajp.0000000000000056 · Cited by 35
Mendes, J., & da Silva, L. J. (2013) · Advances in Neonatal Care · doi:10.1097/anc.0000000000000037 · Cited by 36
Protocol for the development of a salutogenic intrapartum core outcome set (SIPCOS)
Smith, V. A., Daly, D., Lundgren, I., Eri, T. S., Begley, C., Groß, M. M., Downe, S. M., Alfirević, Ž., & Devane, D. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0341-5 · Cited by 30
“The Delphi method is an optimum design for completing phase two of this proposed study as it will facilitate a means of consensus-building by using a series of questionnaires/data collection instruments to collect data from a panel of expert service users, clinicians, researchers and appropriate others on the topic un…”
MethodDetermining the Underlying Dimensions of Quality of Work Life (QWL) in the Nigerian Hotel Industry
Kwahar, N., & Iyortsuun, A. S. (2018) · Entrepreneurial Business and Economics Review · doi:10.15678/eber.2018.060103 · Cited by 33
“Research studies by Reithinam and Ismail (2008), Easton and Van Larr (2013), Hunker (2014), Sojka (2014), Gauri (2015) and Swamy et al.”
BackgroundCairo, S. B., Arbuthnot, M. K., Boomer, L. A., Dingeldein, M. W., Feliz, A., Gadepalli, S. K., Newton, C. R., Ricca, R. L., Vogel, A. M., & Rothstein, D. H. (2018) · Pediatric Surgery International · doi:10.1007/s00383-018-4337-y · Cited by 26
“To address these controversial topics in the management of CDH, a three-step modified Delphi method was employed [11].”
MethodDragomir, A. I., Boucher, V. G., Bacon, S., Gemme, C., Szczepanik, G., Corace, K. M., Campbell, T. S., Vallis, M. T., Garber, G. E., Rouleau, C. R., et al. (2020) · Translational Behavioral Medicine · doi:10.1093/tbm/ibaa015 · Cited by 30
Bunnell, L., Osei-Bryson, K.-M., & Yoon, V. (2020) · Decision Support Systems · doi:10.1016/j.dss.2020.113306 · Cited by 37
Miedany, Y. M. E., Abu-Zaid, M. H., Gaafary, M. M. E., Naby, M. M. H. E., Fathi, N. A., Saber, H. G., Hassan, W. A., Eissa, M., Mohannad, N., Khaled, H. F., et al. (2021) · Egyptian Rheumatology and Rehabilitation · doi:10.1186/s43166-020-00056-9 · Cited by 27
Finding consensus on indicators for organizational climate capacity in sport
Orr, M. (2021) · Managing Sport and Leisure · doi:10.1080/23750472.2021.1914710 · Cited by 30
Diskin, C., Malik, K. E., Gill, P. J., Rashid, N., Chan, C., Nelson, K., Thomson, J. E., Berry, J. G., Agrawal, R., Orkin, J., et al. (2021) · Developmental Medicine & Child Neurology · doi:10.1111/dmcn.15037 · Cited by 29
Grigoriadou, S., Clubbe, R., Garcez, T. P., Huissoon, A. P., Grosse‐Kreul, D., Jolles, S. R. A., Henderson, K., Edmonds, J., Lowe, D. M., & Bethune, C. (2022) · Clinical & Experimental Immunology · doi:10.1093/cei/uxac070 · Cited by 28
“A threshold of 75% of agreement (strongly agree or agree) or disagreement (strongly disagree or disagree) was chosen to define consensus agreement [2].”
MethodAbiri, B., Valizadeh, M., Amini, S., Kelishadi, R., & Hosseinpanah, F. (2023) · Obesity Reviews · doi:10.1111/obr.13548 · Cited by 29
Gallée, J., Cartwright, J., Volkmer, A., Whitworth, A., & Hersh, D. (2023) · American Journal of Speech-Language Pathology · doi:10.1044/2022_ajslp-22-00122 · Cited by 30
Open strategy as a catalyst for innovation: Evidence from cross-sector social partnerships
Pittz, T. G., & Adler, T. R. (2023) · Journal of Business Research · doi:10.1016/j.jbusres.2023.113696 · Cited by 32
Sirotti, S., Terslev, L., Filippucci, E., Iagnocco, A., Möller, I., Naredo, E., Vreju, F. A., Adinolfi, A., Becce, F., Hammer, H. B., et al. (2023) · The Lancet Rheumatology · doi:10.1016/s2665-9913(23)00136-4 · Cited by 26
Consensus on surgical technique for sentinel lymph node dissection in cervical cancer
Bizzarri, N., Obermair, A., Hsu, H., Chacón, E., Collins, A., Tsibulak, I., Mutombo, A. B., Abu‐Rustum, N. R., Balaya, V., Buda, A. A., et al. (2024) · International Journal of Gynecological Cancer · doi:10.1136/ijgc-2023-005151 · Cited by 27
Best Practices for Dealing with Price Volatility in Commercial Construction
Weidman, J. E., Miller, K. R., Christofferson, J. P., & Newitt, J. S. (2011) · International Journal of Construction Education and Research · doi:10.1080/15578771.2011.552936 · Cited by 35
“”(Hsu, 2007) These subjects should have a competent knowledge of the industry and to be considered as a panel member for this study, each member must have exhibited a high level of expertise in the commercial construction industry, have at least a minimum of ten years of construction experience and still be actively i…”
BackgroundMakkar, S. R., Williamson, A. B., Turner, T., Redman, S., & Louviere, J. J. (2015) · Health Research Policy and Systems · doi:10.1186/s12961-015-0013-z · Cited by 26
A Study to Compare Relative Importance of Criteria for Supplier Evaluation in e-Procurement
Pani, A. K., & Kar, A. K. (2011) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2011.35 · Cited by 26
Estepp, C. M., Velasco, J. G., Culbertson, A. L., & Conner, N. W. (2016) · Journal of Hispanic Higher Education · doi:10.1177/1538192716661906 · Cited by 30
“A modified Delphi technique methodology was selected due to its ability to gather opinions and form a consensus from a purposefully selected panel of experts (Dalkey, 1969, 2002; Helmer, 1966; Hsu & Sandford, 2007).”
BackgroundMethodWiangkham, T., Duda, J. L., Haque, S. M., & Rushton, A. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-011764 · Cited by 26
Hughes, A., Bouças, S. B., Burridge, J. H., Murphy, M. A., Buurke, J. H., Feys, P., Klamroth-Marganska, V., Lamers, I., Prange-Lasonder, G. B., Timmermans, A. A. A., et al. (2016) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-016-0192-z · Cited by 26
Nguyen, A. T., Vu, A. D., Dang, G. S., Hoang, A. H., & Hens, L. (2017) · Environment Development and Sustainability · doi:10.1007/s10668-017-9908-x · Cited by 28
“The reliability of the Delphi results largely depends on the selection of the panel members, the open questions of the preliminary stage, using communication techniques adapted to the specific needs, and addressing problems the panel members are familiar with during different rounds (Hsu and Sandford 2007; Lund et al.…”
BackgroundInfluentialGagliardi, D., Rondinone, B. M., Mirabile, M., Buresti, G., ELLWOOD, P. A., Héry, M., Paszkiewicz, P., Valenti, A., & Iavicoli, S. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-015336 · Cited by 26
“15–20 The main features of the Delphi method (anonymity, iteration, controlled feedback, statistical ‘group response’) make it more suitable than others to obtain the opinion of a panel of experts on a predetermined topic, especially when dealing with geographically dispersed participants(25) or when the information a…”
MethodThomsen, A. S. S., la Cour, M., Paltved, C., Lindorff‐Larsen, K., Nielsen, B. U., Konge, L., & Nayahangan, L. J. (2018) · Acta Ophthalmologica · doi:10.1111/aos.13700 · Cited by 26
A PCA-Based Model to Predict Adversarial Examples on Q-Learning of Path Finding
Xiang, Y., Niu, W., Liu, J., Chen, T., & Han, Z. (2018) · IEEE International Conference on Data Science in Cyberspace · doi:10.1109/dsc.2018.00125 · Cited by 31
“factors), and the main existing methods are: analytic hierarchy process method(AHP) [17] and expert research method (Delphi) [18].”
MethodCullerton, K. B., Adams, J., Francis, O., Forouhi, N. G., & White, M. (2019) · PLoS ONE · doi:10.1371/journal.pone.0221250 · Cited by 31
Consensus on Criteria for Good Practices in Video Consultation: A Delphi Study
Jiménez‐Rodríguez, D., Salvador, D. R., Salvador, M. D. M. R., Pérez-Heredia, M., Ronda, F. J. M., & Arrogante, Ó. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17155396 · Cited by 33
“Regarding the quantitative data collected, as a 4-point Likert response scale was used, the criteria used to decide the consensus on the inclusion of each element proposed were as follows [35,43]:”
BackgroundMethodInfluentialThe future of French museums in 2030
Pauget, B., Tobelem, J.-M., & Bootz, J. (2020) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2020.120384 · Cited by 36
Boerner, K. E., Coulombe, J. A., & Corkum, P. V. (2014) · Behavioral Sleep Medicine · doi:10.1080/15402002.2013.874348 · Cited by 29
Evidence‐Based Practice Process Quality Assessment: EPQA Guidelines
Lee, M. C., Johnson, K. L., Newhouse, R. P., & Warren, J. I. (2013) · Worldviews on Evidence-Based Nursing · doi:10.1111/j.1741-6787.2012.00264.x · Cited by 31
Fu, J. S., & Lai, C. (2019) · Journal of Computer-Mediated Communication · doi:10.1093/jcmc/zmz020 · Cited by 28
Cardiometabolic health in people with HIV: expert consensus review
Batterham, R. L., Bedimo, R., Diaz, R. S., Guaraldi, G., Lo, J., Martínez, E., McComsey, G. A., Milinkovic, A., Naito, T., Noé, S., et al. (2024) · Journal of Antimicrobial Chemotherapy · doi:10.1093/jac/dkae116 · Cited by 31
Which failures do patient‐specific quality assurance systems need to catch?
O'Daniel, J. C., Hernández, V., Clark, C. H., Esposito, M., Lehmann, J., McNiven, A., Olaciregui-Ruiz, I., & Kry, S. F. (2024) · Medical Physics · doi:10.1002/mp.17468 · Cited by 25
Güneş, A., & Kaban, A. L. (2025) · Higher Education Quarterly · doi:10.1111/hequ.70057 · Cited by 25
Implementing Sustainability Criteria for Selecting a Roof Assembly Typology in Medium Span Buildings
Canto-Perello, J., Martinez-Garcia, M., Curiel‐Esparza, J., & Martin-Utrillas, M. (2015) · Sustainability · doi:10.3390/su7066854 · Cited by 30
Senaji, T. A., Metwally, E. K., Sejjaaka, S. K., Puplampu, B. B., Michaud, J., & Hassan, A. R. (2014) · Canadian Journal of Administrative Sciences / Revue Canadienne des Sciences de l Administration · doi:10.1002/cjas.1298 · Cited by 25
Atkinson, J., Paépe, K. D., Sánchez–Pozo, A., Rekkas, D. M., Volmer, D., Hirvonen, J. J., Božič, B., Skowron, A., Mircioiu, C., Marcincal, A., et al. (2015) · Pharmacy · doi:10.3390/pharmacy3040307 · Cited by 25
“Thus, the project uses a modified Delphi approach [26]:”
MethodPorta-Sales, J., Pérez, C., Escobar, Y., & Martínez, V. (2015) · Clinical & Translational Oncology · doi:10.1007/s12094-015-1468-7 · Cited by 27
Geerse, O. P., Wynia, K., Kruijer, M., Schotsman, M. J., Hiltermann, T. J. N., & Berendsen, A. J. (2016) · Supportive Care in Cancer · doi:10.1007/s00520-016-3439-0 · Cited by 27
“To develop the Cancer Survivor Core Set, we performed a Delphi study [14] followed by a validation study [15].”
MethodComputing Teachers' Perspectives on Threshold Concepts
Kallia, M., & Sentance, S. (2017) · Workshop in Primary and Secondary Computing Education · doi:10.1145/3137065.3137085 · Cited by 30
Development of a Brazilian Food Truck Risk Assessment Instrument
Auad, L. I., Ginani, V. C., Leandro, E. D. S., Farage, P., Nunes, A. C. S., & Zandonadi, R. P. (2018) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph15122624 · Cited by 28
“Widely employed and accepted in various fields to achieve convergence of opinion of experts in certain topic areas, the Delphi method is designed as a group communication process which allows each participant an opportunity to conduct detailed examinations and discussions of a specific issue by using a series of quest…”
MethodVeziari, Y., Kumar, S., & Leach, M. (2018) · BMC Complementary and Alternative Medicine · doi:10.1186/s12906-018-2352-0 · Cited by 28
“No guidance on appropriate sample sizes for Delphi studies [31] currently exists.”
BackgroundRisk assessment model based on expert's perspective for ballast water management
Cheng, M., Liu, T., Olenin, S., & Su, P.-X. (2019) · Ocean & Coastal Management · doi:10.1016/j.ocecoaman.2019.01.009 · Cited by 28
McFayden, C. B., Boychuk, D., Woolford, D. G., Wheatley, M. J., & Johnston, L. M. (2019) · International Journal of Wildland Fire · doi:10.1071/wf18189 · Cited by 27
“The Delphi technique is a widely accepted way to gather data from domain experts to elicit their judgements and reach a consensus (Hasson et al. 2000; Hsu and Sandford 2007).”
MethodImplementation of government-directed policy in the hospital setting: a modified Delphi study
Havers, S. M., Martin, E. K., Wilson, A. J., & Hall, L. (2019) · Health Research Policy and Systems · doi:10.1186/s12961-019-0500-8 · Cited by 30
Lak, A., & Kheibari, S. Z. (2020) · Geoforum · doi:10.1016/j.geoforum.2020.07.003 · Cited by 25
Truelove, M. A., Martin, J., Langford, F. M., & Leach, M. C. (2020) · Scientific Reports · doi:10.1038/s41598-020-77437-9 · Cited by 26
Wagner, M., Jaki, C., Löllgen, R., Mileder, L. P., Eibensteiner, F., Ritschl, V., Steinbauer, P., Gottstein, M., Abulebda, K., Calhoun, A. W., et al. (2020) · Pediatric Critical Care Medicine · doi:10.1097/pcc.0000000000002649 · Cited by 25
Strategy tools in dynamic environments – An expert-panel study
Rengarajan, S., Moser, R., & Narayanamurthy, G. (2021) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2020.120560 · Cited by 32
Kim, S., Lee, T. W., Kim, G. S., Cho, E., Jang, Y., Choi, M., Baek, S., Lindsay, D., Chan, S. W., Lee, R., et al. (2021) · Human Resources for Health · doi:10.1186/s12960-021-00555-6 · Cited by 25
Identifying institutional factors in general surgery resident wellness and burnout
Foote, D. C., Donkersloot, J. N., Sandhu, G., Ziegler, K. M., & Lau, J. N. (2021) · The American Journal of Surgery · doi:10.1016/j.amjsurg.2021.07.014 · Cited by 27
Promoting Sustainability through Regional Food and Wine Pairing
Serra, M., António, N., Henriques, C., & Afonso, C. M. (2021) · Sustainability · doi:10.3390/su132413759 · Cited by 25
“The perception of detail is only reached by experts [72].”
BackgroundFarberg, A. S., Marson, J. W., Glazer, A. M., Litchman, G. H., Svoboda, R. M., Winkelmann, R. R., Brownstone, N. D., Rigel, D. S., & The Skin Cancer Prevention Working Group (2022) · Dermatology and Therapy · doi:10.1007/s13555-022-00709-x · Cited by 28
“A modified Delphi technique was used to achieve consensus among panel members [18].”
MethodMetaverse for Exercise Rehabilitation: Possibilities and Limitations
Cho, K.-H., Park, J.-B., & Kang, A. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20085483 · Cited by 33
“The Delphi method is the process of collecting opinions on a particular research question, using a series of questionnaires to generate expert opinion in an anonymous fashion, and taking place over a series of rounds [31].”
MethodZhu, X., Li, H., & Su, T. (2023) · Automation in Construction · doi:10.1016/j.autcon.2023.105074 · Cited by 31
“The data augmentation technique and Delphi method [50] are applied to further enhance the quality and reliability of this domain dataset.”
Developmental Contexts and Features of Elite Academy Football Players: Coach and Player Perspectives
Morley, D., Morgan, G., McKenna, J., & Nicholls, A. R. (2014) · International Journal of Sports Science & Coaching · doi:10.1260/1747-9541.9.1.217 · Cited by 45
“The Delphi Poll technique was an appropriate tool to use for this project as it facilitated the generation of a consensus [20] and had the potential to maximise engagement of the end-user.”
Zubala, A., MacIntyre, D. J., Gleeson, N., & Karkou, V. (2013) · The Arts in Psychotherapy · doi:10.1016/j.aip.2013.09.003 · Cited by 27
Gallardo‐Vázquez, D., Hernández, M. I. S., & Polo, F. C. (2014) · Management Research The Journal of the Iberoamerican Academy of Management · doi:10.1108/mrjiam-10-2013-0524 · Cited by 28
Baek, H., & Park, S. (2015) · Sustainability · doi:10.3390/su7021308 · Cited by 28
“The process of reaching a conclusion via a conventional conference has the disadvantage of resulting in decisions that lack subjectivity, due to influences from the surrounding environment [17].”
BackgroundMori, B., Brooks, D., Norman, K. E., Herold, J., & Beaton, D. (2015) · Physiotherapy Canada · doi:10.3138/ptc.2014-29e · Cited by 26
Workplace Issues in Extension—A Delphi Study of Extension Educators
Kroth, M., & Peutz, J. (2011) · Journal of Extension · doi:10.34068/joe.49.01.17 · Cited by 31
“Methodology The Delphi technique, developed in the early 1950's (Hsu & Sandford, 2007), was used in the study to obtain opinions from Extension educators/agents about workplace issues that are most the most important concerning educator/agent attraction, motivation, and retention over the next 5 to…”
BackgroundMethodCollective intelligence in medical diagnosis systems: A case study
Hernández-Chan, G., Ceh-Varela, E., Sánchez-Cervantes, J. L., Villanueva-Escalante, M., Rodríguez‐González, A., & Gallardo, Y. P. (2016) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2016.04.016 · Cited by 26
Ingram, D. L., Hall, C. R., & Knight, J. (2016) · HortScience · doi:10.21273/hortsci.51.8.989 · Cited by 30
Manyazewal, T., Oosthuizen, M. J., & Matlakala, M. C. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-012582 · Cited by 30
Ssebunya, B. R., Schmid, E., van Asten, P., Schader, C., Altenbuchner, C., & Stolze, M. (2016) · Renewable Agriculture and Food Systems · doi:10.1017/s1742170516000363 · Cited by 33
“However, clarity of the research subject, time frames, the possibility of low response rates, and unintentionally guiding feedback from panelists can be challenges in designing and implementing a successful Delphi (Hsu and Sandford, 2007).”
BackgroundIdentification of foot and mouth disease risk areas using a multi-criteria analysis approach
dos Santos, D. V., Silva, G. S., Weber, E. J., Hasenack, H., Groff, F. H. S., Todeschini, B., Borba, M. R., Medeiros, A. A. R., Leotti, V. B., Canal, C. W., et al. (2017) · PLoS ONE · doi:10.1371/journal.pone.0178464 · Cited by 25
Gwee, K., Lee, W. W., Ling, K. L., Ooi, C. J., Quak, S. H., Dan, Y. Y., Siah, K. T. H., Huang, J. G., Chua, A. S. B., Hilmi, I. N., et al. (2018) · Journal of Gastroenterology and Hepatology · doi:10.1111/jgh.14268 · Cited by 27
Developing Resident-Sensitive Quality Measures: Engaging Stakeholders to Inform Next Steps
Schumacher, D. J., Martini, A., Holmboe, E. S., Varadarajan, K. R., Busari, J. O., van der Vleuten, C. P. M., & Carraccio, C. L. (2018) · Academic Pediatrics · doi:10.1016/j.acap.2018.09.013 · Cited by 25
Development of a non-domestic building refurbishment scheme for Malaysia: A Delphi approach
Kamaruzzaman, S. N., Lou, E. C. W., Wong, P. F., Edwards, R. E., Hamzah, N., & Ghani, M. K. (2018) · Energy · doi:10.1016/j.energy.2018.11.020 · Cited by 28
Gogovor, A., Zomahoun, H. T. V., Charif, A. B., McLean, R. K. D., Moher, D., Milat, A., Wolfenden, L., Prévost, K., Aubin, E., Rochon, P. A., et al. (2020) · Systematic Reviews · doi:10.1186/s13643-019-1258-3 · Cited by 25
Entrustable Professional Activities in Orthopaedics
Watson, A., Leroux, T. S., Ogilvie‐Harris, D. J., Nousiainen, M. T., Ferguson, P. C., Murnaghan, M. L., & Dwyer, T. (2021) · JBJS Open Access · doi:10.2106/jbjs.oa.20.00010 · Cited by 34
Harris, C. L., & Holloway, S. (2012) · International Wound Journal · doi:10.1111/j.1742-481x.2011.00925.x · Cited by 26
Elfeddali, I., Van der Feltz-Cornelis, C., Van Os, J., Knappe, S., Vieta, E., Wittchen, H.-U., Obradors-Tarragó, C., & Haro, J. (2014) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph111010915 · Cited by 25
Marques, A. I., Santos, L., Soares, P., Santos, R., Oliveira-Tavares, A., Mota, J., & Carvalho, J. (2011) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/1479-5868-8-104 · Cited by 24
“The results of previous iterations can be modified by participants in later iterations, as they are able to review comments and feedbacks provided by other experts in earlier rounds [31].”
BackgroundZaidman, C. M., Goedeker, N. L., Aqul, A. A., Butterfield, R. J., Connolly, A. M., Crystal, R. G., Godwin, K. E., Hor, K. N., Mathews, K. D., Proud, C. M., et al. (2024) · Journal of Neuromuscular Diseases · doi:10.3233/jnd-230185 · Cited by 26
“TheDelphitechniqueisrigorous, reliesonthehighlevelofexpertiseandcredibility of the panel, and allows for the exploration of complex clinical questions [17, 18].”
BackgroundOptimal management of radiation pneumonitis: Findings of an international Delphi consensus study
Voruganti, I. S., Cunningham, C., McLeod, L., Bahig, H., Chaudhuri, N., Chua, K. L. M., Evison, M., Finn, C. F., Franks, K., Harden, S., et al. (2024) · Lung Cancer · doi:10.1016/j.lungcan.2024.107822 · Cited by 32
Metadata
- Authors
- Hsu, C.-C., & Sandford, B. A.
- Venue
- University of Massachusetts Amherst
- Publisher
- University of Massachusetts Amherst
- Published
- 2007
- Volume
- 12
- Issue
- 10
- Pages
- 10
- OpenAlex
- W2583504027
- Cited by
- 4,500
- References
- 40
- Citations by year
- 2026: 160 · 2025: 361 · 2024: 381 · 2023: 406 · 2022: 373 · 2021: 381 · 2020: 383 · 2019: 375 · 2018: 358 · 2017: 287 · 2016: 298 · 2015: 240 · 2014: 176 · 2013: 129 · 2012: 91
- FWCI
- 516.01
- Type
- journal article
- Language
- en
- Open access
- Licence
- cc-by-nc-nd
- Locations
- ScholarWorks@UMassAmherst (University of Massachusetts Amherst) (submittedVersion, cc-by-nc-nd)
- University of Massachusetts (UMass) Amherst
- Practical assessment, research & evaluation
- Topics
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Social Sciences › Decision Sciences › Management Science and Operations Research › Multi-Criteria Decision Making
- Social Sciences › Sociology and Political Science › Focus Groups and Qualitative Methods
- Keywords
- Delphi method, consensus building, expert opinion, participant selection, response rate, needs assessment, program planning, policy determination
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.