The Delphi Technique: Making Sense of Consensus
Open accessThe DOI matches its DataCite record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
The Delphi technique is a widely used and accepted method for gathering data from respondents within their domain of expertise. The technique is designed as a group communication process which aims to achieve a convergence of opinion on a specific real-world issue. The Delphi process has been used in various fields of study such as program planning, needs assessment, policy determination, and resource utilization to develop a full range of alternatives, explore or expose underlying assumptions, as well as correlate judgments on a topic spanning a wide range of disciplines. The Delphi technique is well suited as a method for consensus-building by using a series of questionnaires delivered using multiple iterations to collect data from a panel of selected subjects. Subject selection, time frames for conducting and completing a study, the possibility of low response rates, and unintentionally guiding feedback from the respondent group are areas which should be considered when designing and implementing a Delphi study. Accessed 68,465 times on https://pareonline.net from August 30, 2007 to December 31, 2019. For downloads from January 1, 2020 forward, please click on the PlumX Metrics link to the right.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“factors with a level of agreement ≥ 70% were extracted and included in the present review [19].”
From Healthcare professionals’ perspectives on artificial intelligence in patient care: a systematic review of hindering and facilitating factors on different levels (2025) · cites this paper as [19]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“To narrow the list into a usable checklist, we then used a three-step Delphi survey process [31].”
From PRISMA-S: an extension to the PRISMA Statement for Reporting Literature Searches in Systematic Reviews (2021) · cites this paper as [31]
The cited source says what the claim attributes to it.
In the citing paper
“The iteration characteristics of the Delphi technique have intrinsic limitations and might lead to groupthink, where participants might conform to dominant opinions of the group, which could affect objectivity.197”
From Definition and diagnostic criteria of clinical obesity (2025) · cites this paper as [197]
In the citing paper
“This anonymous and iterative group technique is designed to gather individual opinions from experts and transform these into a group consensus 6.”
From Diagnosis and treatment of chronic bacterial prostatitis and chronic prostatitis/chronic pelvic pain syndrome: a consensus guideline (2015) · cites this paper as [6]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Foundations of Behavioral Research
Stockton, R., & Kerlinger, F. N. (1974) · American Educational Research Journal · doi:10.2307/1162206 · Cited by 7,347
An Experimental Application of the DELPHI Method to the Use of Experts
Dalkey, N., & Helmer, O. (1963) · Management Science · doi:10.1287/mnsc.9.3.458 · Cited by 6,061
Research guidelines for the Delphi survey technique
Hasson, F. (2000) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2000.01567.x · Cited by 5,951 · cited 1×
“As such, Ludwig (1994) specifically addresses subject motivation as the key to the successful implementation of a Delphi study and investigators need to play an active role in this area to help ensure as high a response rate as possible.”
The Delphi Method: An Experimental Study of Group Opinion
(1969) · RAND Corporation eBooks · doi:10.7249/rm5888 · Cited by 1,628
Gazing into the oracle : the Delphi method and its application to social policy and public health
Ziglio, E., & Adler, M. E. (1996) · Jessica Kingsley Publishers eBooks · Cited by 1,429
Group Techniques for Program Planning
de Ven, A. V., & Delbecq, A. L. (1975) · Cited by 907
Technological forecasting for decision making
Martino, J. P. (1972) · Cited by 813
Experimental Study of Channel Patterns
SCHUMM, S. A., & KHAN, H. R. (1972) · Geological Society of America Bulletin · doi:10.1130/0016-7606(1972)83[1755:esocp]2.0.co;2 · Cited by 776
An experimental study of group opinion
Dalkey, N. (1969) · Futures · doi:10.1016/s0016-3287(69)80025-x · Cited by 750
Miller, G. (2001) · Tourism Management · doi:10.1016/s0261-5177(00)00067-4 · Cited by 604
Research works printed but not linked: 7
- Adams, S. J. (2001). Projecting the next decade in safety management: A Delphi technique study. Professional Safety, 46 (10), 26-29.
- Green, P. J. (1982, March). The content of a college-level outdoor leadership course. Paper presented at the Conference of the Northwest District Association for the American Alliance for Health, Physical Education, Recreation, and Dance, Spokane, WA.
- Jones, C. G. (1975). A Delphi evaluation of agreement between organizations. In H. A. Linstone, & M. Turoff (Eds.). The Delphi method: Techniques and applications (pp. 160-167). Reading, MA: Addison-Wesley Publishing Company.
- Kaplan, L. M. (1971). The use of the Delphi method in organizational communication: A case study. Unpublished master's thesis, The Ohio State University, Columbus.
- Linstone, H. A., & Turoff, M. (1975). Introduction. In H. A. Linstone, & M. Turoff (Eds.). The Delphi method: Techniques and applications (pp. 3-12). Reading, MA: Addison-Wesley Publishing Company.
- Ludlow, J. (1975). Delphi inquiries and knowledge utilization. In H. A. Linstone, & M. Turoff (Eds.). The Delphi method: Techniques and applications (pp. 102-123). Reading, MA: Addison-Wesley Publishing Company.
- Scheibe, M., Skutsch, M., & Schofer, J. (1975). Experiments in Delphi methodology. In H. A. Linstone, & M. Turoff (Eds.). The Delphi method: Techniques and applications (pp. 262-287). Reading, MA: Addison-Wesley Publishing Company.
Cited by
Items 1,001–1,013 of 1,013
Zhao, P., Ali, Z. M., Hashim, N. H. N., Ahmad, Y., & Wang, H. (2024) · Journal of Environmental Management · doi:10.1016/j.jenvman.2024.122520 · Cited by 33
Lorig, K. R., Ritter, P. L., Moreland, C., & Laurent, D. D. (2015) · Health Promotion Practice · doi:10.1177/1524839915571633 · Cited by 30
“The subject matter and content of the tip sheets were determined based on a modified Delphi process (Hsu & Standford, 2007) conducted on the Internet with smallgroup CDSMP master trainers.”
MethodCole, C. B., Pacca, J., Mehl, A., Tomasulo, A., van der Veken, L., Viola, A., & Ridde, V. (2018) · Reproductive Health · doi:10.1186/s12978-018-0574-8 · Cited by 21
“From these inputs, preliminary timeline-based cases of implementation in the two sites were constructed, following a modified version of the Delphi technique [27].”
MethodA global survey of national oral health policies and its coverage for young children
Gaffar, B., Schroth, R. J., Foláyan, M. O., Ramos-Gomez, F., & Virtanen, J. I. (2024) · Frontiers in Oral Health · doi:10.3389/froh.2024.1362647 · Cited by 20
“The Dephi method is a consensus-building method employed to ensure unbiased input and minimizing the impact of social desirability or power dynamics (28).”
MethodAlammary, A., Carbone, A., & Sheard, J. (2015) · 2015 48th Hawaii International Conference on System Sciences · doi:10.1109/hicss.2015.19 · Cited by 19
“The traditional Delphi method normally has four rounds of feedback and modified questionnaires [19, 21].”
BackgroundMethodInfluentialKerns, C. M., Moskowitz, L. J., Rosen, T., Drahota, A., Wainer, A., Josephson, A. R., Soorya, L., Cohn, E., Chacko, A., & Lerner, M. D. (2019) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2017.1410826 · Cited by 18
“The Delphi technique uses multiple iterations of questionnaires completed by a panel of selected experts in a particular field of interest to build consensus around a topic using both qualitative and quantitative methods (Hsu & Sandford, 2007).”
BackgroundMethodInfluentialFlynn (2009) · doi:10.3310/hta18600 · Cited by 17
Abortion services and providers in Canada in 2019: results of a national survey
Renner, R. M., Ennis, M., Contandriopoulos, D., Guilbert, E., Dunn, S., Kaczorowski, J., Darling, E. K., Albert, A., Styffe, C., & Norman, W. V. (2022) · CMAJ Open · doi:10.9778/cmajo.20210232 · Cited by 16
Campbell, B. (2019) · American Journal of Dance Therapy · doi:10.1007/s10465-019-09320-8 · Cited by 15
Feng, X., Qu, Y., Sun, K., Luo, T., & Meng, K. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-066599 · Cited by 15
Xu, J., Guo, Y., Wang, F., Xu, H., Lucero, R., Bian, J., & Prosperi, M. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-059715 · Cited by 6
Karim, J. N., Campbell, H., Pandya, P., Wilson, E. C. F., Alfirevic, Z., Chudleigh, T., Duff, E., Fisher, J., Goodman, H., Hinton, L., et al. (2025) · Health Technology Assessment · doi:10.3310/nltp7102 · Cited by 5
Development and evaluation of the Flourish Diabetes Programme
Kruger, S., Deacon, E., van Rensburg, E., & Segal, D. (2025) · Health SA Gesondheid · doi:10.4102/hsag.v30i0.2923 · Cited by 1
Metadata
- Authors
- Hsu, C.-C., & Sandford, B. A.
- Venue
- University of Massachusetts Amherst
- Publisher
- University of Massachusetts Amherst
- Published
- 2007
- Volume
- 12
- Issue
- 10
- Pages
- 10
- OpenAlex
- W2583504027
- Cited by
- 4,500
- References
- 40
- Citations by year
- 2026: 160 · 2025: 361 · 2024: 381 · 2023: 406 · 2022: 373 · 2021: 381 · 2020: 383 · 2019: 375 · 2018: 358 · 2017: 287 · 2016: 298 · 2015: 240 · 2014: 176 · 2013: 129 · 2012: 91
- FWCI
- 516.01
- Type
- journal article
- Language
- en
- Open access
- Licence
- cc-by-nc-nd
- Locations
- ScholarWorks@UMassAmherst (University of Massachusetts Amherst) (submittedVersion, cc-by-nc-nd)
- University of Massachusetts (UMass) Amherst
- Practical assessment, research & evaluation
- Topics
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Social Sciences › Decision Sciences › Management Science and Operations Research › Multi-Criteria Decision Making
- Social Sciences › Sociology and Political Science › Focus Groups and Qualitative Methods
- Keywords
- Delphi method, consensus building, expert opinion, participant selection, response rate, needs assessment, program planning, policy determination
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.