Cited by 579Delphi Technique in ResearchMulti-Criteria Decision MakingReliability and Agreement in Measurement

The DOI matches its Crossref record; 42 of the 45 references it cites were found in a registry or an index.

The Delphi method: Substance, context, a critique and an annotated bibliography

Open access

Pill, Juri·1971·Socio-Economic Planning Sciences

DOI 10.1016/0038-0121(71)90041-3

Open this paper in CoChat — free account

Integrity signals

Registry

Crossref · 10.1016/0038-0121(71)90041-3

Cites

42 of 42 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Untitled work
(1932) · Medical Entomology and Zoology · Cited by 9,568
An Experimental Application of the DELPHI Method to the Use of Experts
Dalkey, N., & Helmer, O. (1963) · Management Science · doi:10.1287/mnsc.9.3.458 · Cited by 6,061
Science and the Modern World
Fleming, N. B. (2000) · BRILL eBooks · doi:10.1163/9789004495692_008 · Cited by 2,166
The Delphi Method: An Experimental Study of Group Opinion
Dalkey, N. C. (1969) · RAND Corporation eBooks · doi:10.7249/rm5888 · Cited by 1,673
Techniques of attitude scale construction.
Edwards, A. L. (1957) · Appleton-Century-Crofts eBooks · doi:10.1037/14423-000 · Cited by 1,670
A Basis for Scaling Qualitative Data
Guttman, L. (1944) · American Sociological Review · doi:10.2307/2086306 · Cited by 1,333
Consumption Theory in Terms of Revealed Preference
Samuelson, P. A. (1948) · Economica · doi:10.2307/2549561 · Cited by 1,014
Science and the Modern World
Ravenel, M. P. (1926) · American Journal of Public Health · doi:10.2105/ajph.16.4.414-c · Cited by 925
Alternative Approaches to the Theory of Choice in Risk-Taking Situations
Arrow, K. J. (1951) · Econometrica · doi:10.2307/1907465 · Cited by 729
The measurement of attitude
Thurstone, L. L., & Chave, E. J. (1929) · University of Michigan Library Repository · Cited by 626

Show all 45 references

Research works printed but not linked: 12

Adelson, 1967, The education innovation study, Am. Behavioral Scientist, 10, 21
Adelson, 1967, The education innovation study, Am. Behavioral Scientist, 10, 8, 10.1177/000276426701000704 · DOI
Adelson, 1967, The education innovation study, Am. Behavioral Scientist, 10, 21
Campbell, 1968, The Delphi technique: Implementation in the corporate environment, Mgmt Ser., 5, 37
Dalkey, 1963, An experimental application of the Delphi method to the use of experts, Mgmt Sci., 9, 458, 10.1287/mnsc.9.3.458 · DOI · Paper page
1970, Busin. Week
Helmer, 1967, Vital Speeches, 33, 497
Helmer, 1959, On the Epistemology of the Inexact Sciences, 10.1287/mnsc.6.1.25 · DOI
Helmer, 1959, Mgmt Sci., 6, 25, 10.1287/mnsc.6.1.25 · DOI
Kaplan, 1950, The prediction of social and technological events, Publ. Opinion Q., 14, 13, 10.1086/266153 · DOI
Maier, 1967, Assets and liabilities in group problem solving: The need for an integrative function, Psychol. Rev., 74, 239, 10.1037/h0024737 · DOI
Neiswender, 1966, Realites, 50

Sorted by citations

Items 501–574 of 574

Appendix: Delphi Bibliography
Linstone, H. A., & Turoff, M. (2002)
Selection criteria for energy performance improvement measures in traditionally constructed non-domestic buildings
Gower, P. F., & Elspeth, M. (2014)
Motives behind the implementation of Occupational Health and Safety practices in logistics operations
Bartzokas, V. (2015) · Lund University Publications Student Papers (Lund University)
A Delphi Survey of Experts’ Opinions Regarding Prevention of Impairment in Professional Psychology Training
Chan, K.-M. (2006) · ScholarWorks - WMU (Western Michigan University)
A survey of interdisciplinary curriculum development as related to comprehensive health planning: a Delphi study.
Henry, C. E. (1974) · ThinkTech (Texas Tech University)
The PIERS (Pre-eclampsia Integrated Estimate of RiSk) model : development of a valid outcome prediction model for pre-eclampsia.
Menzies, J. M. (2009) · cIRcle (University of British Columbia) · doi:10.14288/1.0067096
Development of the Disaster Victim Identification Forensic Odontology Guide for the Australian Society of Forensic Odontology
Taylor, J. A. (2009) · NOVA (University of Newcastle Australia)
Defining scenarios to food waste reduction: seeking for consensus among food supply stakeholdersPreprint
Díaz-Ruiz, R., Costa‐Font, M., López‐i‐Gelats, F., & Gil, J. (2015) · RePEc: Research Papers in Economics · doi:10.22004/ag.econ.229266
Collaboration in Forecasting
Miller, S. M., Forlines, C., & Irvine, J. M. (2013) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931213571071
Reliability of Delphi survey for traditional knowledge on agricultural resources
Lee, K., Song, M.-J., & Kim, H. (2015) · Journal of the Korean Data and Information Science Society · doi:10.7465/jkdi.2015.26.4.947
1. General introduction - Methods in Development Research
(2005) · Practical Action Publishing eBooks · doi:10.3362/9781780440286.001
Acceptance and commitment therapy with chronic pain patients : using a Delphi study to gather an expert consensus on client language in relation to psychological flexibility
Dunning, G. L. (2016) · White Rose eTheses Online (University of Leeds, The University of Sheffield, University of York)
Back matter - Methods in Development Research
(2005) · Practical Action Publishing eBooks · doi:10.3362/9781780440286.018
Probability Forecasting Methods
Jones, H., & Twiss, B. C. (1978) · Palgrave Macmillan UK eBooks · doi:10.1007/978-1-349-03134-4_10
Oportunidades dentro de los procesos de mundialización textil internacional y relación con la RSE a través de un analisis DELPHI: ética o estética
González, A. L., Zubizarreta, J. H., & De‐Pablos‐Heredero, C. (2016) · Dirección y Organización · doi:10.37610/dyo.v0i59.492
ANALYZING FORESIGHT STUDIES IN CONVERGING TECHNOLOGIES STUDIES OF EU, USA AND TURKEY
Çaliir, B. (2006)
A Bayesian Approach to Predicting Football Match Outcomes Considering Time Effect Weight
Louzada, F., Suzuki, A. K., Salasar, L. E. B., Ara, A., & Leite, J. G. (2015) · Springer proceedings in mathematics & statistics · doi:10.1007/978-3-319-12454-4_12
Preparing Educators to Employ Design-Based Engineering Practices in K-12 Science
Carlson, J. (2017) · VTechWorks (Virginia Tech)
Online collaborative video annotation framework using GoodRelations ontology for E-commerce
Le, T. H. M., & Duong, H. T. (2017) · International Journal of Advanced Computer Research · doi:10.19101/ijacr.2017.731001
REVISED PRELIMINARY REVIEW COPY
Zornberg, J. G., Plaisted, M. D., & Armstrong, C. P. (2013)
POTENSI MODIFIKASI MODEL PIERS UNTUK PREDIKSI LUARAN IBU DENGAN PREEKLAMSIA PADA RUMAH SAKIT TIPE B DI INDONESIA: PENELITIAN RETROSPEKTIF DI RSUD ANSARI SALEH BANJARMASIN, KALIMANTAN SELATAN
Sufriyana, H., Handayani, L., Yuliana, F., & Syafi'i, T. (2018) · Medical and Health Science Journal · doi:10.33086/mhsj.v1i1.614
Service concepts from future - weak signals from different branches
Danivska, V., Rytkönen, E., Nenonen, S. P., & Jylhä, T. (2015)
Effective Dual Immersion School Transitions: An Expert Panel Synthesis
Sellards, R., Block, N. C., & Schneider, S. (2018) · Dual Language Research and Practice Journal · doi:10.21423/dlrpj-v1.a5
Development and evaluation of a pictorial metaphor technique in cognitive analytic therapy
Turner, J. (2016) · Sheffield Hallam University · doi:10.7190/shu-thesis-00016
Knowledge Engineering, Cognitive Ergonomics, and Knowledge Management in 2017
Lofaro, R. J. (2018) · Advances in knowledge acquisition, transfer, and management book series/Advances in knowledge acquisition, transfer and management book series · doi:10.4018/978-1-5225-5427-1.ch005
Understanding food waste behaviours along the food supply chain-a mutilevel approach
Ruiz, R. D. (2018) · UPCommons institutional repository (Universitat Politècnica de Catalunya) · doi:10.5821/dissertation-2117-131411
Separate the wheat from the chaff: Mapping the current and future landscape of web search engines
Bouwman, S. (2019) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) · doi:10.34626/sa90-sg46
Probability Forecasts and Prediction Markets
Mortera, J., & Dawid, A. P. (2022) · Springer series in the data sciences · doi:10.1007/978-3-030-75460-0_6
Phenotypic and clinical outcome studies in amyloidosis and associated autoinflammatory diseases
Youngstein, T. (2019) · UCL Discovery (University College London)
ASSESSING THE SKILLSETS OF ALTERNATIVELY CERTIFIED AGRICULTURAL SCIENCE TEACHERS: A DELPHI STUDY
Wolf, S. (2020)
Aporte Metodológico para un diagnóstico del sector justicia: La percepción local experta de su democratización
Lloret, J. S., & Rubinovich, M. (2020) · Novum Jus · doi:10.14718/novumjus.2020.14.1.3
A consensus-based approach for structural resilience to earthquakes using machine learning techniques
Cerè, G. (2019) · ORCA Online Research @Cardiff (Cardiff University)
Successful community-based models of care for the elimination of hepatitis c virus as a public health threat
Pourmarzi, D. (2020) · Queensland University of Technology · doi:10.5204/thesis.eprints.174395
A comparison of comorbidity scores to predict 1 year mortality in critically ill adult patients
Quach, S. (2008) · Libraries and Cultural Resources (University of Calgary) · doi:10.11575/prism/22278
Overcome the barriers to private sector housing development in a developing country: A case study in Dhaka, Bangladesh
Jahan, R. (2020) · Queensland University of Technology · doi:10.5204/thesis.eprints.203020
Useful Organizational Knowledge via Knowledge Elicitation and Management
Lofaro, R. J. (2020) · Advances in logistics, operations, and management science book series · doi:10.4018/978-1-7998-3473-1.ch120
DEVELOPMENT OF METHODS FOR ASSESSMENT AND SELECTION OF UNMANNED AERIAL VEHICLE FOR MINE RECONNAISSANCE
НЕРОБА, В. (2020) · ScienceRise · doi:10.21303/2313-8416.2020.001496
Élaboration d’un outil d’information sur l’accouchement : consensus par la méthode Delphi
Prévost, S., Jean-Pierre, M. E. T. Z., & Mottet, N. (2021) · Gynécologie Obstétrique Fertilité & Sénologie · doi:10.1016/j.gofs.2021.09.004
Predicting traffic flow during peak commuting hoursPreprint
Shen, Z. (2021) · Research Square · doi:10.21203/rs.3.rs-877585/v1
Using workshops to value urban green and blue surfaces
Persson, J., Emanuelsson, K., & Municipality, J. (. J. (2018) · Journal of Urban and Landscape Planning · doi:10.54508/julp.03.02
Towards Optimum Reporting of Pulmonary Effectiveness Databases and Outcomes (TORPEDO): identifying a core dataset for asthma and COPD studiesPreprint
van Boven, J. F. M., Lucas, S. J., Parker, G., Kaplan, A. G., Trofor, A. C., Bonevski, B., Kirenga, B., Ryan, D. P., Pizzichini, E., Ganse, E. H. V., et al. (2021) · medRxiv · doi:10.1101/2021.10.14.21264843
Current Theories of Planning
Saaty, T. L., & Kearns, K. P. (1985) · Elsevier eBooks · doi:10.1016/b978-0-08-032599-6.50011-8
Energetics; Systems Analysis With Application to Water Resources Planning and Decision-Making.
Meyers, C. D. (1977) · Defense Technical Information Center (DTIC)
Future of Interactive technologies
Mohammed, N. M. (2026) · Edinburgh Napier Research Repository (Edinburgh Napier University) · doi:10.17869/enu.204044
STROCSS 2021 guidelines
Mathew, G., & Agha, R. (2021) · International Journal of Surgery Case Reports · doi:10.1016/j.ijscr.2021.106684
Effective selection of countries in sub-Saharan Africa for new market entry by independent wind power producers
Lausberg, C., Evans, K., & Jongh, E. D. (2021) · Journal of Energy in Southern Africa · doi:10.17159/2413-3051/2021/v32i4a10673
APPLICATION OF FUZZY DELPHI TECHNIQUE IN THE DEVELOPMENT OF NUCLEAR ENERGY STEM LEARNING MODULE FOR FORM FOUR SCIENCE SUBJECTS
Sabri, S. M., Ali, S. R., & Idris, I. B. (2021) · International Journal of Education Psychology and Counseling · doi:10.35631/ijepc.644021
Design of the Strategic Planning Model, Based on the Prospective Analysis for the Universidad de las Fuerzas Armadas ESPE
Robles, L. A. A., & Lorenzo, A. F. (2022) · Lecture notes in networks and systems · doi:10.1007/978-3-030-96046-9_24
References
Keeney, S., Hasson, F., & McKenna, H. (2010) · Wiley eBooks · doi:10.1002/9781444392029.refs
References
(2012) · Elsevier eBooks · doi:10.1016/b978-0-12-397189-0.00123-3
МЕТОДИЧЕСКИЙ ПОДХОД К ОЦЕНКЕ ЭКОНОМИЧЕСКОГО ЭФФЕКТА ОБРАЗЦОВ ОБОРУДОВАНИЯ И ТЕХНИКИ ПОГРАНИЧНОЙ СЛУЖБЫ
Мосов, С., Поливанов, П., Салий, С., & Мухатай, А. (2022) · Вестник КазАТК · doi:10.52167/1609-1817-2022-120-1-198-207
Selected Bibliography
(1976) · Elsevier eBooks · doi:10.1016/b978-0-08-019601-5.50023-9
Towards successful Web-based smoking relapse prevention : the efficacy of a computer tailored program incorporating post-motivational components & an attentional bias modification program
Elfeddali, I. (2013) · Research Publications (Maastricht University) · doi:10.26481/dis.20130627ie
Gestão do Conhecimento e Inovação Volume 9
Rocha, B. P., Machado, G. J. C., Santos, K. D. O., do Nascimento, R. L. L., de Jesus, R. M., Paixão, A. E. A., Baierle, I. C., Schaefer, J. L., Kothe, J. V., Fava, L. P., et al. (2019) · doi:10.5935/978-85-7042-132-6
References, Part 8
(2005) · Elsevier eBooks · doi:10.1016/b978-075067555-0.50270-x
Can a regulatory instrument promote research and development into neglected diseases? A Policy Delphi Survey
Fehr, A. (2012) · PUB – Publications at Bielefeld University (Bielefeld University)
Evaluation of Risk Factors in the Armed Forces Physical Fitness Test
Chiu, Y., Li, C.-C., Song, S.-R., & Hu, Y. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-36049-7_1
Análisis del tratamiento educativo del concepto, programación y evaluación de las competencias en la educación obligatoria
Bernardino, C. H. (2023) · UVaDOC UVaDOC University of Valladolid Documentary Repository (University of Valladolid) · doi:10.35376/10324/61937
Components of model international educational services programs: a Delphic probe
Fystrom, L. M. (1980) · doi:10.31274/rtd-180813-11636
Important and Difficult Topics in CS2: An Expert Consensus via Delphi Study
Wittie, L., Kurdia, A., Huggard, M., & Nguyen, K.-N. (2024) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--43574
Algorithms as Political Subjects in Disruptive Technology Scenarios
González, A. L., Choez, M. A. S., & Popescu, C. R. G. (2023) · Advances in logistics, operations, and management science book series · doi:10.4018/979-8-3693-2077-8.ch001
Management of dental disease in eared seals (family Otariidae): a Delphi approach
Simeone, C. A., Schwitzer, N., Johnson, S., Ruiz, J. C. A., Debosschere, Y., Force, J., Forsayeth, A. M., Gawor, J. P., Gracis, M., Holmstrom, S., et al. (2025) · Frontiers in Veterinary Science · doi:10.3389/fvets.2025.1619326
Aviation lifesavers: developing an innovative cabin rescue and first aid educational module for future cabin crew
Xu, W., Nasri, N. M., Mei, Y., Li, X., Jin, K., Hwang, H.-D., & Liu, X. (2025) · Interactive Learning Environments · doi:10.1080/10494820.2025.2545950
Development and Calibration of a Spatial Model for the Analysis of Paleolithic Archaeological Potential in the Duero Basin of the Iberian Peninsula
Merino-Pelaz, A., Herrero, M. D. A., Herrero, A. D., Alonso, D. Á., & Tanarro, L. M. (2025) · Journal of Archaeological Method and Theory · doi:10.1007/s10816-025-09745-1
Enhancing innovation in medical students through imaginative driven models
Lufeng, L., Das, G., Gopang, A. A., Khuhro, A. S., & Memon, S. (2025) · Scientific Reports · doi:10.1038/s41598-025-30293-x
The Student Services Needs of Adult Evening Students
Bednar, L. E. (1982) · ScholarWorks - WMU (Western Michigan University)
Оценка психологической готовности специалистов оперативно-спасательной службы гражданской защиты с помощю метода анализа иерархий
Владимирович, Ш. Е. (2013) · Вестник Адыгейского государственного университета. Серия 3: Педагогика и психология
Informational Needs of Organizations Under Crisis
Legasto, A. A., & Muriel, A. (1984) · Springer eBooks · doi:10.1007/978-1-4613-2677-9_4
Additional file 2 of The first research agenda for the chiropractic profession in Europe
Rubinstein, S. M., Bolton, J., Webb, A. L., & Hartvigsen, J. (2020) · Figshare · doi:10.6084/m9.figshare.12941124
Additional file 1 of The first research agenda for the chiropractic profession in Europe
Rubinstein, S. M., Bolton, J., Webb, A. L., & Hartvigsen, J. (2020) · Figshare · doi:10.6084/m9.figshare.12941121
Développement, validation et diffusion d’indicateurs de pertinence des soins automatisés à partir du système d’information hospitalier : cadre méthodologique, enjeux et application aux prescriptions d’anticoagulants oraux en médecine adulte
Petit-Monéger, A. (2018) · theses.fr (ABES) · doi:10.70675/c7716632zc584z43c6z8e4cz9a82b660431a
Developing a Core Outcome Set for the Evaluation of Remote Patient Monitoring Interventions Using the Sextuple Aim: Modified Delphi Study
Heilig, A. L., Bonten, T., Recourt, K., & van Marle, M. E. V. D. A. –. (2026) · Journal of Medical Internet Research · doi:10.2196/92863
Software requirements for semantic-based antifragile urban mobility decision-support systems under disruption
Nardi, C. D., Ghaemi, A., Hodorog, A., Cerè, G., Ghoroghi, A., & Rezgui, Y. (2026) · Progress in Disaster Science · doi:10.1016/j.pdisas.2026.100657
Developing a Dispute Pathogens Framework in BIM Implementation Among Malaysian Public Sector Project Supply Chains
Ahmad, N. H., Riazi, S. R. M., & Shafiei, M. W. M. (2026) · ALAM CIPTA International Journal Of Sustainable Tropical Design & Practice · doi:10.47836/ac.19.3.paper02

Authors: Pill, J.
Affiliations: Case Western Reserve University (US)
Corresponding author: Pill, Juri
Venue: Socio-Economic Planning Sciences
Publisher: Elsevier BV
Published: 1971-02
Volume: 5
Issue: 1
Pages: 57-71
ISSN: 0038-0121 (ISSN-L)
DOI: 10.1016/0038-0121(71)90041-3
OpenAlex: W1968468300
Cited by: 579
References: 45
Citations by year: 2026: 6 · 2025: 11 · 2024: 14 · 2023: 25 · 2022: 25 · 2021: 27 · 2020: 31 · 2019: 30 · 2018: 27 · 2017: 27 · 2016: 22 · 2015: 31 · 2014: 29 · 2013: 27 · 2012: 10
FWCI: 26.64
Type: journal article
Language: en
Open access: green
commons.case.edu
Licence: public-domain
www.elsevier.com/tdm/userlicense/1.0/ (tdm)
Locations: Socio-Economic Planning Sciences (publishedVersion)
Scholarly Commons @ Case Western Reserve University (submittedVersion, public-domain)
RePEc: Research Papers in Economics (submittedVersion)
Topics: Social Sciences › Sociology and Political Science › Delphi Technique in Research
Social Sciences › Decision Sciences › Management Science and Operations Research › Multi-Criteria Decision Making
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
Keywords: Delphi method, consensus building, expert panel, subjective scaling, uncertainty, historical development, evaluation methodology, annotated bibliography

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

The Delphi method: Substance, context, a critique and an annotated bibliography

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks