Current validity of the Delphi method in social sciences

Landeta, Jon

doi:10.1016/j.techfore.2005.09.002

Cited by 1,353Delphi Technique in ResearchMulti-Criteria Decision MakingForecasting Techniques and Applications

Current validity of the Delphi method in social sciences

Landeta, Jon·2006·Technological Forecasting and Social Change

DOI 10.1016/j.techfore.2005.09.002

Open this paper in CoChat — free account

Integrity signals

Registry

Crossref · 10.1016/j.techfore.2005.09.002

Cites

46 of 46 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The Delphi method is a technique used to establish consensus among a group of experts on complex issues and in some cases used to forecast future developments.
“First developed in the 1960s, the Delphi method is a technique used to establish consensus among a group of experts on complex issues (Landeta 2006) and in some cases used to forecast future developments (Linstone and Turoff 1975).”
From Friend or foe? Exploring the implications of large language models on the science system (2025) · cites this paper as Landeta 2006

An Experimental Application of the DELPHI Method to the Use of Experts
Dalkey, N., & Helmer, O. (1963) · Management Science · doi:10.1287/mnsc.9.3.458 · Cited by 6,061 · see citing works
the delphi method: techniques and applications
Linstone, H. A., & Turoff, M. (1975) · Bibliothèque et Archives nationales du Québec (Québec government) · Cited by 5,236 · see citing works
The Delphi method as a research tool: an example, design considerations and applications
Okoli, C., & Pawlowski, S. D. (2004) · Information & Management · doi:10.1016/j.im.2003.11.002 · Cited by 4,771 · see citing works
The Delphi technique as a forecasting tool: issues and analysis
Rowe, G., & Wright, G. (1999) · International Journal of Forecasting · doi:10.1016/s0169-2070(99)00018-7 · Cited by 2,515 · see citing works
Input-Output Economics
Leontief, W. W. (1951) · Scientific American · doi:10.1038/scientificamerican1051-15 · Cited by 1,501 · see citing works
The Delphi Method?
Crisp, J., Pelletier, D., Duffield, C. M., Adams, A. M. N., & Nagy, S. A. (1997) · Nursing Research · doi:10.1097/00006199-199703000-00010 · Cited by 1,388 · see citing works
The Delphi method: Techniques and applications
Martino, J. P. (1976) · Technological Forecasting and Social Change · doi:10.1016/0040-1625(76)90035-4 · Cited by 1,355 · see citing works
A critical review of the Delphi technique as a research methodology for nursing
Keeney, S., Hasson, F., & McKenna, H. (2001) · International Journal of Nursing Studies · doi:10.1016/s0020-7489(00)00044-4 · Cited by 1,333 · see citing works
The Delphi technique: a worthwhile research approach for nursing?
McKenna, H. (1994) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.1994.tb01207.x · Cited by 1,151 · see citing works
Technological forecasting for decision making
Martino, J. P. (1972) · Cited by 786 · see citing works
The Effectiveness of Nominal, Delphi, and Interacting Group Decision Making Processes.
de, A. H. V., & Delbecq, A. L. (1974) · Academy of Management Journal · doi:10.2307/255641 · Cited by 706 · see citing works
The design of a policy Delphi
Turoff, M. (1970) · Technological Forecasting and Social Change · doi:10.1016/0040-1625(70)90161-7 · Cited by 623 · see citing works
Theory and applications of the Delphi technique: A bibliography (1975–1994)
Gupta, U. G., & Clarke, R. E. (1996) · Technological Forecasting and Social Change · doi:10.1016/s0040-1625(96)00094-7 · Cited by 577 · see citing works
On the Epistemology of the Inexact Sciences
Helmer, O., & Rescher, N. (1959) · Management Science · doi:10.1287/mnsc.6.1.25 · Cited by 532 · see citing works
Building Consensus Using the Policy Delphi Method
Rayens, M. K., & Hahn, E. J. (2000) · Policy Politics & Nursing Practice · doi:10.1177/152715440000100409 · Cited by 446 · see citing works
Initial experiments with the cross impact matrix method of forecasting
Gordon, T. J., & Hayward, H. (1968) · Futures · doi:10.1016/s0016-3287(68)80003-5 · Cited by 408 · see citing works
A comparative study of differences in subjective likelihood estimates made by individuals, interacting groups, Delphi groups, and nominal groups
Gustafson, D. H., Shukla, R. K., Delbecq, A. L., & Walster, G. W. (1973) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(73)90052-4 · Cited by 376 · see citing works
Stability and agreement criteria for the termination of Delphi studies
Dajani, J. S., Sincoff, M. Z., & Talley, W. K. (1979) · Technological Forecasting and Social Change · doi:10.1016/0040-1625(79)90007-6 · Cited by 365 · see citing works
A review of selected recent advances in technological forecasting
Martino, J. P. (2003) · Technological Forecasting and Social Change · doi:10.1016/s0040-1625(02)00375-x · Cited by 357 · see citing works
Input-Output Economics
Kenessey, Z., & Leontief, W. W. (1967) · Revue de l Institut International de Statistique / Review of the International Statistical Institute · doi:10.2307/1401808 · Cited by 328 · see citing works
REPORT ON A LONG-RANGE FORECASTING STUDY,
Gordon, T. J., & Helmer, O. (1964) · RAND Corporation eBooks · Cited by 316 · see citing works
Delphi Assessment: Expert Opinion, Forecasting, and Group Process
Sackman, H. (1974) · Defense Technical Information Center (DTIC) · Cited by 290 · see citing works
Technological forecasting for decisionmaking
Linstone, H. A. (1973) · Technological Forecasting and Social Change · doi:10.1016/0040-1625(73)90010-3 · Cited by 275 · see citing works
Disaggregative policy Delphi
Tapio, P. (2002) · Technological Forecasting and Social Change · doi:10.1016/s0040-1625(01)00177-9 · Cited by 207 · see citing works
The over-optimism among experts in assessment and foresight
Tichy, G. J. (2004) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2004.01.003 · Cited by 196 · see citing works
The Delphi methodology (Part Two): A useful administrative approach.
Jairath, N. N., & Weinstein, J. N. (1995) · PubMed · Cited by 176 · see citing works
Judgment change during Delphi-like procedures: The role of majority influence, expertise, and confidence
Rowe, G., Wright, G., & McColl, A. (2004) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2004.03.004 · Cited by 152 · see citing works
El método Delphi: una técnica de previsión para la incertidumbre
Rodríguez, J. L. (1999) · Dialnet (Universidad de la Rioja) · Cited by 133 · see citing works
The Delphi technique
Riggs, W. E. (1983) · Technological Forecasting and Social Change · doi:10.1016/0040-1625(83)90073-2 · Cited by 113 · see citing works
An examination of factors contributing to delphi accuracy
Parente, F. J., Anderson, J. K., Myers, P., et al. (1984) · Journal of Forecasting · doi:10.1002/for.3980030205 · Cited by 107 · see citing works
The Prediction of Social and Technological Events
Kaplan, A., Skogstad, A. L., & Girshick, M. A. (1950) · Public Opinion Quarterly · doi:10.1086/266153 · Cited by 105 · see citing works
Directions in Delphi developments: Dissertations and their quality
Rieger, W. (1986) · Technological Forecasting and Social Change · doi:10.1016/0040-1625(86)90063-6 · Cited by 82 · see citing works
Delphi questionnaires versus individual and group interviews
van Dijk, J. A. G. M. (1990) · Technological Forecasting and Social Change · doi:10.1016/0040-1625(90)90029-u · Cited by 78 · see citing works
A Comparison of Techniques for Judgmental Forecasting by Groups with Common Information
Sniezek, J. A. (1990) · Group & Organization Studies · doi:10.1177/105960119001500102 · Cited by 67 · see citing works
The Use of the Delphi Procedures in Manpower Forecasting
Milkovich, G. T., Annoni, A. J., & Mahoney, T. A. (1972) · Management Science · doi:10.1287/mnsc.19.4.381 · Cited by 64 · see citing works
Modified Delphi Methodology for Technology Forecasting Case Study of Electronics and Information Technology in India
Chakravarti, A., Vasanta, B., Krishnan, A. S. A., & Dubash, R. K. (1998) · Technological Forecasting and Social Change · doi:10.1016/s0040-1625(97)00081-4 · Cited by 60 · see citing works
Personal attitudes in the assessment of the future of science and technology: A factor analysis approach
Blind, K., Cuhls, K. E., & Grupp, H. (2001) · Technological Forecasting and Social Change · doi:10.1016/s0040-1625(00)00083-4 · Cited by 59 · see citing works
Quality and Acceptance of an Evaluative Task: The Effects of Four Group Decision-Making Formats
Erffmeyer, R. C., & Lane, I. M. (1984) · Group & Organization Studies · doi:10.1177/105960118400900408 · Cited by 53 · see citing works
Using Delphi for a Long-Range Technology Forecasting, and Assessing Directions of Future R&D Activities The Korean Exercise
Shin, T. (1998) · Technological Forecasting and Social Change · doi:10.1016/s0040-1625(97)00053-x · Cited by 48 · see citing works
Outlook for Japanese and German Future Technology: Comparing Technology Forecast Surveys
Cuhls, K. E., & Kuwahara, T. (1994) · Cited by 34 · see citing works
Issues in large scale Delphi studies
Huckfeldt, V., & Judd, R. C. (1974) · Technological Forecasting and Social Change · doi:10.1016/0040-1625(74)90007-9 · Cited by 26 · see citing works
Reduced cognitive innovation and stimulus‐seeking in chronic schizophrenia
Kish, G. B. (1970) · Journal of Clinical Psychology · doi:10.1002/1097-4679(197004)26:2 · Cited by 26 · see citing works
Quantifying Weighted Expert Opinion
Dransfeld, H., Pemberton, J., & Jacobs, G. (2000) · Technological Forecasting and Social Change · doi:10.1016/s0040-1625(99)00059-1 · Cited by 24 · see citing works
The Delphi method, impeachment and terrorism: Accuracies of short-range forecasts for volatile world events
Parenté, R., Hiöb, T. N., Silver, R. A., et al. (2003) · Technological Forecasting and Social Change · doi:10.1016/s0040-1625(03)00024-6 · Cited by 24 · see citing works
AN APPROACH TO THE STUDY OF A DEVELOPING ECONOMY BY OPERATIONAL GAMING
Helmer, O., & Quade, E. S. (1963) · Defense Technical Information Center (DTIC) · Cited by 15 · see citing works
Alimentación de modelos cuantitativos con información subjetiva: aplicación Delphi en la elaboración de un modelo de imputación del gasto turístico individual en Catalunya
Rodríguez, J. L., de Antonio, J. M., Ruíz, V., et al. (2002) · Questiió: Quaderns d'Estadística, Sistemes, Informatica i Investigació Operativa · Cited by 10 · see citing works

Flagged first, then by citations

Sorted by citations

Consensus measurement in Delphi studies
von der Gracht, H. A. (2012) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2012.04.013 · Cited by 1,831 · see citing works
CATALISE: A Multinational and Multidisciplinary Delphi Consensus Study. Identifying Language Impairments in Children
Bishop, D. V. M., Snowling, M. J., Thompson, P. A., Greenhalgh, T., & CATALISE consortium (2016) · PLOS ONE · doi:10.1371/journal.pone.0158753 · Cited by 831 · see citing works
Improving the practical application of the Delphi method in group-based judgment: a six-step prescription for a well-founded and defensible process
Belton, I., MacDonald, A., Wright, G., & Hamlin, I. (2019) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2019.07.002 · Cited by 474 · see citing works
Reporting guidelines for Delphi techniques in health sciences: A methodological review
Spranger, J., Homberg, A., Sonnberger, M., & Niederberger, M. (2022) · Zeitschrift für Evidenz, Fortbildung und Qualität im Gesundheitswesen · doi:10.1016/j.zefq.2022.04.025 · Cited by 262 · see citing works
Improving design choices in Delphi studies in medicine: the case of an exemplary physician multi-round panel study with 100% response
Veugelers, R., Gaakeer, M. I., Patka, P., & Huijsman, R. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-01029-4 · Cited by 189 · see citing works
Identifying Entrustable Professional Activities in Internal Medicine Training
Hauer, K. E., Kohlwes, J., Cornett, P., Hollander, H., ten Cate, O., Ranji, S. R., Soni, K., Iobst, W., & O'Sullivan, P. (2013) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-12-00060.1 · Cited by 147 · see citing works
Requirements engineering for sustainability: an awareness framework for designing software systems for a better tomorrow
Duboc, L., Penzenstadler, B., Porras, J., Akinli Kocak, S., Betz, S., Chitchyan, R., Leifler, O., Seyff, N., & Venters, C. C. (2020) · Requirements Engineering · doi:10.1007/s00766-020-00336-y · Cited by 88 · see citing works
Mitigation measures for fish habitat improvement in Alpine rivers affected by hydropower operations
Person, E., Bieri, M., Peter, A., & Schleiss, A. J. (2014) · Ecohydrology · doi:10.1002/eco.1380 · Cited by 86 · see citing works
Friend or foe? Exploring the implications of large language models on the science system
Fecher, B., Hebing, M., Laufer, M., Pohle, J., & Sofsky, F. (2025) · AI & SOCIETY · doi:10.1007/s00146-023-01791-1 · Cited by 78 · see citing works
“First developed in the 1960s, the Delphi method is a technique used to establish consensus among a group of experts on complex issues (Landeta 2006) and in some cases used to forecast future developments (Linstone and Turoff 1975).”
Do we Really Know What we are Building? Raising Awareness of Potential Sustainability Effects of Software Systems in Requirements Engineering
Duboc, L., Betz, S., Penzenstadler, B., Akinli Kocak, S., Chitchyan, R., Leifler, O., Porras, J., Seyff, N., & Venters, C. C. (2019) · 2019 IEEE 27th International Requirements Engineering Conference (RE) · doi:10.1109/re.2019.00013 · Cited by 69 · see citing works
Determining nature’s contributions to achieve the sustainable development goals
Anderson, C. B., Seixas, C. S., Barbosa, O., Fennessy, M. S., Díaz-José, J., & Herrera-F., B. (2019) · Sustainability Science · doi:10.1007/s11625-018-0643-5 · Cited by 57 · see citing works
“Using an iterative evaluation technique, known as a Delphi process (Landeta 2006; Mukherjee et al.”
Method
Clinical pathway for suicide risk screening in adult primary care settings: Special recommendations
Ayer, L., Horowitz, L. M., Colpe, L., Lowry, N. J., Ryan, P. C., Boudreaux, E., Little, V., Erban, S., Ramirez-Estrada, S., & Schoenbaum, M. (2022) · Journal of the Academy of Consultation-Liaison Psychiatry · doi:10.1016/j.jaclp.2022.05.003 · Cited by 37 · see citing works
A proposed adaptation of the European Foundation for Quality Management Excellence Model to physical activity programmes for the elderly - development of a quality self-assessment tool using a modified Delphi process
Marques, A. I., Santos, L., Soares, P., Santos, R., Oliveira-Tavares, A., Mota, J., & Carvalho, J. (2011) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/1479-5868-8-104 · Cited by 24 · see citing works
Lessons learned from developing a sustainability awareness framework for software engineering using design science
Betz, S., Penzenstadler, B., Duboc, L., Chitchyan, R., Kocak, S. A., Brooks, I., Oyedeji, S., Porras, J., Seyff, N., & Venters, C. C. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3649597 · Cited by 23 · see citing works
Carbon-Labeling Implementation in Taiwan by Combining Strength–Weakness–Opportunity–Threat and Analytic Network Processes
Hu, A. H., Chen, C.-H., Lan, Y.-C., Hong, M.-Y., & Kuo, C.-H. (2019) · Environmental Engineering Science · doi:10.1089/ees.2018.0328 · Cited by 11 · see citing works

An analysis of prior delphi applications and some observations on its future applicability
Brockhaus, W. L., & Mickelsen, J. F. (1977) · Technological Forecasting and Social Change · doi:10.1016/0040-1625(77)90010-5 · Cited by 35 · see citing works
Applications of the Delphi method in China
Chen, Y., Dong-hua, Z., & Chang-geng, L. (1990) · Technological Forecasting and Social Change · doi:10.1016/0040-1625(90)90075-7 · Cited by 12 · see citing works
A Delphi Study of Regional Industrial Land-Use
Ervin, O. L. (1977) · Review of Regional Studies · doi:10.52324/001c.10230 · Cited by 5 · see citing works
Enhancing a Delphi study on family-focused prevention
Engels, T., & Kennedy, H. P. (2006) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2005.11.008 · Cited by 48 · see citing works
FACULTY CONSENSUS AT A MULTI‐CAMPUS COLLEGE THROUGH DELPHI
Dailey, A. L. (1988) · Community Junior College Research Quarterly of Research and Practice · doi:10.1080/0361697880120102 · Cited by 9 · see citing works

Authors: Landeta, J.
Venue: Technological Forecasting and Social Change
Publisher: Elsevier BV
Published: 2006-06
Volume: 73
Issue: 5
Pages: 467-482
ISSN: 0040-1625 (ISSN-L)
DOI: 10.1016/j.techfore.2005.09.002
OpenAlex: W2003282762
Cited by: 1,353
References: 46
Citations by year: 2026: 66 · 2025: 78 · 2024: 123 · 2023: 98 · 2022: 101 · 2021: 109 · 2020: 97 · 2019: 81 · 2018: 71 · 2017: 58 · 2016: 76 · 2015: 71 · 2014: 67 · 2013: 56 · 2012: 63
FWCI: 36.45
Type: journal article
Language: en
Open access: closed
Licence: www.elsevier.com/tdm/userlicense/1.0/ (tdm)
www.elsevier.com/legal/tdmrep-license (tdm)
Locations: Technological Forecasting and Social Change (publishedVersion)
Funders: Euskal Herriko Unibertsitatea
Topics: Social Sciences › Sociology and Political Science › Delphi Technique in Research
Social Sciences › Decision Sciences › Management Science and Operations Research › Multi-Criteria Decision Making
Social Sciences › Decision Sciences › Management Science and Operations Research › Forecasting Techniques and Applications
Keywords: Delphi method, expert opinion, expert groups, forecasting, decision-making, policy Delphi, social science applications, methodological quality

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Current validity of the Delphi method in social sciences

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks