The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
The Delphi technique: a method for testing complex and multifaceted topics
Abstract
Purpose: The purpose of this paper is to provide project management (PM) students with an example of the Delphi research approach that was applied to a recent doctoral research thesis. The objective is to provide both a description of the approach and an explanation of how it was successfully applied so that researchers in PM may become more aware and expand their perceptions of methodological options available to them. Design/methodology/approach: The paper sets out a literature review of the Delphi approach and explains this research method as it was experienced as a research tool. The paper also provides reflection on the experience of being a researcher undertaking a doctoral study. Findings: The Delphi approach is one of many that may be selected for researching PM issues and problems. It is appropriate for researching complex issues where larger scale quantitative “hard data” fails to unearth richness in tacit knowledge to help the research understand subtle expert opinion. It does not offer the rigor of clinical testing or quantitative analysis, but it provides a scientific methodology that is well suited to issues that require the insights of subject matter experts. The use of Delphi in this context was successful in that the thesis was passed and so its use in this context may be now considered as proved through rigorous examination. Originality/value: The paper provides a solid literature review that may be used or referred to by researchers wishing to adopt this research approach. It also describes the protocols and processes adopted in the doctoral study. Thus, this paper provides the opportunity for PM researchers to expand their repertoire of research tools. Practitioners may also benefit from this paper as it provides a useful approach to assess and validate expert knowledge that could be contestable in a range of practice situations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Lincoln, Y. S., Guba, E. G., & Pilotta, J. J. (1985) · International Journal of Intercultural Relations · doi:10.1016/0147-1767(85)90062-8 · Cited by 45,787
Maslow, A. H. (1943) · Psychological Review · doi:10.1037/h0054346 · Cited by 21,563
(2017) · Defining and Classifying Children in Need · doi:10.4324/9781315258324-16 · Cited by 11,320
the delphi method: techniques and applications
Linstone, H. A., & Turoff, M. (1975) · Bibliothèque et Archives nationales du Québec (Québec government) · Cited by 6,591
Research guidelines for the Delphi survey technique
Hasson, F. (2000) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2000.01567.x · Cited by 5,951
Pundt, A. (2006) · Zeitschrift für Arbeits- und Organisationspsychologie A&O · doi:10.1026/0932-4089.50.3.167 · Cited by 3,745
(1990) · Free Press , Collier Macmillan eBooks · Cited by 2,859
Language in Relation to a Unified Theory of the Structure of Human Behavior
Pike, K. L. (1967) · De Gruyter eBooks · doi:10.1515/9783111657158 · Cited by 2,183
Grasping the intentions of others with one's own mirror neuron system
Iacoboni, M., Molnar-Szakacs, I., Gallese, V., Buccino, G., Mazziotta, J. C., & Rizzolatti, G. (2005) · PLoS Biology · doi:10.1371/journal.pbio.0030079 · Cited by 2,044
Culture, leadership, and organizations the GLOBE study of 62 societies
House, R. J., Hanges, P. J., Javidan, M., Dorfman, P. W., & Gupta, V. (2005) · Cited by 1,428
CRISP, J., PELLETIER, D., DUFFIELD, C., ADAMS, A., & NAGY, S. (1997) · Nursing Research · doi:10.1097/00006199-199703000-00010 · Cited by 1,388
Current validity of the Delphi method in social sciences
Landeta, J. (2006) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2005.09.002 · Cited by 1,353
A critical review of the Delphi technique as a research methodology for nursing
Keeney, S., Hasson, F., & McKenna, H. P. (2001) · International Journal of Nursing Studies · doi:10.1016/s0020-7489(00)00044-4 · Cited by 1,324
The Five-Stage model of adult skill acquisition
Dreyfus, S. E. (2004) · Bulletin of Science, Technology & Society · doi:10.1177/0270467604264992 · Cited by 1,261 · cited 2×
“…question that was posed by House and Javidan in the introduction to the Global Leadership and Organizational Behavior Effectiveness (GLOBE) survey (2004: p9) was “What principles and laws of leadership and organizational processes transcend cultures, and can such principles be discovered and…”
BackgroundThe Delphi technique: a worthwhile research approach for nursing?
McKenna, H. P. (1994) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.1994.tb01207.x · Cited by 1,144
Multiple scenario development: Its conceptual and behavioral foundation
Schoemaker, P. J. H. (1993) · Strategic Management Journal · doi:10.1002/smj.4250140304 · Cited by 911
Group Techniques for Program Planning
de Ven, A. V., & Delbecq, A. L. (1975) · Cited by 907
Winter, M., Smith, C., Morris, P., & Cicmil, S. (2006) · International Journal of Project Management · doi:10.1016/j.ijproman.2006.08.009 · Cited by 858
Expert Opinions in Forecasting: The Role of the Delphi Technique
Rowe, G., & Wright, G. (2001) · International Series in Operations Research & Management Science · doi:10.1007/978-0-306-47630-3_7 · Cited by 777
Key Issues in Information Systems Management: 1994-95 SIM Delphi Results1
Brancheau, J. C., Janz, B. D., & Wetherbe, J. C. (1996) · MIS Quarterly · doi:10.2307/249479 · Cited by 702
A framework for identifying software project risks
Keil, M., Cule, P. E., Lyytinen, K., & Schmidt, R. C. (1998) · Communications of the ACM · doi:10.1145/287831.287843 · Cited by 698
Peripheral Vision: Expertise in Real World Contexts
Dreyfus, H. L., & Dreyfus, S. E. (2005) · Organization Studies · doi:10.1177/0170840605053102 · Cited by 644
Turoff, M. (1970) · Technological Forecasting and Social Change · doi:10.1016/0040-1625(70)90161-7 · Cited by 597
Thangaratinam, S., & Redman, C. W. (2005) · The Obstetrician & Gynaecologist · doi:10.1576/toag.7.2.120.27071 · Cited by 592
Applying the Delphi technique in a study of GPs’ information requirements
Green, B., Jones, M., Hughes, D., & Williams, A. (1999) · Health & Social Care in the Community · doi:10.1046/j.1365-2524.1999.00176.x · Cited by 384
The Delphi technique: a comparison of results obtained using two expert panels
Duffield, C. (1993) · International Journal of Nursing Studies · doi:10.1016/0020-7489(93)90033-q · Cited by 338
Delphi Assessment: Expert Opinion, Forecasting, and Group Process
Sackman, H. (1974) · Defense Technical Information Center (DTIC) · Cited by 290
Enhancing Delphi research: methods and results
Kennedy, H. P. (2004) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2003.02933.x · Cited by 275
Brill, J. M., Bishop, M. J., & Walker, A. E. (2006) · Educational Technology Research and Development · doi:10.1007/s11423-006-8251-y · Cited by 245
The delphi technique: an exposition and application
Mitchell, V. W. (1991) · Technology Analysis & Strategic Management · doi:10.1080/09537329108524065 · Cited by 221
International Business and Trade in the Next Decade: Report from a Delphi Study
Czinkota, M. R., & Ronkainen, I. A. (1997) · Journal of International Business Studies · doi:10.1057/palgrave.jibs.8490121 · Cited by 174
Riggs, W. E. (1983) · Technological Forecasting and Social Change · doi:10.1016/0040-1625(83)90073-2 · Cited by 171
Understanding Project Management Practice through Interpretative and Critical Research Perspectives
Cicmil, S. (2006) · Project Management Journal · doi:10.1177/875697280603700204 · Cited by 170
Brill, J. M., & Branch, R. M. (2007) · Journal of Visual Literacy · doi:10.1080/23796529.2007.11674645 · Cited by 164
E-commerce project development risks: evidence from a Delphi survey
Addison, T. (2002) · International Journal of Information Management · doi:10.1016/s0268-4012(02)00066-x · Cited by 125
A forecast of globalization, international business and trade: report from a Delphi study
Czinkota, M. R., & Ronkainen, I. A. (2005) · Journal of World Business · doi:10.1016/j.jwb.2005.02.006 · Cited by 105
Saizarbitoria, I. H. (2006) · Total Quality Management & Business Excellence · doi:10.1080/09593960600597768 · Cited by 101
Kuusi, O. (1999) · Aaltodoc (Aalto University) · Cited by 91
Directions in Delphi developments: Dissertations and their quality
Rieger, W. (1986) · Technological Forecasting and Social Change · doi:10.1016/0040-1625(86)90063-6 · Cited by 82
The Committee Meeting Alternative; Using the Delphi Technique
Whitman, N. I. (1990) · JONA The Journal of Nursing Administration · doi:10.1097/00005110-199007000-00008 · Cited by 81
Hsu, C.-C., & Sandford, B. A. (2012) · IGI Global eBooks · doi:10.4018/978-1-4666-0074-4.ch011 · Cited by 62
Delphi technique supplies the classic result?
Buckley, C. C. (1994) · The Australian Library Journal · doi:10.1080/00049670.1994.10755684 · Cited by 29
Parenté, R., Hiöb, T. N., Silver, R. A., et al. (2003) · Technological Forecasting and Social Change · doi:10.1016/s0040-1625(03)00024-6 · Cited by 24
Cited by
Kache, F., & Seuring, S. (2017) · International Journal of Operations & Production Management · doi:10.1108/ijopm-02-2015-0078 · Cited by 938
Use of Delphi in health sciences research: A narrative review
Shang, Z. (2023) · Medicine · doi:10.1097/md.0000000000032829 · Cited by 657
Antecedents of social sustainability noncompliance in the Indian apparel sector
Venkatesh, V. G., Zhang, A., Deakins, E., & Mani, V. (2021) · International Journal of Production Economics · doi:10.1016/j.ijpe.2021.108038 · Cited by 34
“The Delphi method is used widely in strategic decision-making to develop a group consensus on the relative importance of study factors (Holsapple & Joshi, 2002; Okoli & Pawlowski, 2004; Grisham, 2009).”
Metadata
- Authors
- Grisham, T.
- Venue
- International Journal of Managing Projects in Business
- Publisher
- Emerald
- Published
- 2009-01-23
- Volume
- 2
- Issue
- 1
- Pages
- 112-130
- ISSN
- 1753-8378 (ISSN-L)
- OpenAlex
- W2089293862
- Cited by
- 403
- References
- 43
- FWCI
- 31.48
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.