We Agree, Don’t We? The Delphi Method for Health Environments Research
The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
Objective: This overview is intended to provide the process framework for built environment researchers to use the Delphi method. The article outlines the methodological criteria originally established for the Delphi method, as well as commonly accepted modifications, to advance guidance for evidence-based built environment considerations. Background: Increasingly used in healthcare research, the Delphi method is a process for gaining consensus through controlled feedback from a panel—a group made up of experts or individuals knowledgeable on the subject. The method is often used where there is limited or conflicting evidence, where participants may be geographically dispersed, and where anonymity is desired to control for dominant individuals. The Delphi method consists of panel selection, development of content surveys, and iterative stages of anonymous responses to gain consensus. Panelists receive feedback after each round in the form of a statistical representation of the overall group’s response. The goal of multiple iterations in the Delphi method is to reduce the range of responses and gain expert consensus, which is often seen as more credible than conjecture or individual opinion. Conclusion: With a geographic diversity of healthcare design expertise, and with so many aspects of healthcare design lacking a robust body of supporting empirical research, the Delphi method is well-suited to developing evidence-based design recommendations and considerations for healthcare built environments.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This guideline was established through international consensus over a 24 month period using a modified Delphi approach.27 28”
From FUTURE-AI: international consensus guideline for trustworthy and deployable artificial intelligence in healthcare (2025) · cites this paper as [27]
In the citing paper
“The Delphi method is a procedure for reaching a consensus with a group of people who are typically experts on the subject through controlled assessments [11].”
From Checklist Approach to Developing and Implementing AI in Clinical Settings: Instrument Development Study (2025) · cites this paper as [11]
Citations
Cites
Determination and Quantification Of Content Validity
LYNN, M. R. (1986) · Nursing Research · doi:10.1097/00006199-198611000-00017 · Cited by 6,775 · cited 2×
“Lynn (1986) defines the proportions of experts agreeing on the content validity of an item and the entire instrument and the standard error based on the total number of experts participating (Figure 4).”
BackgroundPractical Assessment, Research & Evaluation, 2000-2001.
Rudner, L. M., & Schafer, W. D. (2001) · Practical assessment, research & evaluation · Cited by 3,905
Qualitative Research: Consensus methods for medical and health services research
Jones, J., & Hunter, D. (1995) · BMJ · doi:10.1136/bmj.311.7001.376 · Cited by 3,471
The Delphi technique: myths and realities
Powell, C. (2003) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2003.02537.x · Cited by 2,584 · cited 4×
“…from a literature review (or other methods) is a widely accepted modification to the traditional open-ended questionnaire (Banayan, Blood, Park, Shahul, & Scavone, 2015; Boulkedid et al., 2011; Cantrill et al., 1996; Eubank et al., 2016; Hsu & Sandford, 2007; Powell, 2003; Verhagen et al., 1998).”
BackgroundInfluentialVerhagen, A. P., de Vet, H. C. W., de Bie, R. A., Kessels, A. G. H., Boers, M., Bouter, L. M., & Knipschild, P. G. (1998) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(98)00131-0 · Cited by 2,379
Consensus methods: characteristics and guidelines for use
Fink, A., Kosecoff, J., Chassin, M., & Brook, R. H. (1984) · American Journal of Public Health · doi:10.2105/ajph.74.9.979 · Cited by 2,089
Boulkedid, R., Abdoul, H., Loustau, M., Sibony, O., & Alberti, C. (2011) · PLoS ONE · doi:10.1371/journal.pone.0020476 · Cited by 2,045 · cited 10×
“Boulkedid et al. (2011) found that 69% of studies reviewed included some form of meeting—56% of the time between rounds and 44% of the time after the last round.”
BackgroundMethodInfluentialConsensus measurement in Delphi studies
von der Gracht, H. A. (2012) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2012.04.013 · Cited by 1,831 · cited 5×
“The stricter the criteria, the harder it is to obtain consensus (Fink et al., 1984; von der Gracht, 2012).”
BackgroundMethodInfluentialElwyn, G. (2006) · BMJ · doi:10.1136/bmj.38926.629329.ae · Cited by 1,824
The Delphi Method: An Experimental Study of Group Opinion
(1969) · RAND Corporation eBooks · doi:10.7249/rm5888 · Cited by 1,628
Research works printed but not linked: 4
- Garofalo M., 2018, Cureus, 10
- Hassen Y. A. M., 2018, Annals of Surgery, 1
- Hsu C. C., 2007, Practical Assessment, Research & Evaluation, 12, 8
- Linstone H. A., Turoff M. (1975). Introduction. In The Delphi method: Techniques and applications (Vol. 29, pp. 223–230). Retrieved from https://pdfs.semanticscholar.org/c769/dd5d3007e432178c23214f1be91257f62740.pdf
Cited by
Lekadir, K., Frangi, A. F., Porras, A. R., Glocker, B., Cintas, C., Langlotz, C. P., Weicken, E., Asselbergs, F. W., Prior, F., Collins, G. S., et al. (2025) · BMJ · doi:10.1136/bmj-2024-081554 · Cited by 957
Beniczky, S., Trinka, E., Wirrell, E., Abdulla, F., Al Baradie, R., Alonso Vanegas, M., Auvin, S., Singh, M. B., Blumenfeld, H., Bogacz Fressola, A., et al. (2025) · Epilepsia · doi:10.1111/epi.18338 · Cited by 426
“We employed a modified Delphi method 68 to achieve consensus regarding the proposed adjustments and the update of the seizure classification.”
Nasa, P., Azoulay, E., Khanna, A. K., Jain, R., Gupta, S., Javeri, Y., Juneja, D., Rangappa, P., Sundararajan, K., Alhazzani, W., et al. (2021) · Critical Care · doi:10.1186/s13054-021-03491-y · Cited by 185
“Agreement was defined as achieved when > 70% experts voted for a given option on the Likert scale for a statement [13, 14].”
BackgroundMethodInfluentialSevere Asthma Network Italy Definition of Clinical Remission in Severe Asthma: A Delphi Consensus
Canonica, G. W., Blasi, F., Carpagnano, G. E., Guida, G., Heffler, E. M., Paggiaro, P., Allegrini, C., Antonelli, A., Aruanno, A., Bacci, E., et al. (2023) · The Journal of Allergy and Clinical Immunology In Practice · doi:10.1016/j.jaip.2023.07.041 · Cited by 167
Uppal, V., Russell, R. I., Sondekoppam, R. V., Ansari, J. R., Baber, Z., Chen, Y., DelPizzo, K. R., Dîrzu, D. S., Kalagara, H. K. P., Kissoon, N. R., et al. (2023) · Regional Anesthesia & Pain Medicine · doi:10.1136/rapm-2023-104817 · Cited by 129
Metadata
- Authors
- Taylor, E.
- Affiliations
- Center for Health Design (US)
- Corresponding author
- Taylor, Ellen
- ORCID
- Taylor, Ellen
- Venue
- HERD: Health Environments Research & Design Journal
- Publisher
- SAGE Publications
- Published
- 2019-12-30
- Volume
- 13
- Issue
- 1
- Pages
- 11-23
- ISSN
- 1937-5867 (ISSN-L)
- 2167-5112
- OpenAlex
- W2996859150
- Cited by
- 316
- References
- 37
- Citations by year
- 2026: 56 · 2025: 80 · 2024: 88 · 2023: 42 · 2022: 32 · 2021: 17 · 2020: 1
- FWCI
- 25.12
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- HERD Health Environments Research & Design Journal (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Agency for Healthcare Research and Quality (HS24380)
- Topics
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Physical Sciences › Engineering › Architecture › Healthcare Facilities Design and Sustainability
- Health Sciences › Nursing › Research and Theory › Health Education and Validation
- Keywords
- Delphi method, expert consensus, healthcare design, built environment, evidence-based design, healthcare facilities, panel selection, iterative feedback
- MeSH terms
- Evidence-Based Facility Design, Delphi Technique, Health Facility Environment, Humans, Research Design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: We Agree, Don’t We? The Delphi Method for Health Environments Research. https://app.cochat.ai/papers/10.1177/1937586719887709
- The paper
- Taylor, E. (2020). We Agree, Don’t We? The Delphi Method for Health Environments Research. HERD: Health Environments Research & Design Journal. https://doi.org/10.1177/1937586719887709
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.