Response changes in Delphi processes: why is it important to provide high-quality feedback to delphi participants?
Open accessThe claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Advantages of the Delphi method include practicality, anonymity, and iteration.
“Advantages of this method include practicality (it can be done online, asynchronously, without specialist tools), anonymity (participants know the average group score but not individuals' scores), and iteration (through feedback, outliers are prompted to either defend their response to the group or change it) (42, 43).”
From Planning and Evaluating Remote Consultation Services: A New Conceptual Framework Incorporating Complexity and Practical Ethics (2021) · cites this paper as [42]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Boulkedid, R., Abdoul, H., Loustau, M., Sibony, O., & Alberti, C. (2011) · PLoS ONE · doi:10.1371/journal.pone.0020476 · Cited by 2,045 · see citing works
An exploration of the use of simple statistics to measure consensus and stability in Delphi studies
Holey, E. A., Feeley, J. L., Dixon, J., & Whittaker, V. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-52 · Cited by 531 · see citing works
Woudenberg, F. (1991) · Technological Forecasting and Social Change · doi:10.1016/0040-1625(91)90002-w · Cited by 530 · see citing works
Lange, T., Kopkow, C., Lützner, J., Günther, K., Gravius, S., Scharf, H., Stöve, J., Wagner, R., & Schmitt, J. M. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-0912-8 · Cited by 189 · see citing works
The Delphi method—more research please
Humphrey-Murto, S. M., & de Wit, M. P. T. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.10.011 · Cited by 137 · see citing works
Khodyakov, D., Grant, S., Denger, B., Kinnett, K., Martin, A. S., Booth, M. S., Armstrong, C., Dao, E., Chen, C., Coulter, I. D., et al. (2019) · Medical Decision Making · doi:10.1177/0272989x19883631 · Cited by 39 · see citing works
Self-citationCollaborative learning framework for online stakeholder engagement
Khodyakov, D., Savitsky, T. D., & Dalal, S. R. (2015) · Health Expectations · doi:10.1111/hex.12383 · Cited by 34 · see citing works
Self-citationKhodyakov, D., Denger, B., Grant, S., Kinnett, K., Armstrong, C., Martin, A. S., Peay, H. L., Coulter, I. D., & Hazlewood, G. S. (2020) · PubMed · doi:10.25376/hra.11908395 · Cited by 18 · see citing works
Self-citationArmstrong, C., Grant, S., Kinnett, K., Denger, B., Martin, A. S., Coulter, I. D., Booth, M. S., & Khodyakov, D. (2020) · PubMed · doi:10.25376/hra.11908392 · Cited by 16 · see citing works
Self-citationKhodyakov, D., Denger, B., Grant, S., et al. (2019) · Publisher · Cited by 9 · see citing works
Self-citationArmstrong, C., Grant, S., Kinnett, K., et al. (2019) · Publisher · Cited by 8 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Greenhalgh, T., Rosen, R., Shaw, S. E., Byng, R., Faulkner, S., Finlay, T., Grundy, E., Husain, L., Hughes, G., Leone, C., et al. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.726095 · Cited by 173 · see citing works
“Advantages of this method include practicality (it can be done online, asynchronously, without specialist tools), anonymity (participants know the average group score but not individuals’ scores), and iteration (through feedback, outliers are prompted to either defend their response to the group or change it) (42, 43).”
MethodDas Delphi-Verfahren: Methodik, Varianten und Anwendungsbeispiele
Niederberger, M., & Deckert, S. (2022) · Zeitschrift für Evidenz Fortbildung und Qualität im Gesundheitswesen · doi:10.1016/j.zefq.2022.08.007 · Cited by 45 · see citing works
Greenhalgh, T., Thompson, P. A., Weiringa, S., Neves, A. L., Husain, L., Dunlop, M., Rushforth, A., Nunan, D., de Lusignan, S., & Delaney, B. C. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-042626 · Cited by 44 · see citing works
Ayres, B. D., Donnenfeld, E. D., Farid, M., Gaddie, I. B., Gupta, P. K., Holland, E. J., Karpecki, P. M., Lindstrom, R. L., Nichols, K. K., Pflugfelder, S. C., et al. (2023) · Eye · doi:10.1038/s41433-023-02500-4 · Cited by 40 · see citing works
Datta, R., Datta, K., Routh, D., Bhatia, J. K., Yadav, A. K., Singhal, A., & Dalal, S. S. (2021) · Medical Journal Armed Forces India · doi:10.1016/j.mjafi.2020.11.012 · Cited by 20 · see citing works
Nature and Predictors of Response Changes in Modified-Delphi Panels
Khodyakov, D., & Chen, C. (2020) · Value in Health · doi:10.1016/j.jval.2020.08.2093 · Cited by 17 · see citing works
Self-citationMillward, C. P., Armstrong, T. S., Barrington, H., Bell, S., Brodbelt, A. R., Bulbeck, H., Crofton, A., Dirven, L., Georgious, T., Grundy, P. L., et al. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-057384 · Cited by 17 · see citing works
Richards, K. L., Woolrych, I., Allen, K. L., & Schmidt, U. H. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-08170-4 · Cited by 17 · see citing works
Farid, M., Ayres, B. D., Donnenfeld, E. D., Gaddie, I. B., Gupta, P. K., Holland, E. J., Lindstrom, R. L., Pflugfelder, S. C., Karpecki, P. M., Nichols, K. K., et al. (2023) · Clinical ophthalmology · doi:10.2147/opth.s399989 · Cited by 16 · see citing works
Roijer, P. J., Vallinga, M. S., Pidgeon, T. E., Ceulemans, A., Bakker, A., Carrière, B., Rashid, T. G., Bellringer, J., Belinky, J., Buncamper, M. E., et al. (2023) · International Journal of Transgender Health · doi:10.1080/26895269.2023.2288881 · Cited by 13 · see citing works
Okoh, A. C., Onyeso, O. K., Ekemezie, W., Oyinlola, O., Akinrolie, O., Kalu, M. E., & on behalf of the Emerging Researchers & Professionals in Ageing-African Network (2024) · PLoS ONE · doi:10.1371/journal.pone.0298541 · Cited by 6 · see citing works
Khodyakov, D., Park, S., Hutcheon, J. A., Parisi, S. M., & Bodnar, L. M. (2022) · Health Expectations · doi:10.1111/hex.13420 · Cited by 6 · see citing works
Self-citationKalu, M. E., Bello-Haas, V. P. M. D., Griffin, M., Boamah, S. A., Harris, J. E., & Rantanen, T. (2023) · Disability and Rehabilitation · doi:10.1080/09638288.2023.2232293 · Cited by 5 · see citing works
Kanter, J., Frei‐Jones, M. J., Manwani, D. G., Treadwell, M. J., Madisetti, M., Miller, R., Jacob, S. A., Saif-Ur-Rehman, S., O’Brien, A. R., & Lanzkron, S. (2025) · Journal of sickle cell disease. · doi:10.1093/jscdis/yoaf011 · Cited by 5 · see citing works
Application of the Delphi Technique to Determine the Technological Competencies of a Faculty Member
Sosnytskyi, Y., Sikorskyi, P., Безбородих, С. М., Morozova, M., & Moroz, V. P. (2021) · European Journal of Educational Research · doi:10.12973/eu-jer.10.4.2089 · Cited by 5 · see citing works
Moving toward standardization: physician reporting of sleep studies
Lastra, A. C., Ingram, D. G., Park, J. B., James, E., Matthews, C. K. B., Canapari, C. A., Mansukhani, M. P., & Stahl, S. M. (2022) · Journal of Clinical Sleep Medicine · doi:10.5664/jcsm.10442 · Cited by 2 · see citing works
Semantic sensitivity and stakeholder gaps in the Delphi consensus definition of pruritus
Chen, S., & Lee, Y.-T. (2025) · Journal of the European Academy of Dermatology and Venereology · doi:10.1111/jdv.70003 · Cited by 1 · see citing works
Dong, H., & Zhang, Y.-Q. (2025) · Journal of Pain Research · doi:10.2147/jpr.s518289
The Construction of Competency Indicators for Dance Education Programs in Chinese Universities
Chen, D., & Peng-Fei, C. (2025) · Journal of Curriculum and Teaching · doi:10.5430/jct.v14n4p247
Richards, K. L., Woolrych, I., Allen, K. L., & Schmidt, U. (2022) · Figshare · doi:10.6084/m9.figshare.20098376
Richards, K. L., Woolrych, I., Allen, K. L., & Schmidt, U. (2022) · Figshare · doi:10.6084/m9.figshare.20098379
Derivation of Pediatric Emergency Preparedness Checklist for Urgent Care Centers
Shaukat, H., Abulebda, K., Mathison, D., Auerbach, M. A., Zaveri, P. P., & Yuknis, M. L. (2026) · Pediatrics Open Science · doi:10.1542/pedsos.2025-001335
- Authors
- Khodyakov, D., & Chen, C.
- Affiliations
- RAND Corporation (US)
- Corresponding author
- Khodyakov, Dmitry
- ORCID
- Khodyakov, Dmitry
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2020-09
- Volume
- 125
- Pages
- 160-161
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W3025059080
- Cited by
- 22
- References
- 11
- Citations by year
- 2026: 1 · 2025: 4 · 2024: 1 · 2023: 4 · 2022: 7 · 2021: 3 · 2020: 2
- FWCI
- 4.98
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Journal of Clinical Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Patient-Centered Outcomes Research Institute
- Topics
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Keywords
- Delphi method, group feedback, consensus building, online forums, participant behavior
- MeSH terms
- Delphi Technique, Humans, Patients, Caregivers, Guidelines as Topic, Consensus
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review