Consensus methods: characteristics and guidelines for use
Abstract
Consensus methods are being used increasingly to solve problems in medicine and health. Their main purpose is to define levels of agreement on controversial subjects. Advocates suggest that, when properly employed, consensus strategies can create structured environments in which experts are given the best available information, allowing their solutions to problems to be more justifiable and credible than otherwise. This paper surveys the characteristics of several major methods (Delphi, Nominal Group, and models developed by the National Institutes of Health and Glaser) and provides guidelines for those who want to use the techniques. Among the concerns these guidelines address are selecting problems, choosing members for consensus panels, specifying acceptable levels of agreement, properly using empirical data, obtaining professional and political support, and disseminating results.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
CPGs specifying methods reported formal consensus through Delphi [35] or Glaser-like [36] techniques (19%), informal consensus (31%), or a voting system (18%).
“CPGs specifying methods reported formal consensus through Delphi [35] or Glaser-like [36] techniques (19%), informal consensus (that is, no mention of specific or recognized techniques, or insufficient detail; 31%), or a voting system (18%).”
The UEG/ESNM developed consensus statements on chronic nausea and vomiting using an adapted RAND/UCLA modified Delphi panel method.
“The UEG/ESNM began a Delphi process to develop consensus statements on chronic nausea and vomiting in collaboration with other European societies, applying the adapted RAND/UCLA modified Delphi panel method [ 3 , 4 ]”
From European Guideline on Chronic Nausea and Vomiting—A UEG and ESNM Consensus for Clinical Management (2025) · cites this paper as [3]
Cites
A Group Process Model for Problem Identification and Program Planning
Delbecq, A. L., & de Ven, A. H. V. (1971) · The Journal of Applied Behavioral Science · doi:10.1177/002188637100700404 · Cited by 1,152 · see citing works
The nominal group as a research instrument for exploratory health studies.
de Ven, A. H. V., & Delbecq, A. L. (1972) · American Journal of Public Health · doi:10.2105/ajph.62.3.337 · Cited by 628 · see citing works
Medical Assessment by a Delphi Group Opinion Technic
Milholland, A. V., Wheeler, S. G., & Heieck, J. J. (1973) · New England Journal of Medicine · doi:10.1056/nejm197306142882405 · Cited by 218 · see citing works
Using Delphi to achieve congruent objectives and activities in a pediatrics department
Loughlin, K. G., & Moore, L. F. (1979) · Academic Medicine · doi:10.1097/00001888-197902000-00006 · Cited by 210 · see citing works
The NIH Consensus-Development Program and the Assessment of Health-Care Technologies
Perry, S., & Kalberer, J. T. (1980) · New England Journal of Medicine · doi:10.1056/nejm198007173030334 · Cited by 83 · see citing works
Formulating Priorities for Quality Assurance Activity
Williamson, J. (1978) · JAMA · doi:10.1001/jama.1978.03280340051021 · Cited by 75 · see citing works
Using Behavioral Science Strategies for Defining the State-of-the-Art
Glaser, E. M. (1980) · The Journal of Applied Behavioral Science · doi:10.1177/002188638001600107 · Cited by 55 · see citing works
Rennie, D. (1981) · New England Journal of Medicine · doi:10.1056/nejm198103123041110 · Cited by 53 · see citing works
Moscovice, I., Armstrong, P., Shortell, S. M., & Bennett, R. (1977) · Journal of Health Politics Policy and Law · doi:10.1215/03616878-2-3-388 · Cited by 45 · see citing works
Spending priorities in Kent: a Delphi study.
Charlton, J. R., Patrick, D. L., Matthews, G., & West, P. A. (1981) · Journal of Epidemiology & Community Health · doi:10.1136/jech.35.4.288 · Cited by 27 · see citing works
Statistical Methods for Reliability and Validity Testing
Horn, S. D., & Williamson, J. (1977) · Medical Care · doi:10.1097/00005650-197711000-00006 · Cited by 22 · see citing works
The Relative Importance of Treatment Outcomes
Clark, A., & Friedman, M. J. (1982) · Evaluation Review · doi:10.1177/0193841x8200600106 · Cited by 20 · see citing works
Thomson, W. A., & Ld, P. (1979) · PubMed · Cited by 11 · see citing works
Goodale, F., & Gander, G. W. (1976) · Academic Medicine · doi:10.1097/00001888-197611000-00002 · Cited by 8 · see citing works
Design of a health policy research and development system for Wisconsin.
Gustafson, D. H., Delbecq, A. L., Hansen, M., & Myers, R. F. (1975) · PubMed · Cited by 7 · see citing works
The Delphi predictions of pathology chairmen
Hill, R. B., & Goodale, F. (1981) · Academic Medicine · doi:10.1097/00001888-198107000-00001 · Cited by 6 · see citing works
Measurement of Task Delegations Among Nurses by Nominal Group Process Analysis
Trivedi, V. M. (1982) · Medical Care · doi:10.1097/00005650-198202000-00003 · Cited by 4 · see citing works
The Delphi technique in a psychiatric hospital.
Kumaran, K., Rc, H., & Rowe, M. (1976) · PubMed · Cited by 3 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Assessing the quality of reports of randomized clinical trials: Is blinding necessary?
Jadad, A. R., Moore, R. A., Carroll, D., Jenkinson, C., Reynolds, D. J. M., Gavaghan, D. J., & McQuay, H. J. (1996) · Controlled Clinical Trials · doi:10.1016/0197-2456(95)00134-4 · Cited by 17,582 · see citing works
Palisano, R. J., Rosenbaum, P., Walter, S. D., Russell, D., Wood, E. P., & Galuppi, B. E. (1997) · Developmental Medicine & Child Neurology · doi:10.1111/j.1469-8749.1997.tb07414.x · Cited by 6,728 · see citing works
Derivation of the sledai. A disease activity index for lupus patients
Bombardier, C., Gladman, D. D., Urowitz, M. B., Caron, D., Chang, C. H., Austin, A., Bell, A., Bloch, D. A., Corey, P. N., Decker, J. L., et al. (1992) · Arthritis & Rheumatism · doi:10.1002/art.1780350606 · Cited by 4,570 · see citing works
Nomenclature of Systemic Vasculitides
Jennette, J. C., Falk, R. J., Andrássy, K., BACON, P. A., Churg, J., Gross, W. L., Hagen, E. C., Hoffman, G. S., Hunder, G. G., Kallenberg, C. G. M., et al. (1994) · Arthritis & Rheumatism · doi:10.1002/art.1780370206 · Cited by 3,867 · see citing works
Qualitative Research: Consensus methods for medical and health services research
Jones, J., & Hunter, D. (1995) · BMJ · doi:10.1136/bmj.311.7001.376 · Cited by 3,471 · see citing works
The Delphi technique: myths and realities
Powell, C. (2003) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2003.02537.x · Cited by 2,611 · see citing works
Development of a critical appraisal tool to assess the quality of cross-sectional studies (AXIS)
Downes, M. J., Brennan, M. L., Williams, H. C., & Dean, R. S. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-011458 · Cited by 2,376 · see citing works
Jünger, S., Payne, S. A., Brine, J., Radbruch, L., & Brearley, S. G. (2017) · Palliative Medicine · doi:10.1177/0269216317690685 · Cited by 2,210 · see citing works
Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed
Kottner, J., Audigé, L., Brorson, S., Donner, A. P., Gajewski, B. J., Hróbjartsson, A., Roberts, C., Shoukri, M. M., & Streiner, D. L. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.03.002 · Cited by 2,239 · see citing works
Eliasson, A., Krumlinde‐Sundholm, L., Rösblad, B., Beckung, E., Arner, M., Öhrvall, A., & Rosenbaum, P. (2006) · Developmental Medicine & Child Neurology · doi:10.1017/s0012162206001162 · Cited by 2,197 · see citing works
(2001) · Defense Technical Information Center (DTIC) · Cited by 2,158 · see citing works
Boulkedid, R., Abdoul, H., Loustau, M., Sibony, O., & Alberti, C. (2011) · PLoS ONE · doi:10.1371/journal.pone.0020476 · Cited by 2,045 · see citing works
Consensus development methods, and their use in clinical guideline development.
Murphy, M., Black, Lamping, McKee, M., Sanderson, Askham, & Marteau (1998) · Health Technology Assessment · doi:10.3310/hta2030 · Cited by 2,042 · see citing works
Consensus measurement in Delphi studies
von der Gracht, H. A. (2012) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2012.04.013 · Cited by 1,831 · see citing works
A measure of quality of life for clinical trials in chronic lung disease
Guyatt, G. H., Berman, L. B., Townsend, M., Pugsley, S. O., & Chambers, L. W. (1987) · Thorax · doi:10.1136/thx.42.10.773 · Cited by 1,721 · see citing works
Society of Interventional Radiology Clinical Practice Guidelines
Sacks, D., McClenny, T. E., Cardella, J. F., & Lewis, C. A. (2003) · Journal of Vascular and Interventional Radiology · doi:10.1097/01.rvi.0000094584.83406.3e · Cited by 1,713 · see citing works
Lundberg, I. E., Tjärnlund, A., Bottai, M., Werth, V. P., Pilkington, C., de Visser, M., Alfredsson, L. S., Amato, A. A., Barohn, R. J., Liang, M. H., et al. (2017) · Annals of the Rheumatic Diseases · doi:10.1136/annrheumdis-2017-211468 · Cited by 1,597 · see citing works
Assche, G. V., Dignass, A. U., Panés, J., Beaugerie, L., Karagiannis, J. A., Allez, M., Ochsenkühn, T., Orchard, T., Rogler, G., Louis, E. J., et al. (2010) · Journal of Crohn s and Colitis · doi:10.1016/j.crohns.2009.12.003 · Cited by 1,444 · see citing works
Shiboski, S. C., Shiboski, C. H., Criswell, L. A., Baer, A. N., Challacombe, S., Lanfranchi, H. E., Schiødt, M., Umehara, H., Vivino, F. B., Zhao, Y., et al. (2012) · Arthritis Care & Research · doi:10.1002/acr.21591 · Cited by 1,355 · see citing works
Fuller, C. W., Ekstrand, J., Junge, A., Andersen, T. E., Bahr, R., Dvořák, J., Hägglund, M., McCrory, P. R., & Meeuwisse, W. H. (2006) · British Journal of Sports Medicine · doi:10.1136/bjsm.2005.025270 · Cited by 1,355 · see citing works
A compilation of strategies for implementing clinical innovations in health and mental health
Powell, B. J., McMillen, J. C., Proctor, E. K., Carpenter, C. R., Griffey, R. T., Bunger, A. C., Glass, J. E., & York, J. L. (2012) · Medical Care Research and Review · doi:10.1177/1077558711430690 · Cited by 1,069 · see citing works
Global Consensus on Keratoconus and Ectatic Diseases
Gomes, J. Á. P., Tan, D. T. H., Rapuano, C. J., Belin, M. W., Ambrósio, R., Güell, J. L., Malecaze, F., Nishida, K., & Sangwan, V. (2015) · Cornea · doi:10.1097/ico.0000000000000408 · Cited by 1,137 · see citing works
The Delphi technique in health sciences education research
de Villiers, M., Villiers, P. J. T. D., & Kent, A. (2005) · Medical Teacher · doi:10.1080/13611260500069947 · Cited by 1,007 · see citing works
Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed
Kottner, J., Audigé, L., Brorson, S., Donner, A. P., Gajewski, B. J., Hróbjartsson, A., Roberts, C., Shoukri, M. M., & Streiner, D. L. (2011) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2011.01.016 · Cited by 997 · see citing works
Guidelines International Network: Toward International Standards for Clinical Practice Guidelines
Qaseem, A., Forland, F., Macbeth, F., Ollenschläger, G., Phillips, S., van der Wees, P., & for the Board of Trustees of the Guidelines International Network* (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-156-7-201204030-00009 · Cited by 902 · see citing works
Marik, P. E., Pastores, S. M., Annane, D., Meduri, G. U., Sprung, C. L., Arlt, W., Keh, D., Briegel, J., Beishuizen, A., Dimopoulou, I., et al. (2008) · Critical Care Medicine · doi:10.1097/ccm.0b013e31817603ba · Cited by 912 · see citing works
The ESHRE/ESGE consensus on the classification of female genital tract congenital anomalies
Grimbizis, G. F., Gordts, S., Di Spiezio Sardo, A., Brucker, S., De Angelis, C., Gergolet, M., Li, T.-C., Tanos, V., Brolmann, H., Gianaroli, L., et al. (2013) · Human Reproduction · doi:10.1093/humrep/det098 · Cited by 884 · see citing works
Dignass, A. U., Eliakim, R., Magro, F., Maaser, C., Chowers, Y., Geboes, K., Mantzaris, G. J., Reinisch, W., Colombel, J., Vermeire, S., et al. (2012) · Journal of Crohn s and Colitis · doi:10.1016/j.crohns.2012.09.003 · Cited by 885 · see citing works
Hidecker, M. J. C., Paneth, N., Rosenbaum, P., Kent, R. D., Lillie, J., Eulenberg, J. B., CHESTER, K., Jr., JOHNSON, B., Michalsen, L., Evatt, M., et al. (2011) · Developmental Medicine & Child Neurology · doi:10.1111/j.1469-8749.2011.03996.x · Cited by 882 · see citing works
Wyrwich, K. W., Tierney, W. M., & Wolinsky, F. D. (1999) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00071-2 · Cited by 858 · see citing works
European evidence based consensus for endoscopy in inflammatory bowel disease
Annese, V., Daperno, M., Rutter, M. D., Amiot, A., Bossuyt, P. J., East, J. E., Ferrante, M., Goetz, M., Katsanos, K. H., Kießlich, R., et al. (2013) · Journal of Crohn s and Colitis · doi:10.1016/j.crohns.2013.09.016 · Cited by 813 · see citing works
Conflict of Interest in Medical Research, Education, and Practice
Institute of Medicine (2009) · National Academies Press eBooks · doi:10.17226/12598 · Cited by 824 · see citing works
Patel, R. R., Awan, S. N., Barkmeier-Kraemer, J., Courey, M., Deliyski, D., Eadie, T., Paul, D., Švec, J. G., & Hillman, R. (2018) · American Journal of Speech-Language Pathology · doi:10.1044/2018_ajslp-17-0009 · Cited by 818 · see citing works
Enhancing rigour in the Delphi technique research
Hasson, F., & Keeney, S. (2011) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2011.04.005 · Cited by 771 · see citing works
Patel, I. J., Davidson, J. C., Nikolic, B., Salazar, G., Schwartzberg, M. S., Walker, T. G., & Saad, W. A. (2012) · Journal of Vascular and Interventional Radiology · doi:10.1016/j.jvir.2012.02.012 · Cited by 751 · see citing works
Srivastava, S., Love-Nichols, J. A., Dies, K. A., Ledbetter, D. H., Martin, C. L., Chung, W. K., Firth, H. V., Frazier, T., Hansen, R. L., Prock, L., et al. (2019) · Genetics in Medicine · doi:10.1038/s41436-019-0554-6 · Cited by 695 · see citing works
Dickinson, L., Ahmed, H. U., ALLEN, C. M., Barentsz, J. O., Carey, B. M., Fütterer, J. J., Heijmink, S. W. T. P. J., Hoskin, P., Kirkham, A. P. S., Padhani, A. R., et al. (2010) · European Urology · doi:10.1016/j.eururo.2010.12.009 · Cited by 737 · see citing works
Lundberg, I. E., Tjärnlund, A., Bottai, M., Werth, V. P., Pilkington, C., de Visser, M., Alfredsson, L. S., Amato, A. A., Barohn, R. J., Liang, M. H., et al. (2017) · Arthritis & Rheumatology · doi:10.1002/art.40320 · Cited by 755 · see citing works
European consensus on the histopathology of inflammatory bowel disease
Magro, F., Langner, C., Driessen, A. L. C., Ensarı, A., Geboes, K., Mantzaris, G. J., Villanacci, V., Becheanu, G., Borralho, P., Cathomas, G., et al. (2013) · Journal of Crohn s and Colitis · doi:10.1016/j.crohns.2013.06.001 · Cited by 729 · see citing works
Research methods used in developing and applying quality indicators in primary care
Campbell, S., Braspenning, J., Hutchinson, A., & Marshall, M. (2003) · BMJ · doi:10.1136/bmj.326.7393.816 · Cited by 725 · see citing works
Research methods used in developing and applying quality indicators in primary care
Campbell, S. (2002) · BMJ Quality & Safety · doi:10.1136/qhc.11.4.358 · Cited by 689 · see citing works
Sacks, D., Baxter, B., Campbell, B. C. V., Carpenter, J., Cognard, C., Dippel, D. W. J., Eesa, M., Fischer, U., Hausegger, K. A., Hirsch, J. A., et al. (2018) · Journal of Vascular and Interventional Radiology · doi:10.1016/j.jvir.2017.11.026 · Cited by 678 · see citing works
Variations in the Use of Medical and Surgical Services by the Medicare Population
Chassin, M. R., Brook, R. H., Park, R. E., KEESEY, J. W., Fink, A., Kosecoff, J., Kahn, K. L., Merrick, N. J., & Solomon, D. H. (1986) · New England Journal of Medicine · doi:10.1056/nejm198601303140505 · Cited by 649 · see citing works
Beiderbeck, D., Frevel, N., von der Gracht, H. A., Schmidt, S. L., & Schweitzer, V. M. (2021) · MethodsX · doi:10.1016/j.mex.2021.101401 · Cited by 642 · see citing works
Fuller, C. W., Molloy, M. G., Bagate, C., Bahr, R., Brooks, J. H. M., Donson, H., Kemp, S. P. T., McCrory, P. R., McIntosh, A. S., Meeuwisse, W. H., et al. (2007) · British Journal of Sports Medicine · doi:10.1136/bjsm.2006.033282 · Cited by 633 · see citing works
Dignass, A. U., Gasché, C., Bettenworth, D., Birgegård, G., Danese, S., Gisbert, J. P., Gomollón, F., Iqbal, T. H., Katsanos, K. H., Κoutroubakis, I. E., et al. (2014) · Journal of Crohn s and Colitis · doi:10.1093/ecco-jcc/jju009 · Cited by 635 · see citing works
Terminology and classification of muscle injuries in sport: The Munich consensus statement
Mueller-Wohlfahrt, H.-W., Haensel, L., Mithoefer, K., Ekstrand, J., English, B., McNally, S. R., Orchard, J. W., van Dijk, C. N., Kerkhoffs, G. M. M. J., Schamasch, P., et al. (2012) · British Journal of Sports Medicine · doi:10.1136/bjsports-2012-091448 · Cited by 621 · see citing works
Thangaratinam, S., & Redman, C. W. E. (2005) · The Obstetrician & Gynaecologist · doi:10.1576/toag.7.2.120.27071 · Cited by 611 · see citing works
Sacks, D., Baxter, B., Campbell, B. C. V., Carpenter, J., Cognard, C., Dippel, D. W. J., Eesa, M., Fischer, U., Hausegger, K. A., Hirsch, J. A., et al. (2018) · American Journal of Neuroradiology · doi:10.3174/ajnr.a5638 · Cited by 605 · see citing works
Fuller, C. W., Ekstrand, J., Junge, A., Andersen, T. E., Bahr, R., Dvořák, J., Hägglund, M., McCrory, P. R., & Meeuwisse, W. H. (2006) · Clinical Journal of Sport Medicine · doi:10.1097/00042752-200603000-00003 · Cited by 585 · see citing works
Fuller, C. W., Ekstrand, J., Junge, A., Andersen, T. E., Bahr, R., Dvorak, J., Hägglund, M., McCrory, P. R., & Meeuwisse, W. H. (2006) · Scandinavian Journal of Medicine and Science in Sports · doi:10.1111/j.1600-0838.2006.00528.x · Cited by 555 · see citing works
Stange, E. F., Travis, S. P. L., Vermeire, S., Reinisch, W., Geboes, K., Barakauskienė, A., Feakins, R. M., Fléjou, J., Herfarth, H. H., Hommes, D. W., et al. (2008) · Journal of Crohn s and Colitis · doi:10.1016/j.crohns.2007.11.001 · Cited by 551 · see citing works
Eliasson, A., Krumlinde‐Sundholm, L., Rösblad, B., Beckung, E., Arner, M., Öhrvall, A., & Rosenbaum, P. (2007) · Developmental Medicine & Child Neurology · doi:10.1111/j.1469-8749.2006.tb01313.x · Cited by 542 · see citing works
Ismail, Z., for the NPS Professional Interest Area of the International Society of to Advance Alzheimer’s Research and Treatment (NPS-PIA of ISTAART), Agüera-Ortiz, L., Brodaty, H., Cieslak, A., Cummings, J., Fischer, C. E., Gauthier, S., Geda, Y. E., Herrmann, N., et al. (2017) · Journal of Alzheimer's Disease · doi:10.3233/jad-160979 · Cited by 530 · see citing works
Fractures Attributable to Osteoporosis: Report from the National Osteoporosis Foundation
Melton, L. J., Thamer, M., Ray, N. F., Chan, J. K., Chesnut, C. H., Einhorn, T. A., Johnston, C. C., Raisz, L. G., Silverman, S. L., & Siris, E. S. (1997) · Journal of Bone and Mineral Research · doi:10.1359/jbmr.1997.12.1.16 · Cited by 535 · see citing works
Landrigan, P. J., Schechter, C. B., Lipton, J. M. M., Fahs, M. C., & Schwartz, J. D. (2002) · Environmental Health Perspectives · doi:10.1289/ehp.02110721 · Cited by 529 · see citing works
Stange, E. F., Travis, S. P. L., Vermeire, S., Beglinger, C., Kupcinkas, L., Geboes, K., Barakauskiene, A., Villanacci, V., Herbay, A. V., Warren, B. F., et al. (2006) · Gut · doi:10.1136/gut.2005.081950a · Cited by 506 · see citing works
Consensus on Exercise Reporting Template (CERT): Modified Delphi Study
Slade, S. C., Dionne, C. E., Underwood, M., Buchbinder, R., Beck, B., Bennell, K., Brosseau, L., Costa, L., Cramp, F., Cup, E., et al. (2016) · Physical Therapy · doi:10.2522/ptj.20150668 · Cited by 478 · see citing works
A risk model for the prediction of recurrent falls in community-dwelling elderly
Stalenhoef, P. A., Diederiks, J. P. M., Knottnerus, J. A., Kester, A. D. M., & Crebolder, H. F. J. M. (2002) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(02)00502-4 · Cited by 480 · see citing works
Delphi as a method to establish consensus for diagnostic criteria
Graham, B. (2003) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(03)00211-7 · Cited by 481 · see citing works
Developing and implementing clinical practice guidelines.
Grimshaw, J., Freemantle, N., Wallace, S. A., Russell, I. T., Hurwitz, B., Watt, I., Long, A., & Sheldon, T. (1995) · BMJ Quality & Safety · doi:10.1136/qshc.4.1.55 · Cited by 467 · see citing works
Consensus Development Methods: A Review of Best Practice in Creating Clinical Guidelines
Black, N. A., Murphy, M., Lamping, D. L., McKee, M., Sanderson, C. F. B., Askham, J., & Marteau, T. M. (1999) · Journal of Health Services Research & Policy · doi:10.1177/135581969900400410 · Cited by 452 · see citing works
Guidelines for Patient Radiation Dose Management
Stecker, M. S., Balter, S., Towbin, R. B., Miller, D. L., Vano, E., Bartal, G., Angle, J. F., Chao, C. P., Cohen, A. M., Dixon, R. G., et al. (2009) · Journal of Vascular and Interventional Radiology · doi:10.1016/j.jvir.2009.04.037 · Cited by 451 · see citing works
Methods of Formal Consensus in Classification/Diagnostic Criteria and Guideline Development
Nair, R., Aggarwal, R., & Khanna, D. (2011) · Seminars in Arthritis and Rheumatism · doi:10.1016/j.semarthrit.2010.12.001 · Cited by 441 · see citing works
Core Competencies in Evidence-Based Practice for Health Professionals
Albarqouni, L., Hoffmann, T., Straus, S. E., Olsen, N. R., Young, T., Ilić, D., Shaneyfelt, T. M., Haynes, R. B., Guyatt, G. H., & Glasziou, P. (2018) · JAMA Network Open · doi:10.1001/jamanetworkopen.2018.0281 · Cited by 438 · see citing works
Meissner, M. H., Gloviczki, P., Comerota, A. J., Dalsing, M. C., Eklöf, B., Gillespie, D. L., Lohr, J. M., McLafferty, R. B., Murad, M. H., Padberg, F. T., et al. (2012) · Journal of Vascular Surgery · doi:10.1016/j.jvs.2011.12.081 · Cited by 434 · see citing works
Waggoner, J., Carline, J. D., & Durning, S. J. (2016) · Academic Medicine · doi:10.1097/acm.0000000000001092 · Cited by 432 · see citing works
Breaking bad news: consensus guidelines for medical practitioners.
Girgis, A., & Sanson‐Fisher, R. (1995) · Journal of Clinical Oncology · doi:10.1200/jco.1995.13.9.2449 · Cited by 430 · see citing works
Detection of Right-to-Left Shunt with Ultrasound Contrast Agent and Transcranial Doppler Sonography
Jauß, M., & Zanette, E. M. (2000) · Cerebrovascular Diseases · doi:10.1159/000016119 · Cited by 428 · see citing works
European Evidence-based Consensus: Inflammatory Bowel Disease and Malignancies
Annese, V., Beaugerie, L., Egan, L. J., Biancone, L., Bolling, C., Brandts, C., Dierickx, D., Dummer, R., Fiorino, G., Gornet, J. M., et al. (2015) · Journal of Crohn s and Colitis · doi:10.1093/ecco-jcc/jjv141 · Cited by 428 · see citing works
Cancer risks associated with external radiation from diagnostic imaging procedures
Linet, M. S., Slovis, T. L., Miller, D. L., Kleinerman, R. A., Lee, C., Rajaraman, P., & de González, A. B. (2012) · CA A Cancer Journal for Clinicians · doi:10.3322/caac.21132 · Cited by 421 · see citing works
Practice Guidelines, a New Reality in Medicine
Woolf, S. H. (1992) · Archives of Internal Medicine · doi:10.1001/archinte.1992.00400170036007 · Cited by 410 · see citing works
ESTES guidelines: acute mesenteric ischaemia
Tilsed, J. V. T., Casamassima, A., Kurihara, H., Mariani, D., Martinez, I., Pereira, J., Ponchietti, L., Shamiyeh, A., al-Ayoubi, F., Barco, L. A. B., et al. (2016) · European Journal of Trauma and Emergency Surgery · doi:10.1007/s00068-016-0634-0 · Cited by 382 · see citing works
Venkatesan, A. M., Kundu, S., Sacks, D., Wallace, M. J., Wojak, J. C., Rose, S. C., Clark, T. W. I., d’Othée, B. J., Itkin, M. G., Jones, R. S., et al. (2010) · Journal of Vascular and Interventional Radiology · doi:10.1016/j.jvir.2010.07.018 · Cited by 379 · see citing works
Saad, W. E. A., Wallace, M. J., Wojak, J. C., Kundu, S., & Cardella, J. F. (2010) · Journal of Vascular and Interventional Radiology · doi:10.1016/j.jvir.2010.01.012 · Cited by 357 · see citing works
European evidence based consensus on surgery for ulcerative colitis
Øresland, T., Bemelman, W. A., Sampietro, G. M., Spinelli, A., Windsor, A., Ferrante, M., Marteau, P., Zmora, O., Kotze, P. G., Espin-Basany, E., et al. (2015) · Journal of Crohn's and Colitis · doi:10.1016/j.crohns.2014.08.012 · Cited by 353 · see citing works
The role of primary care in preventing ambulatory care sensitive conditions
Caminal, J. (2004) · European Journal of Public Health · doi:10.1093/eurpub/14.3.246 · Cited by 337 · see citing works
Klimstra, D. S., Modlin, I. M., Adsay, V. N., Chetty, R., Deshpande, V., Gönen, M., Jensen, R. T., Kidd, M. S., Kulke, M. H., Lloyd, R. V., et al. (2010) · The American Journal of Surgical Pathology · doi:10.1097/pas.0b013e3181ce1447 · Cited by 349 · see citing works
Quality Improvement Guidelines for Percutaneous Needle Biopsy
Gupta, S. K., Wallace, M. J., Cardella, J. F., Kundu, S., Miller, D. L., & Rose, S. C. (2010) · Journal of Vascular and Interventional Radiology · doi:10.1016/j.jvir.2010.01.011 · Cited by 345 · see citing works
Omary, R. A., Bettmann, M. A., Cardella, J. F., Bakal, C. W., Schwartzberg, M. S., Sacks, D., Rholl, K. S., Meranze, S. G., & Lewis, C. A. (2002) · Journal of Vascular and Interventional Radiology · doi:10.1016/s1051-0443(07)61769-2 · Cited by 343 · see citing works
The Delphi technique: a comparison of results obtained using two expert panels
Duffield, C. M. (1993) · International Journal of Nursing Studies · doi:10.1016/0020-7489(93)90033-q · Cited by 338 · see citing works
We Agree, Don’t We? The Delphi Method for Health Environments Research
Taylor, E. (2020) · HERD: Health Environments Research & Design Journal · doi:10.1177/1937586719887709 · Cited by 316 · see citing works
ACCF Proposed Method for Evaluating the Appropriateness of Cardiovascular Imaging
Patel, M. R., Spertus, J. A., Brindis, R. G., Hendel, R. C., Douglas, P. S., Peterson, E. D., Wolk, M. J., Allen, J. M., & Raskin, I. E. (2005) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2005.08.030 · Cited by 332 · see citing works
Bourreille, A., Ignjatović, A., Aabakken, L., Loftus, E. V., Eliakim, R., Pennazio, M., Bouhnik, Y., Seidman, E. G., Keuchel, M., Albert, J., et al. (2009) · Endoscopy · doi:10.1055/s-0029-1214790 · Cited by 330 · see citing works
Omary, R. A., Bettmann, M. A., Cardella, J. F., Bakal, C. W., Schwartzberg, M. S., Sacks, D., Rholl, K. S., Meranze, S. G., & Lewis, C. A. (2003) · Journal of Vascular and Interventional Radiology · doi:10.1097/01.rvi.0000094601.83406.e1 · Cited by 323 · see citing works
Design’s role in construction accident causality and prevention: Perspectives from an expert panel
Gambatese, J., Behm, M., & Rajendran, S. (2007) · Safety Science · doi:10.1016/j.ssci.2007.06.010 · Cited by 308 · see citing works
The determinants of planetary health: an Indigenous consensus perspective
Redvers, N., Celidwen, Y., Schultz, C., Horn, O., Githaiga, C., Vera, M., Perdrisat, M., Plume, L. M., Kobei, D., Kain, M. C., et al. (2022) · The Lancet Planetary Health · doi:10.1016/s2542-5196(21)00354-5 · Cited by 307 · see citing works
Quality Improvement Guidelines for Percutaneous Transcatheter Embolization
Angle, J. F., Siddiqi, N. H., Wallace, M. J., Kundu, S., Stokes, L. S., Wojak, J. C., & Cardella, J. F. (2010) · Journal of Vascular and Interventional Radiology · doi:10.1016/j.jvir.2010.06.014 · Cited by 301 · see citing works
Murray, I. R., Geeslin, A. G., Goudie, E. B., Petrigliano, F. A., & LaPrade, R. F. (2017) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.16.00793 · Cited by 311 · see citing works
Gallo, G., Martellucci, J., Sturiale, A., Clerico, G. F., Milito, G., Marino, F., Cocorullo, G., Giordano, P., Mistrangelo, M., & Trompetto, M. (2020) · Techniques in Coloproctology · doi:10.1007/s10151-020-02149-1 · Cited by 292 · see citing works
Brown, D. B., Cardella, J. F., Sacks, D., Goldberg, S. N., Gervais, D. A., Rajan, D. K., Vedantham, S., Miller, D. L., Brountzos, Ε., Grassi, C. J., et al. (2006) · Journal of Vascular and Interventional Radiology · doi:10.1097/01.rvi.0000195330.47954.48 · Cited by 282 · see citing works
Caplin, D. M., Nikolic, B., Kalva, S. P., Ganguli, S., Saad, W. E. A., & Zuckerman, D. A. (2011) · Journal of Vascular and Interventional Radiology · doi:10.1016/j.jvir.2011.07.012 · Cited by 276 · see citing works
Toward a Consensus on Centralization in Surgery
Vonlanthen, R., Lodge, P., Barkun, J. S., Farges, O., Rogiers, X., Soreide, K., Kehlet, H., Reynolds, J. V., Käser, S. A., Naredi, P., et al. (2018) · Annals of Surgery · doi:10.1097/sla.0000000000002965 · Cited by 274 · see citing works
Consensus guidelines for validation of virtual reality surgical simulators
Carter, F., Schijven, M. P., Aggarwal, R. K., Grantcharov, T., Francis, N. K., Hanna, G. B., & JAKIMOWICZ, J. J. (2005) · Surgical Endoscopy · doi:10.1007/s00464-005-0384-2 · Cited by 271 · see citing works
Quality Improvement Guidelines for Transjugular Intrahepatic Portosystemic Shunts
Dariushnia, S. R., Haskal, Z. J., Midia, M., Martin, L. G., Walker, T. G., Kalva, S. P., Clark, T. W. I., Ganguli, S., Krishnamurthy, V. N., Saiter, C. K., et al. (2015) · Journal of Vascular and Interventional Radiology · doi:10.1016/j.jvir.2015.09.018 · Cited by 270 · see citing works
Achieving health gain through clinical guidelines. I: Developing scientifically valid guidelines.
Grimshaw, J., & Russell, I. T. (1993) · BMJ Quality & Safety · doi:10.1136/qshc.2.4.243 · Cited by 266 · see citing works
Pharmacologic Therapy for Pulmonary Arterial Hypertension in Adults
Taichman, D. B., Ornelas, J., Chung, L., Klinger, J. R., Lewis, S., Mandel, J., Palevsky, H. I., Rich, S., Sood, N., Rosenzweig, E. B., et al. (2014) · Chest · doi:10.1378/chest.14-0793 · Cited by 256 · see citing works
Woolf, S. H. (1990) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(90)90073-x · Cited by 259 · see citing works
Using the Delphi Method for Qualitative, Participatory Action Research in Health Leadership
Fletcher, A. J., & Marchildon, G. P. (2014) · International Journal of Qualitative Methods · doi:10.1177/160940691401300101 · Cited by 256 · see citing works
Ferguson, N. D., Frutos–Vivar, F., Esteban, A., Fernández-Segoviano, P., Aramburu, J. A., Nájera, L., & Stewart, T. E. (2005) · Critical Care Medicine · doi:10.1097/01.ccm.0000181529.08630.49 · Cited by 248 · see citing works
- Authors
- Fink, A., Kosecoff, J., Chassin, M., & Brook, R. H.
- ORCID
- Venue
- American Journal of Public Health
- Publisher
- American Public Health Association
- Published
- 1984-09
- Volume
- 74
- Issue
- 9
- Pages
- 979-983
- ISSN
- 0090-0036 (ISSN-L)
- 1541-0048
- OpenAlex
- W2168909631
- Cited by
- 2,089
- References
- 19
- Citations by year
- 2026: 56 · 2025: 96 · 2024: 119 · 2023: 107 · 2022: 106 · 2021: 101 · 2020: 112 · 2019: 85 · 2018: 85 · 2017: 93 · 2016: 84 · 2015: 90 · 2014: 87 · 2013: 90 · 2012: 71
- FWCI
- 55.78
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Journal of Public Health (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Social Sciences › Decision Sciences › Management Science and Operations Research › Multi-Criteria Decision Making
- Keywords
- consensus methods, Delphi method, nominal group technique, expert panel, health policy decision-making
- MeSH terms
- Decision Making, Delphi Technique, Humans, Methods, National Institutes of Health (U.S.), Research Design, United States
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
