The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Development of the summary of findings table for network meta-analysis
Abstract
Objectives The aim of the study was to develop a Grading of Recommendations, Assessment, Development and Evaluation (GRADE) summary of findings (SoF) table format that displays the critical information from a network meta-analysis (NMA).Study design and setting We applied a user experience model for data analysis based on four rounds of semistructured interviews.Results We interviewed 32 stakeholders who conduct or use MA. Four rounds of interviews produced six candidate NMA-SoF tables. Users found a final NMA-SoF table that included the following components highly acceptable: (1) details of the clinical question (PICO), (2) a plot depicting network geometry, (3) relative and absolute effect estimates, (4) certainty of evidence, (5) ranking of treatments, and (6) interpretation of findings.Conclusion Using stakeholder feedback, we developed a new GRADE NMA-SoF table that includes the relevant components that facilitate understanding NMA findings and health decision-making.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We used the GRADE framework to assess the overall quality of evidence and presented our main findings according to GRADE guidance for NMA. 42 , 46”
From Exercise for sarcopenia in older people: A systematic review and network meta‐analysis (2023) · cites this paper as [46]
Citations
Cites
Qualitative Data Analysis: An Expanded Sourcebook
(1994) · Journal of Environmental Psychology · doi:10.1016/s0272-4944(05)80231-2 · Cited by 48,420
Three Approaches to Qualitative Content Analysis
Hsieh, H.-F., & Shannon, S. E. (2005) · Qualitative Health Research · doi:10.1177/1049732305276687 · Cited by 44,601
The qualitative content analysis process
Elo, S., & Kyngäs, H. (2008) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2007.04569.x · Cited by 22,617
Qualitative research & evaluation methods
Patton, M. Q. (2002) · Sage eBooks · Cited by 15,530
Palinkas, L. A., Horwitz, S. M., Green, C. A., Wisdom, J. P., Duan, N., & Hoagwood, K. (2015) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-013-0528-y · Cited by 12,038
Hutton, B., Salanti, G., Caldwell, D. M., Chaimani, A., Schmid, C. H., Cameron, C., Ioannidis, J. P. A., Straus, S., Thorlund, K., Jansen, J. P., et al. (2015) · Annals of Internal Medicine · doi:10.7326/m14-2385 · Cited by 8,269
Puhan, M. A., Schunemann, H. J., Murad, M. H., Li, T., Brignardello-Petersen, R., Singh, J. A., Kessels, A. G., Guyatt, G. H., & for the GRADE Working Group (2014) · BMJ · doi:10.1136/bmj.g5630 · Cited by 1,812
Self-citationSimultaneous comparison of multiple treatments: Combining direct and indirect evidence.
Caldwell, D. M., Ades, A. E., & Higgins, J. P. T. (2005) · BMJ · doi:10.1136/bmj.331.7521.897 · Cited by 1,600
Refining the Test Phase of Usability Evaluation: How Many Subjects Is Enough?
Virzi, R. A. (1992) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872089203400407 · Cited by 1,269
Conceptual and technical challenges in network meta-analysis
Cipriani, A., Higgins, J. P. T., Geddes, J. R., & Salanti, G. (2013) · Annals of Internal Medicine · doi:10.7326/0003-4819-159-2-201307160-00008 · Cited by 1,072
Chapter 12: Interpreting results and drawing conclusions
Schünemann, H. J., Oxman, A. D., Jonathan, J., & Glasziou, P. (2011) · Cited by 873
Self-citationLipkus, I. M. (2007) · Medical Decision Making · doi:10.1177/0272989x07307271 · Cited by 796
Simple tools for understanding risks: from innumeracy to insight
Gigerenzer, G., & Edwards, A. (2003) · BMJ · doi:10.1136/bmj.327.7417.741 · Cited by 776
GRADE guidelines: 13. Preparing Summary of Findings tables and evidence profiles—continuous outcomes
Guyatt, G. H., Thorlund, K., Oxman, A. D., Walter, S. D., Patrick, D., Furukawa, T. A., Johnston, B. C., Karanicolas, P., Akl, E. A., Vist, G., et al. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.08.001 · Cited by 772
Self-citationHoaglin, D. C., Hawkins, N., Jansen, J. P., Scott, D. A., Itzler, R. F., Cappelleri, J. C., Boersma, C., Thompson, D., Larholt, K. M., Díaz, M., et al. (2011) · Value in Health · doi:10.1016/j.jval.2011.01.011 · Cited by 769
Advances in the GRADE approach to rate the certainty in estimates from a network meta-analysis
Brignardello-Petersen, R., Bonner, A., Alexander, P. E., Siemieniuk, R. A., Furukawa, T. A., Rochwerg, B., Hazlewood, G. S., Alhazzani, W., Mustafa, R. A., Murad, M. H., et al. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.10.005 · Cited by 753
Self-citationIoannidis, J. P. A. (2009) · Canadian Medical Association Journal · doi:10.1503/cmaj.081086 · Cited by 716
Approaches to interpreting and choosing the best treatments in network meta-analyses
Mbuagbaw, L., Rochwerg, B., Jaeschke, R., Heels-Andsell, D., Alhazzani, W., Thabane, L., & Guyatt, G. H. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0473-z · Cited by 693
Self-citationHow People Make Decisions That Involve Risk
Reyna, V. F. (2004) · Current Directions in Psychological Science · doi:10.1111/j.0963-7214.2004.00275.x · Cited by 668
What is missing from descriptions of treatment in trials and reviews?
Glasziou, P., Meats, E., Heneghan, C., & Shepperd, S. (2008) · BMJ · doi:10.1136/bmj.39590.732037.47 · Cited by 614
Strategies to help patients understand risks
Paling, J. (2003) · BMJ · doi:10.1136/bmj.327.7417.745 · Cited by 556
A systematic review on communicating with patients about evidence
Trevena, L. J., BPsych, H. M. D., Barratt, A. L., Butow, P. N., & Caldwell, P. H. Y. (2005) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2005.00596.x · Cited by 329
Reporting of results from network meta-analyses: methodological systematic review
Bafeta, A., Trinquart, L., Seror, R., & Ravaud, P. (2014) · BMJ · doi:10.1136/bmj.g1741 · Cited by 220
Uncertainty in Treatment Rankings: Reanalysis of Network Meta-analyses of Randomized Trials
Trinquart, L., Attiche, N., Bafeta, A., Porcher, R., & Ravaud, P. (2016) · Annals of Internal Medicine · doi:10.7326/m15-2521 · Cited by 202
Rosenbaum, S., Glenton, C., & Oxman, A. D. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.12.014 · Cited by 161
Carrasco-Labra, A., Brignardello-Petersen, R., Santesso, N., Neumann, I., Mustafa, R. A., Mbuagbaw, L., Etxeandia Ikobaltzeta, I., De Stio, C., McCullagh, L. J., Alonso-Coello, P., et al. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.12.007 · Cited by 129
Self-citationRosenbaum, S., Glenton, C., Nylund, H. K., & Oxman, A. D. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.12.013 · Cited by 125
Rosenbaum, S., Glenton, C., & Cracknell, J. (2008) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-8-34 · Cited by 106
Evidence Synthesis for Decision Making 7
Ades, A. E., Caldwell, D. M., Reken, S., Welton, N. J., Sutton, A. J., & Dias, S. (2013) · Medical Decision Making · doi:10.1177/0272989x13485156 · Cited by 98
Beyene, J., Kibret, T., & Richer, D. (2014) · Clinical Epidemiology · doi:10.2147/clep.s69660 · Cited by 79
Self-citationLangendam, M. W., Carrasco‐Labra, A., Santesso, N. A., Mustafa, R. A., Brignardello‐Petersen, R., Ventresca, M., Heus, P., Lasserson, T. J., Moustgaard, R., Brożek, J., et al. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.12.008 · Cited by 25
Self-citationTan, S. H., Bujkiewicz, S., Sutton, A. J., Dequen, P., & Cooper, N. J. (2013) · Journal of Health Services Research & Policy · doi:10.1177/1355819613498379 · Cited by 22
Sullivan, S. M., Coyle, D., & Wells, G. A. (2014) · PLoS ONE · doi:10.1371/journal.pone.0113277 · Cited by 15
Quality Inquiry & Research Design
Creswell, J. W., & Poth, C. (2018) · Cited by 1
Research works printed but not linked: 2
- Schünemann, 2008, Chapter 11: presenting results and ‘Summary of findings' tables, 2008
- Patton, 2002, Chapter 5. Designing qualitative studies, 230
Cited by
Sorted by citations
Exercise for sarcopenia in older people: A systematic review and network meta‐analysis
Shen, Y., Shi, Q., Nong, K., Li, S., Yue, J., Huang, J., Dong, B., Beauchamp, M., & Hao, Q. (2023) · Journal of Cachexia, Sarcopenia and Muscle · doi:10.1002/jcsm.13225 · Cited by 464
Self-citationBrignardello-Petersen, R., Florez, I. D., Izcovich, A., Santesso, N., Hazlewood, G., Alhazanni, W., Yepes-Nuñez, J. J., Tomlinson, G., Schünemann, H. J., & Guyatt, G. H. (2020) · BMJ · doi:10.1136/bmj.m3900 · Cited by 320
Self-citationEfficacy and safety of COVID-19 vaccines
Graña, C., Ghosn, L., Evrenoglou, T., Jarde, A., Minozzi, S., Bergman, H., Buckley, B. S., Probyn, K., Villanueva, G., Henschke, N., et al. (2022) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd015477 · Cited by 310
Weibel, S., Rücker, G., Eberhart, L. H., Pace, N. L., Hartl, H. M., Jordan, O. L., Mayer, D., Riemer, M., Schaefer, M. S., Raj, D., et al. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012859.pub2 · Cited by 302
Behavioural interventions for smoking cessation: an overview and network meta-analysis
Hartmann-Boyce, J., Livingstone-Banks, J., Ordóñez-Mena, J. M., Fanshawe, T. R., Lindson, N., Freeman, S. C., Sutton, A. J., Theodoulou, A., & Aveyard, P. (2021) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013229.pub2 · Cited by 259
Metadata
- Authors
- Yepes-Nuñez, J. J., Li, S.-A., Guyatt, G., Jack, S. M., Brozek, J. L., Beyene, J., Murad, M. H., Rochwerg, B., Mbuagbaw, L., Zhang, Y., Flórez, I. D., Siemieniuk, R. A., Sadeghirad, B., Mustafa, R., Santesso, N., & Schünemann, H. J.
- Affiliations
- University of Toronto (CA)
- McMaster University (CA)
- Mayo Clinic (US)
- University of Kansas Medical Center (US)
- Corresponding author
- Schünemann, Holger J.
- ORCID
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2019-11
- Volume
- 115
- Pages
- 1-13
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W2943784761
- Cited by
- 218
- References
- 35
- Citations by year
- 2026: 17 · 2025: 20 · 2024: 28 · 2023: 35 · 2022: 47 · 2021: 31 · 2020: 30 · 2019: 9
- FWCI
- 19.55
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Clinical Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- network meta-analysis, summary of findings tables, GRADE, stakeholder feedback, user experience, network geometry, quality of evidence, treatment ranking, health decision-making, PICO
- MeSH terms
- Abstracting and Indexing, Network Meta-Analysis as Topic, Decision Making, Humans, Evidence-Based Medicine, Information Dissemination, Research Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review