The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Indirect Treatment Comparison/Network Meta-Analysis Study Questionnaire to Assess Relevance and Credibility to Inform Health Care Decision Making: An ISPOR-AMCP-NPC Good Practice Task Force Report
Open accessAbstract
Despite the great realized or potential value of network meta-analysis of randomized controlled trial evidence to inform health care decision making, many decision makers might not be familiar with these techniques. The Task Force developed a consensus-based 26-item questionnaire to help decision makers assess the relevance and credibility of indirect treatment comparisons and network meta-analysis to help inform health care decision making. The relevance domain of the questionnaire (4 questions) calls for assessments about the applicability of network meta-analysis results to the setting of interest to the decision maker. The remaining 22 questions belong to an overall credibility domain and pertain to assessments about whether the network meta-analysis results provide a valid answer to the question they are designed to answer by examining 1) the used evidence base, 2) analysis methods, 3) reporting quality and transparency, 4) interpretation of findings, and 5) conflicts of interest. The questionnaire aims to help readers of network meta-analysis opine about their confidence in the credibility and applicability of the results of a network meta-analysis, and help make decision makers aware of the subtleties involved in the analysis of networks of randomized trial evidence. It is anticipated that user feedback will permit periodic evaluation and modification of the questionnaire.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Strengths of our study include a comprehensive systematic review methodology that followed the Cochrane Handbook44 and ISPOR12 guidelines, and reported using the PRISMA extension for NMA.13”
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
The Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
GRADE: an emerging consensus on rating quality of evidence and strength of recommendations
Guyatt, G. H., Oxman, A. D., Vist, G. E., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P., & Schünemann, H. J. (2008) · BMJ · doi:10.1136/bmj.39489.470347.ad · Cited by 23,305
Salanti, G., Ades, A. E., & Ioannidis, J. P. A. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.03.016 · Cited by 3,766
Self-citationHow should meta‐regression analyses be undertaken and interpreted?
Thompson, S. G., & Higgins, J. P. T. (2002) · Statistics in Medicine · doi:10.1002/sim.1187 · Cited by 3,026
Bayesian Data Analysis, 2nd edn
Brix, A. (2005) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/j.1467-985x.2004.00347_4.x · Cited by 2,588
Checking consistency in mixed treatment comparison meta-analysis
Dias, S., Welton, N. J., Caldwell, D. M., & Ades, A. E. (2010) · Statistics in Medicine · doi:10.1002/sim.3767 · Cited by 2,521 · cited 3×
“[32] Dias S, Welton NJ, Caldwell DM, Ades AE.”
BackgroundResultCombination of direct and indirect evidence in mixed treatment comparisons
Lu, G., & Ades, A. E. (2004) · Statistics in Medicine · doi:10.1002/sim.1875 · Cited by 2,172
Bucher, H. C., Guyatt, G. H., Griffith, L. E., & Walter, S. D. (1997) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(97)00049-8 · Cited by 2,052
The Hazards of Scoring the Quality of Clinical Trials for Meta-analysis
Jüni, P. (1999) · JAMA · doi:10.1001/jama.282.11.1054 · Cited by 1,981
Simultaneous comparison of multiple treatments: Combining direct and indirect evidence.
Caldwell, D. M., Ades, A. E., & Higgins, J. P. T. (2005) · BMJ · doi:10.1136/bmj.331.7521.897 · Cited by 1,600 · cited 4×
“the comparison of interest would be considered [4,5,10,12].”
BackgroundResultInfluentialDias, S., Sutton, A. J., Ades, A. E., & Welton, N. J. (2013) · Medical Decision Making · doi:10.1177/0272989x12458724 · Cited by 1,207
Toward Evidence-Based Medical Statistics. 1: The P Value Fallacy
Goodman, S. N. (1999) · Annals of Internal Medicine · doi:10.7326/0003-4819-130-12-199906150-00008 · Cited by 1,188
Jansen, J. P., Fleurence, R., Devine, B., Itzler, R. F., Barrett, A., Hawkins, N., Lee, K., Boersma, C., Annemans, L., & Cappelleri, J. C. (2011) · Value in Health · doi:10.1016/j.jval.2011.04.002 · Cited by 1,029
Self-citationSong, F., Altman, D. G., Glenny, A., & Deeks, J. J. (2003) · BMJ · doi:10.1136/bmj.326.7387.472 · Cited by 947
The Interpretation of Random-Effects Meta-Analysis in Decision Models
Ades, A. E., Lu, G., & Higgins, J. P. T. (2005) · Medical Decision Making · doi:10.1177/0272989x05282643 · Cited by 862
Hoaglin, D. C., Hawkins, N., Jansen, J. P., Scott, D. A., Itzler, R. F., Cappelleri, J. C., Boersma, C., Thompson, D., Larholt, K. M., Díaz, M., et al. (2011) · Value in Health · doi:10.1016/j.jval.2011.01.011 · Cited by 769
Self-citationAssessing Evidence Inconsistency in Mixed Treatment Comparisons
Lu, G., & Ades, A. E. (2006) · Journal of the American Statistical Association · doi:10.1198/016214505000001302 · Cited by 756
Demystifying trial networks and network meta-analysis
Mills, E. J., Thorlund, K., & Ioannidis, J. P. A. (2013) · BMJ · doi:10.1136/bmj.f2914 · Cited by 742
Jansen, J. P., Crawford, B., Bergman, G., & Stam, W. B. (2008) · Value in Health · doi:10.1111/j.1524-4733.2008.00347.x · Cited by 386
Self-citationUse of Indirect and Mixed Treatment Comparisons for Technology Assessment
Sutton, A. J., Ades, A. E., Cooper, N. J., & Abrams, K. R. (2008) · PharmacoEconomics · doi:10.2165/00019053-200826090-00006 · Cited by 354
A case study of multiple-treatments meta-analysis demonstrates that covariates should be considered
Salanti, G., Marinho, V. C., & Higgins, J. P. T. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.10.001 · Cited by 301
Self-citationSchmid, C. H., Stark, P. C., Berlin, J. A., Landais, P., & Lau, J. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2003.12.001 · Cited by 245
Cooper, N. J., Sutton, A. J., Morris, D. H., Ades, A. E., & Welton, N. J. (2009) · Statistics in Medicine · doi:10.1002/sim.3594 · Cited by 238
Exploring the Geometry of Treatment Networks
Salanti, G., Kavvoura, F. K., & Ioannidis, J. P. A. (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-148-7-200804010-00011 · Cited by 236
Self-citationIndirect Comparisons: A Review of Reporting and Methodological Quality
Donegan, S., Williamson, P. R., Gamble, C. L., & Smith, C. T. (2010) · PLoS ONE · doi:10.1371/journal.pone.0011054 · Cited by 146
Berger, M. L., Martin, B. C., Husereau, D., Worley, K., Allen, J. D., Yang, W., Quon, N. C., Mullins, C. D., Kahler, K. H., & Crown, W. H. (2014) · Value in Health · doi:10.1016/j.jval.2013.12.011 · Cited by 135
Mixed treatment comparisons using aggregate and individual participant level data
Saramago, P., Sutton, A. J., Cooper, N. J., & Manca, A. (2012) · Statistics in Medicine · doi:10.1002/sim.5442 · Cited by 116
Evidence Synthesis for Decision Making 7
Ades, A. E., Caldwell, D. M., Reken, S., Welton, N. J., Sutton, A. J., & Dias, S. (2013) · Medical Decision Making · doi:10.1177/0272989x13485156 · Cited by 98
Indirect comparisons: the mesh and mess of clinical trials
Ioannidis, J. P. A. (2006) · The Lancet · doi:10.1016/s0140-6736(06)69615-3 · Cited by 94
Network meta‐analysis of individual and aggregate level data
Jansen, J. P. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1048 · Cited by 94
Self-citationDias, S., Welton, N. J., Marinho, V. C., Salanti, G., Higgins, J. P. T., & Ades, A. E. (2010) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/j.1467-985x.2010.00639.x · Cited by 85
Self-citationAssessing the potential for outcome reporting bias in a review: a tutorial
Dwan, K. M., Gamble, C. L., Kolamunnage‐Dona, R., Mohammed, S., Powell, C., & Williamson, P. R. (2010) · Trials · doi:10.1186/1745-6215-11-52 · Cited by 66
Directed acyclic graphs can help understand bias in indirect and mixed treatment comparisons
Jansen, J. P., Schmid, C. H., & Salanti, G. (2012) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.01.002 · Cited by 62
Self-citationDonegan, S., Williamson, P. R., D’Alessandro, U., & Smith, C. T. (2012) · Statistics in Medicine · doi:10.1002/sim.5470 · Cited by 50
Flagged first, then by citations
Research works printed but not linked: 1
- Caro, 2014, A modeling study questionnaire to assess study relevance and credibility to inform health care decision making: an ISPOR-AMCP-NPC Good Practice Task Force report, Value Health, 17
Cited by
Sorted by citations
Hutton, B., Salanti, G., Caldwell, D. M., Chaimani, A., Schmid, C. H., Cameron, C., Ioannidis, J. P. A., Straus, S., Thorlund, K., Jansen, J. P., et al. (2015) · Annals of Internal Medicine · doi:10.7326/m14-2385 · Cited by 8,269
Self-citationCINeMA: an approach for assessing confidence in the results of a network meta-analysis
Nikolakopoulou, A., Higgins, J. P. T., Papakonstantinou, T., Chaimani, A., Del Giovane, C., Egger, M., & Salanti, G. (2020) · PLOS Medicine · doi:10.1371/journal.pmed.1003082 · Cited by 1,935
Self-citationPuhan, M. A., Schunemann, H. J., Murad, M. H., Li, T., Brignardello-Petersen, R., Singh, J. A., Kessels, A. G., Guyatt, G. H., & for the GRADE Working Group (2014) · BMJ · doi:10.1136/bmj.g5630 · Cited by 1,812
Ranking treatments in frequentist network meta-analysis works without resampling methods
Rücker, G., & Schwarzer, G. (2015) · BMC Medical Research Methodology · doi:10.1186/s12874-015-0060-8 · Cited by 1,732
Comparisons of Interventions for Preventing Falls in Older Adults
Tricco, A. C., Thomas, S. M., Veroniki, A. A., Hamid, J. S., Cogo, E., Strifler, L., Khan, P. A., Robson, R. C., Sibley, K. M., MacDonald, H. R., et al. (2017) · JAMA · doi:10.1001/jama.2017.15006 · Cited by 657
Metadata
- Authors
- Jansen, J. P., Trikalinos, T., Cappelleri, J. C., Daw, J., Andes, S., Eldessouki, R., & Salanti, G.
- Affiliations
- Tufts University (US)
- Brown University (US)
- Pfizer (United States) (US)
- UPMC Health System (US)
- Fayoum University (EG)
- University of Ioannina (GR)
- Corresponding author
- Jansen, Jeroen P.
- ORCID
- Venue
- Value in Health
- Publisher
- Elsevier BV
- Published
- 2014-03
- Volume
- 17
- Issue
- 2
- Pages
- 157-173
- ISSN
- 1098-3015 (ISSN-L)
- OpenAlex
- W2035613798
- Cited by
- 319
- References
- 38
- Citations by year
- 2026: 15 · 2025: 17 · 2024: 28 · 2023: 20 · 2022: 22 · 2021: 22 · 2020: 36 · 2019: 17 · 2018: 36 · 2017: 30 · 2016: 39 · 2015: 27 · 2014: 10
- FWCI
- 34.46
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Value in Health (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- network meta-analysis, indirect treatment comparison, healthcare decision-making, credibility assessment, applicability, reporting quality, transparency, conflicts of interest, randomized controlled trials
- MeSH terms
- Decision Making, Delivery of Health Care, Humans, Surveys and Questionnaires, Research Design, Meta-Analysis as Topic, Randomized Controlled Trials as Topic, Evidence-Based Medicine, Advisory Committees, Internationality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
