A process for assessing the feasibility of a network meta-analysis: a case study of everolimus in combination with hormonal therapy versus chemotherapy for advanced breast cancer
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The aim of this study is to outline a general process for assessing the feasibility of performing a valid network meta-analysis (NMA) of randomized controlled trials (RCTs) to synthesize direct and indirect evidence for alternative treatments for a specific disease population. METHODS: Several steps to assess the feasibility of an NMA are proposed based on existing recommendations. Next, a case study is used to illustrate this NMA feasibility assessment process in order to compare everolimus in combination with hormonal therapy to alternative chemotherapies in terms of progression-free survival for women with advanced breast cancer. RESULTS: A general process for assessing the feasibility of an NMA is outlined that incorporates explicit steps to visualize the heterogeneity in terms of treatment and outcome characteristics (Part A) as well as the study and patient characteristics (Part B). Additionally, steps are performed to illustrate differences within and across different types of direct comparisons in terms of baseline risk (Part C) and observed treatment effects (Part D) since there is a risk that the treatment effect modifiers identified may not explain the observed heterogeneity or inconsistency in the results due to unexpected, unreported or unmeasured differences. Depending on the data available, alternative approaches are suggested: list assumptions, perform a meta-regression analysis, subgroup analysis, sensitivity analyses, or summarize why an NMA is not feasible. CONCLUSIONS: The process outlined to assess the feasibility of an NMA provides a stepwise framework that will help to ensure that the underlying assumptions are systematically explored and that the risks (and benefits) of pooling and indirectly comparing treatment effects from RCTs for a particular research question are transparent.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Everolimus in Postmenopausal Hormone-Receptor–Positive Advanced Breast Cancer
Baselga, J., Campone, M., Piccart, M., Burris, H. A., Rugo, H. S., Sahmoud, T., Noguchi, S., Gnant, M., Pritchard, K. I., Lebrun, F., et al. (2012) · New England Journal of Medicine · doi:10.1056/nejmoa1109653 · Cited by 2,863 · cited 2×
“A stepwise process was used to select the relevant RCTs and to assess the feasibility of a NMA (Figure 3 presents the flow chart, while Additional file 2: Table S1 presents all included trials, their respective authors, years of publication and interventions) [24-28,40-64].”
Checking consistency in mixed treatment comparison meta-analysis
Dias, S., Welton, N. J., Caldwell, D. M., & Ades, A. E. (2010) · Statistics in Medicine · doi:10.1002/sim.3767 · Cited by 2,521 · cited 1×
“…that will be used to explore heterogeneity and/or inconsistency, which may include the use of a random effects model, unrelated means model [4], exclusion of specific studies that are outliers (using pre-defined criteria), node splitting [16], or the inclusion of inconsistency factors [17-19].”
Consistency and inconsistency in network meta-analysis: concepts and models for multi-arm studies
Higgins, J. P. T., Jackson, D., Barrett, J. K., Lu, G., Ades, A. E., & White, I. R. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1044 · Cited by 2,098 · cited 1×
“Therefore, it is suggested to pre-specify the types of analyses that will be used to explore heterogeneity and/or inconsistency, which may include the use of a random effects model, unrelated means model [4], exclusion of specific studies that are outliers (using pre-defined criteria), node splitting [16], or the incl…”
Simultaneous comparison of multiple treatments: Combining direct and indirect evidence.
Caldwell, D. M., Ades, A. E., & Higgins, J. P. T. (2005) · BMJ · doi:10.1136/bmj.331.7521.897 · Cited by 1,600 · cited 1×
“Even when the results of the direct evidence are conclusive, combining them with the results of indirect estimates in a mixed treat-ment comparison may yield more precise estimates as a greater evidence base is considered [8,10,12].”
Dias, S., Sutton, A. J., Ades, A. E., & Welton, N. J. (2013) · Medical Decision Making · doi:10.1177/0272989x12458724 · Cited by 1,207
Network meta‐analysis for indirect treatment comparisons
Lumley, T. (2002) · Statistics in Medicine · doi:10.1002/sim.1201 · Cited by 1,206 · cited 1×
“If the available evidence base consists of a network of interlinked multiple RCTs involving treatments compared directly or indirectly or both, it can be synthesized by means of NMA [4,8,11,13,14].”
White, I. R., Barrett, J. K., Jackson, D., & Higgins, J. P. T. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1045 · Cited by 1,114
Evaluation of networks of randomized trials
Salanti, G., Higgins, J. P., Ades, A., & Ioannidis, J. P. (2008) · Statistical Methods in Medical Research · doi:10.1177/0962280207080643 · Cited by 1,078
Jansen, J. P., & Naci, H. (2013) · BMC Medicine · doi:10.1186/1741-7015-11-159 · Cited by 656 · cited 3×
“A general process for assessing the feasibility of an NMA is outlined in Figure 1, which builds upon the existing recommendations regarding NMA [5,6,11].”
Self-citationEcological Bias, Confounding, and Effect Modification
GREENLAND, S., & MORGENSTERN, H. (1989) · International Journal of Epidemiology · doi:10.1093/ije/18.1.269 · Cited by 540
Cited by
O’Brien, D., Long, J., Quigley, J., Lee, C., McCarthy, A., & Kavanagh, P. (2021) · BMC Public Health · doi:10.1186/s12889-021-10935-1 · Cited by 317
Burnett, H., Earley, A., Voors, A. A., Senni, M., McMurray, J. J. V., Deschaseaux, C., & Cope, S. (2017) · Circulation Heart Failure · doi:10.1161/circheartfailure.116.003529 · Cited by 238
“Feasibility Assessment The feasibility of conducting a valid NMA was assessed using the process described by Cope et al,14 which involves an assessment of clinical heterogeneity in terms of the characteristics of the treatments, outcomes, study design, and patients and a comparison of differences…”
Self-citationPapadimitropoulou, K., Vossen, C., Karabis, A., Donatti, C., & Kubitz, N. (2017) · Current Medical Research and Opinion · doi:10.1080/03007995.2016.1277201 · Cited by 91
Reason, T., Benbow, E., Langham, J., Gimblett, A., Klijn, S. L., & Malcolm, B. (2024) · PharmacoEconomics - Open · doi:10.1007/s41669-024-00476-9 · Cited by 71
“…to identify relevant trials, followed by a feasibility analysis to determine which trials were appropriate to include in the NMA, i.e. involving a review of the study design, patient characteristics and outcomes to determine whether the trials were sufficiently similar to include in the NMA [17].”
MethodHersi, M., Corace, K., Hamel, C., Esmaeilisaraji, L., Rice, D., Dryburgh, N., Skidmore, B., Garber, G., Porath, A., Willows, M., et al. (2023) · PLoS ONE · doi:10.1371/journal.pone.0292745 · Cited by 13
“[45] and inspected the studies with regard to network connectivity, the similarity of interventions (e.”
Background
Metadata
- Authors
- Cope, S., Zhang, J., Saletan, S., Smiechowski, B., Jansen, J. P., & Schmid, P.
- Venue
- BMC Medicine
- Published
- 2014-06-05
- Volume
- 12
- Issue
- 1
- Pages
- 93-93
- ISSN
- 1741-7015 (ISSN-L)
- OpenAlex
- W1966561347
- Cited by
- 110
- References
- 12
- FWCI
- 6.41
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A process for assessing the feasibility of a network meta-analysis: a case study of everolimus in combination with hormonal therapy versus chemotherapy for advanced breast cancer. https://app.cochat.ai/papers/10.1186/1741-7015-12-93
- The paper
- Cope, S., Zhang, J., Saletan, S., Smiechowski, B., Jansen, J. P., & Schmid, P. (2014). A process for assessing the feasibility of a network meta-analysis: a case study of everolimus in combination with hormonal therapy versus chemotherapy for advanced breast cancer. BMC Medicine. https://doi.org/10.1186/1741-7015-12-93
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.