Problems with use of composite end points in cardiovascular trials: systematic review of randomised controlled trials
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: To explore the extent to which components of composite end points in randomised controlled trials vary in importance to patients, the frequency of events in the more and less important components, and the extent of variability in the relative risk reductions across components. DESIGN: Systematic review of randomised controlled trials. DATA SOURCES: Cardiovascular randomised controlled trials published in the Lancet, Annals of Internal Medicine, Circulation, European Heart Journal, JAMA, and New England Journal of Medicine, from 1 January 2002 to 30 June 2003. Component end points of composite end points were categorised according to importance to patients as fatal, critical, major, moderate, or minor. RESULTS: Of 114 identified randomised controlled trials that included a composite end point of importance to patients, 68% (n=77) reported complete component data for the primary composite end point; almost all (98%; n=112) primary composite end points included a fatal end point. Of 84 composite end points for which component data were available, 54% (n=45) showed large or moderate gradients in both importance to patients and magnitude of effect across components. When analysed by categories of importance to patients, the most important components were associated with lower event rates in the control group (medians of 3.3-3.7% for fatal, critical, and major outcomes; 12.3% for moderate outcomes; and 8.0% for minor outcomes). Components of greater importance to patients were associated with smaller treatment effects than less important ones (relative risk reduction of 8% for death and 33% for components of minor importance to patients). CONCLUSION: The use of composite end points in cardiovascular trials is frequently complicated by large gradients in importance to patients and in magnitude of the effect of treatment across component end points. Higher event rates and larger treatment effects associated with less important components may result in misleading impressions of the impact of treatment.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
Lewis, E. J., Hunsicker, L. G., Clarke, W. R., Berl, T., Pohl, M. A., Lewis, J. B., Ritz, E., Atkins, R. C., Rohde, R., & Raz, I. (2001) · New England Journal of Medicine · doi:10.1056/nejmoa011303 · Cited by 5,987
Cochrane Handbook for Systematic Reviews of Interventions
Higgins, J. P. T., Green, S., & Ben Van Den, A. (2020) · International Coaching Psychology Review · doi:10.53841/bpsicpr.2020.15.2.123 · Cited by 5,670
Composite Outcomes in Randomized Trials: Greater Precision But With Greater Uncertainty?
Freemantle, N., Calvert, M., Wood, J., Eastaugh, J., & Griffin, C. (2003) · JAMA · doi:10.1001/jama.289.19.2554 · Cited by 783
One Thousand Health-Related Quality-of-Life Estimates
Tengs, T. O., & Wallace, A. (2000) · Medical Care · doi:10.1097/00005650-200006000-00004 · Cited by 662
Validity of composite end points in clinical trials
Montori, V. M., Permanyer-Miralda, G., Ferreira-González, I., Busse, J. W., Pacheco-Huergo, V., Bryant, D., Alonso, J., Akl, E. A., Domingo-Salvany, A., Mills, E., et al. (2005) · BMJ · doi:10.1136/bmj.330.7491.594 · Cited by 442
Self-citationPatients at the centre: in our practice, and in our use of language
Guyatt, G. (2004) · Evidence-Based Medicine · doi:10.1136/ebm.9.1.6 · Cited by 152
Self-citationIntravascular Gamma Radiation for In-Stent Restenosis in Saphenous-Vein Bypass Grafts
Waksman, R., Ajani, A. E., White, R. L., Chan, R. C., Satler, L. F., Kent, K. M., Pichard, A. D., Pinnow, E. E., Bui, A. B., Ramee, S. R., et al. (2002) · New England Journal of Medicine · doi:10.1056/nejmoa012579 · Cited by 145
Key Issues in End Point Selection for Heart Failure Trials: Composite End Points
Neaton, J. D., Gray, G. W., Zuckerman, B. D., & Konstam, M. A. (2005) · Journal of Cardiac Failure · doi:10.1016/j.cardfail.2005.08.350 · Cited by 138
Lessons Learned From Recent Cardiovascular Clinical Trials: Part II
DeMets, D. L., & Califf, R. M. (2002) · Circulation · doi:10.1161/01.cir.0000023220.26465.89 · Cited by 123
Cited by
SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials
Chan, A.-W., Tetzlaff, J. M., Gotzsche, P. C., Altman, D. G., Mann, H., Berlin, J. A., Dickersin, K., Hrobjartsson, A., Schulz, K. F., Parulekar, W. R., et al. (2013) · BMJ · doi:10.1136/bmj.e7586 · Cited by 6,251
Moons, K. G. M., de Groot, J. A. H., Bouwmeester, W., Vergouwe, Y., Mallett, S., Altman, D. G., Reitsma, J. B., & Collins, G. S. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001744 · Cited by 2,018
“combined outcomes is particularly challenging [82,83].”
Reddel, H. K., Taylor, D. R., Bateman, E. D., Boulet, L.-P., Boushey, H. A., Busse, W. W., Casale, T. B., Chanez, P., Enright, P. L., Gibson, P. G., et al. (2009) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.200801-060st · Cited by 1,918
Increasing value and reducing waste in research design, conduct, and analysis
Ioannidis, J. P. A., Greenland, S., Hlatky, M. A., Khoury, M. J., Macleod, M. R., Moher, D., Schulz, K. F., & Tibshirani, R. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62227-8 · Cited by 1,597
Pocock, S. J., Ariti, C. A., Collier, T. J., & Wang, D. (2012) · European Heart Journal · doi:10.1093/eurheartj/ehr352 · Cited by 812
Why Most Clinical Research Is Not Useful
Ioannidis, J. P. A. (2016) · PLOS Medicine · doi:10.1371/journal.pmed.1002049 · Cited by 655
Probiotics for the prevention of pediatric antibiotic-associated diarrhea
Goldenberg, J. Z., Lytvyn, L., Steurich, J., Parkin, P., Mahant, S., & Johnston, B. C. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004827.pub4 · Cited by 607
Holmes, M. V., Perel, P., Shah, T., Hingorani, A. D., & Casas, J. P. (2011) · JAMA · doi:10.1001/jama.2011.1880 · Cited by 472
Periprocedural Bleeding and 1-Year Outcome After Percutaneous Coronary Interventions
Ndrepepa, G., Berger, P. B., Mehilli, J., Seyfarth, M., Neumann, F.-J., Schömig, A., & Kastrati, A. (2008) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2007.10.040 · Cited by 471
Bhandari, M., Guyatt, G., Walter, S. D., Tornetta, P., Schemitsch, E. H., Swiontkowski, M., & Sanders, D. (2008) · The Journal of Bone and Joint Surgery-American Volume · doi:10.2106/jbjs.g.01694 · Cited by 450
Self-citationWhy clinical trial outcomes fail to translate into benefits for patients
Heneghan, C., Goldacre, B., & Mahtani, K. R. (2017) · Trials · doi:10.1186/s13063-017-1870-2 · Cited by 404
Primary Prevention of Cardiovascular Mortality and Events With Statin Treatments
Mills, E. J., Rachlis, B., Wu, P., Devereaux, P. J., Arora, P., & Perri, D. (2008) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2008.08.039 · Cited by 423
Self-citationCordoba, G., Schwartz, L., Woloshin, S., Bae, H., & Gotzsche, P. C. (2010) · BMJ · doi:10.1136/bmj.c3920 · Cited by 400
An introduction to multiplicity issues in clinical trials: the what, why, when and how
Li, G., Taljaard, M., Van den Heuvel, E. R., Levine, M. A., Cook, D. J., Wells, G. A., Devereaux, P. J., & Thabane, L. (2016) · International Journal of Epidemiology · doi:10.1093/ije/dyw320 · Cited by 381
Reappraisal of Ventilator-Free Days in Critical Care Research
Yehya, N., Harhay, M. O., Curley, M. A. Q., Schoenfeld, D. A., & Reeder, R. W. (2019) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.201810-2050cp · Cited by 385
Intravenous Vitamin C in Adults with Sepsis in the Intensive Care Unit
Lamontagne, F., Masse, M.-H., Menard, J., Sprague, S., Pinto, R., Heyland, D. K., Cook, D. J., Battista, M.-C., Day, A. G., Guyatt, G. H., et al. (2022) · New England Journal of Medicine · doi:10.1056/nejmoa2200644 · Cited by 350
Self-citationThe Problem With Composite End Points in Cardiovascular Studies
Kip, K. E., Hollabaugh, K., Marroquin, O. C., & Williams, D. O. (2008) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2007.10.034 · Cited by 348
Communicating the Uncertainty of Harms and Benefits of Medical Interventions
Politi, M. C., Han, P. K. J., & Col, N. F. (2007) · Medical Decision Making · doi:10.1177/0272989x07307270 · Cited by 344
Mills, E. J., WU, P., Chong, G., Ghement, I., Singh, S., Akl, E. A., Eyawo, O., Guyatt, G., Berwanger, O., & Briel, M. (2011) · QJM · doi:10.1093/qjmed/hcq165 · Cited by 338
Self-citationKlonoff, D. C., Wang, J., Rodbard, D., Kohn, M. A., Li, C., Liepmann, D., Kerr, D., Ahn, D., Peters, A. L., Umpierrez, G. E., et al. (2023) · Journal of Diabetes Science and Technology · doi:10.1177/19322968221085273 · Cited by 295
“11 In this study, we (1) identify the two essential components that best present a person’s glycemic state—one responsible for the risk of hypoglycemia and the other responsible for exposure to hyperglycemia, based on a graphical and numerical interpretation of AGP data, and (2) introduce a…”
Probiotics for the prevention of pediatric antibiotic-associated diarrhea
Guo, Q., Goldenberg, J. Z., Humphrey, C., El Dib, R., & Johnston, B. C. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004827.pub5 · Cited by 275
Kaul, S., & Diamond, G. A. (2010) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2009.06.065 · Cited by 269
Kendzerska, T., Mollayeva, T., Gershon, A. S., Leung, R. S., Hawker, G., & Tomlinson, G. (2014) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2013.01.003 · Cited by 265
Guirguis-Blake, J. M., Evans, C. V., Senger, C. A., O'Connor, E. A., & Whitlock, E. P. (2016) · Annals of Internal Medicine · doi:10.7326/m15-2113 · Cited by 260
Patient-Important Outcomes in Registered Diabetes Trials
Gandhi, G. Y. (2008) · JAMA · doi:10.1001/jama.299.21.2543 · Cited by 252
Should people at low risk of cardiovascular disease take a statin?
Abramson, J. D., Rosenberg, H. G., Jewell, N., & Wright, J. M. (2013) · BMJ · doi:10.1136/bmj.f6123 · Cited by 208
Study designs: Part 4 – Interventional studies
Aggarwal, R., & Ranganathan, P. (2019) · Perspectives in Clinical Research · doi:10.4103/picr.picr_91_19 · Cited by 138
Composite End Points in Randomized Trials: There Is No Free Lunch
Tomlinson, G., & Detsky, A. S. (2010) · JAMA · doi:10.1001/jama.2009.2017 · Cited by 121
Catalá-López, F., Macías Saint-Gerons, D., González-Bermejo, D., Rosano, G. M., Davis, B. R., Ridao, M., Zaragoza, A., Montero-Corominas, D., Tobías, A., de la Fuente-Honrubia, C., et al. (2016) · PLOS Medicine · doi:10.1371/journal.pmed.1001971 · Cited by 109
Neumann, I., Rada, G., Claro, J. C., Carrasco-Labra, A., Thorlund, K., Akl, E. A., Bates, S. M., & Guyatt, G. H. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-156-10-201205150-00421 · Cited by 94
“If we consider that the less important component of the outcome is usually more frequent than the most serious (56), the importance of the increase in bleeding with high doses of factor Xa inhibitors could be questioned.”
BackgroundSelf-citationWhat Makes a Good Predictor?: The Evidence Applied to Coronary Artery Calcium Score
Ioannidis, J. P. A., & Tzoulaki, I. (2010) · JAMA · doi:10.1001/jama.2010.503 · Cited by 81
Evidence appraisal: a scoping review, conceptual framework, and research agenda
Goldstein, A., Venker, E., & Weng, C. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocx050 · Cited by 30
Methodologic Issues in Health Informatics Trials: The Complexities of Complex Interventions
Shcherbatykh, I., Holbrook, A., Thabane, L., Dolovich, L., & COMPETE III investigators (2008) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2518 · Cited by 27
Metadata
- Authors
- Ferreira-González, I., Permanyer-Miralda, G., Domingo-Salvany, A., Busse, J. W., Heels-Ansdell, D., Montori, V. M., Akl, E. A., Bryant, D. M., Alonso-Coello, P., Alonso, J., Worster, A., Upadhye, S., Jaeschke, R., Schünemann, H. J., Pacheco-Huergo, V., Wu, P., Mills, E. J., & Guyatt, G. H.
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 2007-04-02
- Volume
- 334
- Issue
- 7597
- Pages
- 786
- ISSN
- 0007-1447 (ISSN-L)
- 0959-8138
- 1468-5833
- OpenAlex
- W2042805913
- Cited by
- 473
- References
- 15
- FWCI
- 4.77
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.