The DOI matches its Crossref record; 98 of the 99 references it cites were found in a registry or an index.
Subgroup analyses in therapeutic cardiovascular clinical trials: Are most of them misleading?
Abstract
Background Treatment decisions in clinical cardiology are directed by results from randomized clinical trials (RCTs). We studied the appropriateness of the use and interpretation of subgroup analysis in current therapeutic cardiovascular RCTs.Methods We reviewed main reports of phase 3 cardiovascular RCTs with at least 100 patients, published in 2002 and 2004, and from major journals (Circulation, J Am Coll Cardiol, Am Heart J, Am J Cardiol, N Engl J Med, Lancet, JAMA, BMJ, Ann Intern Med). Information on subgroups included prespecification, number, interaction test use, significant subgroups found, and emphasis on findings. We examined appropriateness of reporting and differences according to sample size, overall trial result, and CONSORT adoption.Results We selected 63 RCTs, with a median of 496 (range 100-15,245) patients. Thirty-nine RCTs were reported with subgroup analyses and 26 with > 5 subgroups. No trial was specifically powered to detect subgroup effects, and only 14 RCTs were reported with fully prespecified subgroups. Only 11 RCTs were reported with interaction tests. Furthermore, 21 RCTs were reported with claims of significant subgroups and 15 with equal or more emphasis to subgroups than to the overall results. Subgroup analyses in large RCTs (> 500 patients) were reported more often than in small ones (24/30 vs 15/33, P = .005). No differences were found according to overall result (positive/negative) or CONSORT adoption.Conclusions Subgroup analyses in recent cardiovascular RCTs were reported with several shortcomings, including a lack of prespecification and testing of a large number of subgroups without the use of the statistically appropriate test for interaction. Reporting of subgroup analysis needs to be substantially improved because emphasis on these secondary results may mislead treatment decisions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In 2006, Hernandez et al 4 reported similar results after investigating published cardiovascular RCTs.”
From Understanding of interaction (subgroup) analysis in clinical trials (2019) · cites this paper as [4]
Citations
Cites
Tissue Plasminogen Activator for Acute Ischemic Stroke
(1995) · New England Journal of Medicine · doi:10.1056/nejm199512143332401 · Cited by 11,654
OLSSON, A. G., McMurray, J. J. V., Thorgeirsson, G., Spaulding, C. M., Slattery, J., Pyörälà, K., Færgeman, O., Wright, R. S., Berg, K. M., Wilhelmsen, L., et al. (1994) · The Lancet · Cited by 8,467
The SOLVD Investigators* (1991) · New England Journal of Medicine · doi:10.1056/nejm199108013250501 · Cited by 8,029
Bristow, M. R., Saxon, L. A., Boehmer, J., Krueger, S., Kass, D. A., De Marco, T., Carson, P., DiCarlo, L., DeMets, D., White, B. G., et al. (2004) · New England Journal of Medicine · doi:10.1056/nejmoa032423 · Cited by 5,812
Moses, J. W., Leon, M. B., Popma, J. J., Fitzgerald, P. J., Holmes, D. R., O’Shaughnessy, C. D., Caputo, R. P., Kereiakes, D. J., Williams, D. O., Teirstein, P. S., et al. (2003) · New England Journal of Medicine · doi:10.1056/nejmoa035071 · Cited by 4,222
The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration
Altman, D. G., Schulz, K. F., Moher, D., Egger, M., Davidoff, F., Elbourne, D., Gøtzsche, P. C., Lang, T., & for the CONSORT Group (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00012 · Cited by 3,835
Shepherd, J., Blauw, G. J., Murphy, M. B., Bollen, E. L., Buckley, B. M., Cobbe, S. M., Ford, I., Gaw, A., Hyland, M., Jukema, J. W., et al. (2002) · The Lancet · doi:10.1016/s0140-6736(02)11600-x · Cited by 3,378
Pedersen, T. R. (2004) · Atherosclerosis Supplements · doi:10.1016/j.atherosclerosissup.2004.08.027 · Cited by 3,098
Early and Sustained Dual Oral Antiplatelet Therapy Following Percutaneous Coronary Intervention
Steinhubl, S. R., Berger, P. B., Mann, J. T., Fry, E. T. A., DeLago, A. J., Wilmer, C. I., Topol, E. J., & for the CREDO Investigators (2002) · JAMA · doi:10.1001/jama.288.19.2411 · Cited by 3,071
Cited by
Sorted by citations
Items 101–131 of 131
Wei, L., Butterly, E. W., Rodriguez-Perez, J., Chowdhury, A., Shemilt, R., Hanlon, P., & McAllister, D. (2024) · BMJ Open · doi:10.1136/bmjopen-2023-081315 · Cited by 3
Analyse d'un essai thérapeutique
Duval, X. (2007) · La Presse Médicale · doi:10.1016/j.lpm.2007.01.003 · Cited by 3
Rudiments of Subgroup Analyses
Moyé, L. A. (2012) · Progress in Cardiovascular Diseases · doi:10.1016/j.pcad.2011.07.005 · Cited by 3
Boden, W. E., Flather, M. D., & Bhatt, D. L. (2010) · Cardiovascular Drugs and Therapy · doi:10.1007/s10557-010-6245-9 · Cited by 2
Getting Published and Having an Impact: Turning Rehabilitation Research Results Into Gold
Brown, M., & Gordon, W. A. (2008) · Cited by 2
Vorsicht bei Subgruppenanalysen!
Kleist, P. (2007) · Swiss Medical Forum ‒ Schweizerisches Medizin-Forum · doi:10.4414/smf.2007.06301 · Cited by 2
Industry-Sponsored Negative Trials and the Potential Pitfalls of Post Hoc Analysis
Tribble, C. G. (2008) · Archives of Surgery · doi:10.1001/archsurg.143.10.933 · Cited by 2
Subgroup analysis in randomized controlled trials: Useful or misleading?
Tritschler, T., Sadeghipour, P., & Bikdeli, B. (2022) · Thrombosis Research · doi:10.1016/j.thromres.2022.10.009 · Cited by 2
Long, Y., de Ruiter, S. C., Luijten, L. W. G., Wiegers, E., Dippel, D. W. J., van Doorn, P. A., Jacobs, B. C., & Steyerberg, E. W. (2024) · medRxiv · doi:10.1101/2024.06.24.24309421 · Cited by 2
Self-citationKastrati, L., Farina, S., Gris, A. V., Raeisi‐Dehkordi, H., Llanaj, E., Quezada‐Pinedo, H. G., Bally, L., Muka, T., & Ioannidis, J. P. A. (2024) · medRxiv · doi:10.1101/2024.07.04.24309572 · Cited by 2
Erder, M. H., Signorovitch, J., Setyawan, J., Yang, H., Parikh, K., Betts, K. A., & Xie, J. (2012) · Cited by 1
Singhal, N. S., Swanson, R. A., & Yenari, M. A. (2024) · Springer eBooks · doi:10.1007/978-3-031-49963-0_2 · Cited by 2
Hashim, M. J. (2010) · Accountability in Research · doi:10.1080/08989621.2010.511570 · Cited by 1
HETEROGENEITY IN COST-EFFECTIVENESS ANALYSIS:
Espinoza, M. (2012) · Cited by 1
Latent tuberculosis infection and incident cardiovascular and non-cardiovascular deathPreprint
Magodoro, I. M., Wilkinson, K. A., Claggett, B. L., Aluoch, A. O., Siedner, M. J., Ntsekhe, M., Ntusi, N., Nyirenda, J. L. Z., & Wilkinson, R. J. (2024) · medRxiv · doi:10.1101/2024.03.11.24304070 · Cited by 1
Role of Registries and Observational Studies in the Continuous Quality Improvement of Health Care.
Toral, A. R. (2013) · Revista Argentina de Cardiología · doi:10.7775/ajc.81.3.2455
Bevacqua, R. J., & Perrone, S. V. (2014) · Redalyc (Universidad Autónoma del Estado de México)
Papel de registros y estudios observacionales en la mejora continua de la calidad asistencial
Toral, A. R. (2014) · Revista Argentina de Cardiología · doi:10.7775/rac.es.v81.i3.2455
will need good clinical judgment and incorporation and analysis of both scoring systems.
Young, G. B., & Sharpe, M. D. (2012)
Preoperative Chemoradiotherapy for Esophageal Cancer
Mancini, N., Clementi, M., Burioni, R., Bloomgren, G., Richman, S., & Compton, T. (2012)
Attention aux analyses de sous-groupes!
Kleist, P. (2007) · Forum Médical Suisse ‒ Swiss Medical Forum · doi:10.4414/fms.2007.06301
Kan vi stole på subgruppeanalyser?
Skovlund, E. (2020) · Tidsskrift for Den norske legeforening · doi:10.4045/tidsskr.20.0119
Schandelmaier, S., Schmitt, A. M., Herbrand, A. K., Glinz, D., Ewald, H., Briel, M., Guyatt, G. H., Hemkens, L. G., & Kasenda, B. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-034565
Clinical Trials: Handling the Data
Bailey, C. E., & Chang, G. J. (2013) · Success in academic surgery · doi:10.1007/978-1-4471-4679-7_4
Faculty Opinions recommendation of Outcome based subgroup analysis: a neglected concern.
Gabler, N. B. (2010) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.1488957.970055
Hanlon, P., Butterly, E. W., Shah, A. S. V., Hannigan, L. J., Lewsey, J., Mair, F. S., Kent, D. M., Guthrie, B., Wild, S. H., Welton, N. J., et al. (2023) · medRxiv · doi:10.1101/2023.01.19.23284762
Phase III Clinical Trials with Anticancer Agents
Parulekar, W. R., & Sargent, D. J. (2010) · Springer eBooks · doi:10.1007/978-1-4419-7358-0_7
What Do RCTs Tell Us, and Could They Tell Us More? Looking Within and Beyond the Study Sample
Sim, J., Lancaster, G., & Lewis, M. (2024) · Springer eBooks · doi:10.1007/978-3-031-25859-6_5
Tong, G., Li, C., Wang, H., Fang, X., Liu, R., Zeng, Y., Sun, Q., Ouyang, Y., Ryan, M. M., Davis‐Plourde, K. L., et al. (2026) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2026.112512
Gender disparities in leadership of methodological research in health science
Christodoulakis, N., Lawson, D. O., Silva, J., Young, J., Anderson, L. N., Spall, H. G. C. V., Logie, C. H., & Mbuagbaw, L. C. E. (2026) · PLoS ONE · doi:10.1371/journal.pone.0359403
Metadata
- Authors
- Hernández, A. V., Boersma, E., Murray, G. D., Habbema, J. D. F., & Steyerberg, E. W.
- Affiliations
- Erasmus MC (NL)
- University of Edinburgh (GB)
- Corresponding author
- Hernández, Adrián V.
- Venue
- American Heart Journal
- Publisher
- Elsevier BV
- Published
- 2006-02
- Volume
- 151
- Issue
- 2
- Pages
- 257-264
- ISSN
- 0002-8703 (ISSN-L)
- OpenAlex
- W1971141955
- Cited by
- 131
- References
- 99
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 8 · 2023: 4 · 2022: 5 · 2021: 2 · 2020: 7 · 2019: 6 · 2018: 4 · 2017: 3 · 2016: 7 · 2015: 3 · 2014: 7 · 2013: 11 · 2012: 13
- FWCI
- 7.82
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Heart Journal (publishedVersion)
- PubMed (publishedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- subgroup analysis, cardiovascular clinical trials, interaction testing, trial reporting quality, CONSORT, sample size, treatment decision-making, publication bias
- MeSH terms
- Cardiovascular Diseases, Data Interpretation, Statistical, Decision Making, Humans, Randomized Controlled Trials as Topic, Treatment Outcome, Clinical Trials, Phase III as Topic, Sample Size
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review