Primary and Secondary Outcome Reporting in Randomized Trials
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Consensus as to best practices for the selection, reporting, and interpretation of primary and secondary outcomes of randomized controlled trials is lacking. We reviewed the strategies adopted in publications of randomized controlled trials (RCTs) for the analysis, presentation, and interpretation of efficacy outcomes from a survey of all cardiovascular RCTs published in the New England Journal of Medicine, Lancet, and the Journal of the American Medical Association during 2019. We focus on the choice of primary outcomes, the variety of approaches to selecting secondary outcomes, the options sometimes used to control type I error, and the common practice to not correct for multiple testing in reporting secondary outcomes. We comment on current practice across journals in the reporting of P values and also how conclusions in trial reports frequently adhere to an undue reliance on P < 0.05 as a basis for positive claims of treatment efficacy. We conclude with recommendations for how future RCT reports could best select, report, and interpret their findings on primary and secondary outcomes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dapagliflozin in Patients with Heart Failure and Reduced Ejection Fraction
McMurray, J. J. V., Solomon, S. D., Inzucchi, S. E., Køber, L., Kosiborod, M. N., Martinez, F. A., Ponikowski, P., Sabatine, M. S., Anand, I. S., Bělohlávek, J., et al. (2019) · New England Journal of Medicine · doi:10.1056/nejmoa1911303 · Cited by 7,140
Scientists rise up against statistical significance
Amrhein, V., Greenland, S., & McShane, B. (2019) · Nature · doi:10.1038/d41586-019-00857-9 · Cited by 2,983
Moving to a World Beyond “ p < 0.05”
Wasserstein, R. L., Schirm, A. L., & Lazar, N. A. (2019) · The American Statistician · doi:10.1080/00031305.2019.1583913 · Cited by 2,976
Angiotensin–Neprilysin Inhibition in Heart Failure with Preserved Ejection Fraction
Solomon, S. D., McMurray, J. J. V., Anand, I. S., Ge, J., Lam, C. S. P., Maggioni, A. P., Martinez, F., Packer, M., Pfeffer, M. A., Pieske, B., et al. (2019) · New England Journal of Medicine · doi:10.1056/nejmoa1908655 · Cited by 2,430
Sterne, J. A. C. (2001) · BMJ · doi:10.1136/bmj.322.7280.226 · Cited by 1,466
Statistics in Medicine — Reporting of Subgroup Analyses in Clinical Trials
Wang, R., Lagakos, S. W., Ware, J. H., Hunter, D. J., & Drazen, J. M. (2007) · New England Journal of Medicine · doi:10.1056/nejmsr077003 · Cited by 1,445
Robust misinterpretation of confidence intervals
Hoekstra, R., Morey, R. D., Rouder, J. N., & Wagenmakers, E.-J. (2014) · Psychonomic Bulletin & Review · doi:10.3758/s13423-013-0572-3 · Cited by 425
A graphical approach to sequentially rejective multiple test procedures
Bretz, F., Maurer, W., Brannath, W., & Posch, M. (2009) · Statistics in Medicine · doi:10.1002/sim.3495 · Cited by 420
Ticagrelor in patients with stable coronary disease and diabetes
Steg, P. G., Bhatt, D. L., Simon, T., Fox, K., Mehta, S. R., Harrington, R. A., Held, C., Andersson, M., Himmelmann, A., Ridderstråle, W., et al. (2019) · New England Journal of Medicine · doi:10.1056/nejmoa1908077 · Cited by 365
Analysis and reporting of adverse events in randomised controlled trials: a review
Phillips, R., Hazell, L., Sauzet, O., & Cornelius, V. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-024537 · Cited by 228
Cited by
McDonagh, T. A., Metra, M., Adamo, M., Gardner, R. S., Baumbach, A., Böhm, M., Burri, H., Butler, J., Čelutkienė, J., Chioncel, O., et al. (2023) · European Heart Journal · doi:10.1093/eurheartj/ehad195 · Cited by 2,612
Self-citationAuthors/Task Force Members:, McDonagh, T. A., Metra, M., Adamo, M., Gardner, R. S., Baumbach, A., Böhm, M., Burri, H., Butler, J., Čelutkienė, J., et al. (2024) · European Journal of Heart Failure · doi:10.1002/ejhf.3024 · Cited by 466
Ma, L., Hu, X., Song, L., Chen, X., Ouyang, M., Billot, L., Li, Q., Malavera, A., Li, X., Muñoz-Venturelli, P., et al. (2023) · The Lancet · doi:10.1016/s0140-6736(23)00806-1 · Cited by 407
Yang, P., Song, L., Zhang, Y., Zhang, X., Chen, X., Li, Y., Sun, L., Wan, Y., Billot, L., Li, Q., et al. (2022) · The Lancet · doi:10.1016/s0140-6736(22)01882-7 · Cited by 264
Ray, K. K., Oru, E., Rosenson, R. S., Jones, J., Ma, X., Walgren, J., Haupt, A., Verma, S., Gaudet, D., Nicholls, S. J., et al. (2025) · The Lancet · doi:10.1016/s0140-6736(25)00507-0 · Cited by 81
Cummings, B. B., Joing, M. P., Bouchard, P. R., Milton, M. N., Moesta, P. F., Ramanan, V., Lane, A., Hirman, J., Trauger, J. W., Maratos-Flier, E., et al. (2025) · The Lancet · doi:10.1016/s0140-6736(25)00825-6 · Cited by 49
Hierarchical endpoints and win statistics for geromedicine trials
Abdellatif, M., Kim, Y., & Kroemer, G. (2026) · Nature Aging · doi:10.1038/s43587-026-01158-3
Metadata
- Authors
- Pocock, S. J., Rossello, X., Owen, R., Collier, T. J., Stone, G. W., & Rockhold, F. W.
- Venue
- Journal of the American College of Cardiology
- Publisher
- Elsevier BV
- Published
- 2021-08
- Volume
- 78
- Issue
- 8
- Pages
- 827-839
- ISSN
- 0735-1097 (ISSN-L)
- OpenAlex
- W3193653141
- Cited by
- 78
- References
- 12
- FWCI
- 6.77
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.