Secondary use of randomized controlled trials to evaluate drug safety: a review of methodological considerations
The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
Background Randomized clinical trials (RCTs) are often positioned at the top of evidence hierarchies. Meta-analyses of RCTs aim to integrate the state of knowledge on a given scientific question, particularly for rare drug-related outcomes. However, although RCTs are valuable tools in our armamentarium, they are rarely designed to evaluate drug safety and are thus susceptible to limitations that may hamper the ability of both RCTs and meta-analyses to fully characterize the safety profiles of drugs. Their potential limitations might be exacerbated in the study of rare outcomes, often encountered in drug safety assessment, when even minor deviations from the intended randomization could impact the stability of the risk estimates. Purpose This article considers the methodological caveats of both RCTs and meta-analyses of RCTs pertinent to the study of drug-related harms. It is intended to stimulate discussion about the impact of these caveats on interpreting findings of RCTs and meta-analyses for drug safety, which would foster more robust, critical evaluations, and thus enhance clinical and regulatory decision-making. Methods Pertinent issues that can influence the interpretation of drug-related harms discussed in this article were based on authors’ expertise and review of the literature. Results Investigators and clinicians should be cognizant of the potential limitations of the secondary use of RCTs and meta-analyses in the assessment of drug-related harms and, when applicable, should consider potential remedies to overcome these limitations. Limitations Only few practical examples are included in the article due to the fact that many of the discussed caveats are not examined and/or reported in many publications. In addition, the confidential nature of data reviewed at a regulatory agency forestalls an in depth discussion of examples pertaining to specific drugs. Furthermore, our ability to quantify the extent of encountering, or the actual impact of, the caveats addressed in this review on the RCTs findings is limited. It is worth noting that the mere encounter of a given caveat does not mean that it will obviate the utility of drug safety information from a given trial. The extent of its impact is expected to vary based on the specifics of the trial, the drugs studied, the indications, and the nature of the adverse events. Conclusions Although some of the limitations described are inherent in RCTs, some of the sources of bias highlighted in this article could be minimized by careful RCT design, planned follow-up, and improved collection of information on adverse events. As future research sheds more light on pertinent knowledge gaps and issues, the ability to maximize the use of RCTs and meta-analyses of RCTs to address drug safety questions of interest will be greatly enhanced.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Meta-analysis: Principles and procedures
Egger, M., Smith, G. D., & Phillips, A. N. (1997) · BMJ · doi:10.1136/bmj.315.7121.1533 · Cited by 2,415
Deeks, J. J., Altman, D. G., & Bradburn, M. J. (2001) · Systematic Reviews in Health Care · doi:10.1002/9780470693926.ch15 · Cited by 2,163 · cited 1×
“data and the ‘true’ drug risk that is being estimated [59].”
BackgroundThe Hazards of Scoring the Quality of Clinical Trials for Meta-analysis
Jüni, P. (1999) · JAMA · doi:10.1001/jama.282.11.1054 · Cited by 1,981 · cited 1×
“An increasingly popular view is that evaluating the impact of individual aspects of the trial design on study findings is more useful than any arbitrarily-weighted summary score derived from the individual items [57,58].”
BackgroundSystematic Reviews in Health Care: Meta‐Analysis in Context
(2001) · doi:10.1002/9780470693926 · Cited by 1,693
Evaluating medication effects outside of clinical trials: new-user designs
Ray, W. A. (2003) · American Journal of Epidemiology · doi:10.1093/aje/kwg231 · Cited by 1,646 · cited 1×
“An apparent decrease in risk over time might, in reality, reflect a decreasing number of susceptible participants, as some susceptible participants tend to develop drug-related AEs shortly after drug exposure, a phenomenon known as ‘depletion of susceptibles’ [32].”
BackgroundSanderson, S., Tatt, I. D., & Higgins, J. P. (2007) · International Journal of Epidemiology · doi:10.1093/ije/dym018 · Cited by 1,531 · cited 1×
“Furthermore, there is a noticeable lack of standardized tools to assess the quality of drug safety evidence gleaned from observational studies [93,94].”
BackgroundThe Existence of Publication Bias and Risk Factors for Its Occurrence
Dickersin, K. (1990) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1990.03440100097014 · Cited by 1,417 · cited 1×
“Moreover, while publication bias has been widely discussed in the literature [49], the equally concerning problem of multiple counting of trials/ participants [50] has received less attention, although several examples can be found in the literature including articles in leading medical journals [11,51].”
BackgroundA method for assessing the quality of a randomized control trial
Chalmers, T. C., Smith, H., Blackburn, B., Silverman, B., Schroeder, B., Reitman, D., & Ambroz, A. (1981) · Controlled Clinical Trials · doi:10.1016/0197-2456(81)90056-8 · Cited by 1,349
Moher, D., Jadad, A. R., Nichol, G., Penman, M., Tugwell, P., & Walsh, S. (1995) · Controlled Clinical Trials · doi:10.1016/0197-2456(94)00031-w · Cited by 1,308
Cumulative Meta-Analysis of Therapeutic Trials for Myocardial Infarction
Lau, J., Antman, E. M., Jimenez-Silva, J., Kupelnick, B., Mosteller, F., & Chalmers, T. C. (1992) · New England Journal of Medicine · doi:10.1056/nejm199207233270406 · Cited by 1,140 · cited 1×
“Due to the multiple comparisons that are typically conducted and their post-hoc, retrospective nature [62], some authors [63] have suggested using a stricter significance level for meta-analysis in place of the”
Method
Cited by
Defining and Measuring Meditation-Related Adverse Effects in Mindfulness-Based Programs
Britton, W. B., Lindahl, J. R., Cooper, D. J., Canby, N. K., & Palitsky, R. (2021) · Clinical Psychological Science · doi:10.1177/2167702621996340 · Cited by 278
Harms in Systematic Reviews Paper 1: An introduction to research on harms
Qureshi, R., Mayo-Wilson, E., & Li, T. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.10.023 · Cited by 63
Smith, S. M., Wang, A. T., Katz, N. P., McDermott, M. P., Burke, L. B., Coplan, P., Gilron, I., Hertz, S. H., Lin, A. H., Rappaport, B. A., et al. (2013) · Pain · doi:10.1016/j.pain.2013.03.003 · Cited by 58
Improving the analysis of adverse event data in randomized controlled trials
Cornelius, V. R., & Phillips, R. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.12.023 · Cited by 27
Metadata
- Authors
- Hammad, T. A., Pinheiro, S. P., & Neyarapally, G. A.
- Venue
- Clinical Trials
- Publisher
- SAGE Publications
- Published
- 2011-08-30
- Volume
- 8
- Issue
- 5
- Pages
- 559-570
- ISSN
- 1740-7745 (ISSN-L)
- 1740-7753
- OpenAlex
- W2091050540
- Cited by
- 46
- References
- 27
- FWCI
- 4.17
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Secondary use of randomized controlled trials to evaluate drug safety: a review of methodological considerations. https://app.cochat.ai/papers/10.1177/1740774511419165
- The paper
- Hammad, T. A., Pinheiro, S. P., & Neyarapally, G. A. (2011). Secondary use of randomized controlled trials to evaluate drug safety: a review of methodological considerations. Clinical Trials. https://doi.org/10.1177/1740774511419165
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.