Benefits and Risks of Drug Treatments: How to Combine the Best Evidence on Benefits With the Best Data About Adverse Effects
The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
THE CENTRAL THEME OF THE INSTITUTE OF MEDICINE report on the US drug safety system was the need for a life cycle approach to drug evaluation: both the benefits and the risks need to be evaluated and integrated during the entire market life of a drug. The Food and Drug Administration Amendments Act of 2007 also called on the agency to improve its methods of communicating risks and benefits to patients and physicians. The Institute of Medicine recommendation to “develop and continually improve a systematic approach to risk-benefit analysis for use throughout the [Food and Drug Administration] in the preapproval and postapproval settings” specifically acknowledges the need for and the challenges of the development of new methods of combining evidence about risks and benefits. Information that combines the best evidence on benefits with the best data on risks is also needed for daily clinical practice. Whenever a patient and physician decide on a particular course of treatment, they do so because they expect that the likely benefits will exceed potential harms. For the benefits of drug treatments, they often have authoritative sources to provide information: randomized trials and systematic reviews and meta-analyses of such trials. For adverse effects, the situation is different. Given the average duration of randomized trials (often months to 1 or 2 years) and the average number of patients in randomized trials (often dozens to a few hundred), such trials are at most able to detect and quantify frequent adverse events that occur only early during treatment. Moreover, the adverse effect has to be known beforehand or anticipated to be recorded systematically in the trials. The study population in trials, which often includes young persons with a single diagnosis and without concurrent disease, is often not representative of those who will eventually use the drug in the community. The situation does not much improve in meta-analysis: the typical meta-analysis of randomized trials covers 1000 to 2500 individuals, only half of whom will have taken the new drug. The sample size precludes good quantification of adverse effects unless they occur at least with a frequency of about 1 per 200 person-years. Meta-analyses of trials do not solve the problem of late adverse effects or the problem of the narrow population included in the trials. The information on harms from trials is incomplete, and the possibility of using and combining such information across trials in systematic reviews is limited. Thus, to understand the full spectrum of adverse effects—those that occur late, that were not known beforehand, and that are rare but nevertheless serious—and to be able to investigate the true incidence of known adverse effects in circumstances of actual prescribing, well-designed observational studies will always be necessary. It follows that systematic reviews of drug treatments must include not only the results of randomized trials on benefits but also evidence from observational research on harms. Although the idea to turn to observational data for evidence may be a surprise, the idea makes sense in view of what randomization does and what randomized trials are good at doing. Randomized trials are uniquely superior to evaluate the benefits, the intended or hoped-for effects of treatments. The random allocation mechanism is able to overcome the strong tendency of physicians to selectively prescribe treatments based on the perceived prognosis and likely outcomes of patients. Although prescriptions that are tailored to individual prognoses constitute desired medical practice, this effort also makes it difficult to compare the benefits of different treatments because patients who receive different treatments will have different prognoses, called “confounding by indication.” In general, data from routine daily practice can therefore not be used to assess the benefits of treatment, especially for the comparison between users and nonusers of a drug.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
When are observational studies as credible as randomised trials?
Vandenbroucke, J. P. (2004) · The Lancet · doi:10.1016/s0140-6736(04)16261-2 · Cited by 538
Self-citationAssessment and Control for Confounding by Indication in Observational Studies
Psaty, B. M., Koepsell, T. D., Lin, D., Weiss, N. S., Siscovick, D. S., Rosendaal, F. R., Pahor, M., & Furberg, C. D. (1999) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.1999.tb01603.x · Cited by 363
Self-citationComparison of evidence on harms of medical interventions in randomized and nonrandomized studies
Papanikolaou, P. N. (2006) · Canadian Medical Association Journal · doi:10.1503/cmaj.050873 · Cited by 229
CASE-CONTROL STUDIES IN THE EVALUATION OF DRUG-INDUCED ILLNESS
JICK, H., & VESSEY, M. P. (1978) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a112502 · Cited by 123
Completeness of Safety Reporting in Randomized Trials: An Evaluation of 7 Medical Areas
Ioannidis, J. P. A., & Lau, J. (2001) · JAMA · doi:10.1001/jama.285.4.437 · Cited by 3
Cited by
Chou, R., Loeser, J. D., Owens, D. K., Rosenquist, R. W., Atlas, S. J., Baisden, J., Carragee, E. J., Grabois, M., Murphy, D. R., Resnick, D. K., et al. (2009) · Spine · doi:10.1097/brs.0b013e3181a1390d · Cited by 581
Pulmonary Arterial Hypertension
McGoon, M. D., Benza, R. L., Escribano-Subias, P., Jiang, X., Miller, D. P., Peacock, A. J., Pepke-Zaba, J., Pulido, T., Rich, S., Rosenkranz, S., et al. (2013) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2013.10.023 · Cited by 524
French national health insurance information system and the permanent beneficiaries sample
Tuppin, P., de Roquefeuil, L., Weill, A., Ricordeau, P., & Merlière, Y. (2010) · Revue d'Épidémiologie et de Santé Publique · doi:10.1016/j.respe.2010.04.005 · Cited by 399
Gill, S. S., Anderson, G. M., Fischer, H. D., Bell, C. M., Li, P., Normand, S.-L. T., & Rochon, P. A. (2009) · Archives of Internal Medicine · doi:10.1001/archinternmed.2009.43 · Cited by 306
on behalf of the Diabetes and Cancer Research Consortium, Johnson, J. A., Carstensen, B., Witte, D., Bowker, S. L., Lipscombe, L., & Renehan, A. G. (2012) · Diabetologia · doi:10.1007/s00125-012-2525-1 · Cited by 260
Metadata
- Authors
- Vandenbroucke, J. P., & Psaty, B. M.
- Venue
- JAMA
- Publisher
- American Medical Association (AMA)
- Published
- 2008-11-26
- Volume
- 300
- Issue
- 20
- Pages
- 2417
- ISSN
- 0002-9955 (ISSN-L)
- 0098-7484
- OpenAlex
- W2061862339
- Cited by
- 131
- References
- 5
- FWCI
- 21.96
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Benefits and Risks of Drug Treatments: How to Combine the Best Evidence on Benefits With the Best Data About Adverse Effects. https://app.cochat.ai/papers/10.1001/jama.2008.723
- The paper
- Vandenbroucke, J. P., & Psaty, B. M. (2008). Benefits and Risks of Drug Treatments: How to Combine the Best Evidence on Benefits With the Best Data About Adverse Effects. JAMA. https://doi.org/10.1001/jama.2008.723
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.