The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Estimating Treatment Effects Using Observational Data
Abstract
THE RANDOMIZED CLINICAL TRIAL (RCT) IS THE ideal method for measuring treatment effects. Participants in clinical trials are randomly assigned to a treatment or control group. Randomization reduces biases by making treatment and control groups “equal with respect to all features,” except the treatment assignment. When randomization is performed correctly, differences in efficacy found by statistical comparisons can be attributed to the difference between the treatment and control. However, the RCT does not necessarily provide the final answer to treatment effectiveness, as there are many restrictions that limit generalizability. For example, RCTs are often restricted to patients with limited disease, comorbidity, and concomitant medications. Thus, RCTs generally demonstrate efficacy rather than effectiveness, where efficacy is the treatment effect under the restricted conditions of the RCT and effectiveness is the treatment effect under the conditions of usual practice. Observational, nonrandomized studies have a role when RCTs are not available, and, even when RCTs are available, to quantify effectiveness and other real world experiences. A contemporary example of this is the evaluation of drugeluting stents, for which RCTs have demonstrated shortterm efficacy for relatively healthy patients and observational studies are beginning to address long-term effectiveness and safety problems and use of clopidogrel in a broader array of patients. There are many approaches for making statistical inferences from observational data. Some approaches focus on study design, others on statistical techniques. However, even with the best of designs, observational studies, unlike the RCTs, do not automatically control for selection biases. Therefore, statistical methods involving matching, stratification, and/or covariance adjustment are needed. Lack of randomization in observational studies may result in large differences on the observed (and unobserved) participant characteristics between the treatment and control groups. These differences can lead to biased estimates of treatment effects. The goal of the statistical techniques that focus on observational data is to create an analysis that resembles what would occur had the treatment been randomly assigned. In RCTs, the balance is achieved on participant characteristics that occur before the treatment is administered. The success of randomization in creating balance can be assessed before any outcome measurements are taken. Therefore, in observational studies, the first goal of a statistical technique is to create balance between treatments on characteristics that are assessed before the actual treatment is administered. Once this balance has been achieved, outcome measurements can be ascertained and compared between groups. In practice, this goal is often difficult to achieve because the data available for observational studies usually contain measured patient characteristics that are obtained before, during, and after treatment administration, and it is often difficult to determine exactly which patient characteristics are pretreatment or not. Furthermore, there frequently are unmeasured characteristics that are not available, inadequately measured, or unknown. Thus, the statistical methods in observational studies need first to be judged based on their performance in creating a balance on background characteristics between treated and control groups and the impact of outcome data should play no role in this assessment. To adjust for pretreatment imbalances, 2 statistical approaches often used are analysis of covariance methods and propensity score methods. These 2 methods complement each other and generally should be used together rather than choosing between one or the other. Analysis of covariance refers here to standard statistical analyses that produce estimates of treatment effects adjusted for background characteristics (covariates), which are included explicitly in a statistical (regression) model. With observational studies, this technique can produce biased estimates of treatment effects if there is extreme imbalance of the background characteristics and/or the treatment effect
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Rubin, D. B. (2007) · Statistics in Medicine · doi:10.1002/sim.2739 · Cited by 1,047
Clopidogrel Use and Long-term Clinical Outcomes After Drug-Eluting Stent Implantation
Eisenstein, E. L., Anstrom, K. J., Kong, D. F., Shaw, L. K., Tuttle, R. H., Mark, D. B., Kramer, J. M., Harrington, R. A., Matchar, D. B., Kandzari, D. E., et al. (2007) · JAMA · doi:10.1001/jama.297.2.joc60179 · Cited by 870
Stukel, T. A., Fisher, E. S., Wennberg, D. E., Alter, D. A., Gottlieb, D. J., & Vermeulen, M. J. (2007) · JAMA · doi:10.1001/jama.297.3.278 · Cited by 786
MCCLELLAN, M., MCNEIL, B. J., & NEWHOUSE, J. P. (1995) · Survey of Anesthesiology · doi:10.1097/00132586-199506000-00003 · Cited by 331
Measuring effectiveness. What to expect without a randomized control group.
D’Agostino, R. B., & Russell, H. K. (1995) · PubMed · Cited by 100
Self-citationD’Agostino (1998) · doi:10.1002/(sici)1097-0258(19981015)17:19<2265::aid-sim918>3.0.co;2-b
Cited by
Physical Activity, Diet, and Risk of Alzheimer Disease
Scarmeas, N. (2009) · JAMA · doi:10.1001/jama.2009.1144 · Cited by 916
For objective causal inference, design trumps analysis
Rubin, D. B. (2008) · The Annals of Applied Statistics · doi:10.1214/08-aoas187 · Cited by 831
The effect of financial incentives on the quality of health care provided by primary care physicians
Scott, A., Sivey, P., Ait Ouakrim, D., Willenberg, L., Naccarella, L., Furler, J., & Young, D. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008451.pub2 · Cited by 568
Drug-Eluting Stents vs. Coronary-Artery Bypass Grafting in Multivessel Coronary Disease
Hannan, E. L., Wu, C., Walford, G., Culliford, A. T., Gold, J. P., Smith, C. R., Higgins, R. S. D., Carlson, R. E., & Jones, R. H. (2008) · New England Journal of Medicine · doi:10.1056/nejmoa071804 · Cited by 541
Effectiveness of treatments for severe sepsis: A prospective, multicenter, observational study.
Ferrer, R., Artigas, A., Suarez, D., Palencia, E., Levy, M. M., Arenzana, A., Pérez, X. L., & Sirvent, J.-M. (2009) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.200812-1912oc · Cited by 433
Metadata
- Authors
- D’Agostino, R. B.
- Venue
- JAMA
- Publisher
- American Medical Association (AMA)
- Published
- 2007-01-17
- Volume
- 297
- Issue
- 3
- Pages
- 314
- ISSN
- 0002-9955 (ISSN-L)
- 0098-7484
- OpenAlex
- W2161330753
- Cited by
- 350
- References
- 7
- FWCI
- 29.13
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Estimating Treatment Effects Using Observational Data. https://app.cochat.ai/papers/10.1001/jama.297.3.314
- The paper
- D’Agostino, R. B. (2007). Estimating Treatment Effects Using Observational Data. JAMA. https://doi.org/10.1001/jama.297.3.314
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.