Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 350

The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.

Estimating Treatment Effects Using Observational Data

D’Agostino, Ralph B.·2007·JAMA

Abstract

THE RANDOMIZED CLINICAL TRIAL (RCT) IS THE ideal method for measuring treatment effects. Participants in clinical trials are randomly assigned to a treatment or control group. Randomization reduces biases by making treatment and control groups “equal with respect to all features,” except the treatment assignment. When randomization is performed correctly, differences in efficacy found by statistical comparisons can be attributed to the difference between the treatment and control. However, the RCT does not necessarily provide the final answer to treatment effectiveness, as there are many restrictions that limit generalizability. For example, RCTs are often restricted to patients with limited disease, comorbidity, and concomitant medications. Thus, RCTs generally demonstrate efficacy rather than effectiveness, where efficacy is the treatment effect under the restricted conditions of the RCT and effectiveness is the treatment effect under the conditions of usual practice. Observational, nonrandomized studies have a role when RCTs are not available, and, even when RCTs are available, to quantify effectiveness and other real world experiences. A contemporary example of this is the evaluation of drugeluting stents, for which RCTs have demonstrated shortterm efficacy for relatively healthy patients and observational studies are beginning to address long-term effectiveness and safety problems and use of clopidogrel in a broader array of patients. There are many approaches for making statistical inferences from observational data. Some approaches focus on study design, others on statistical techniques. However, even with the best of designs, observational studies, unlike the RCTs, do not automatically control for selection biases. Therefore, statistical methods involving matching, stratification, and/or covariance adjustment are needed. Lack of randomization in observational studies may result in large differences on the observed (and unobserved) participant characteristics between the treatment and control groups. These differences can lead to biased estimates of treatment effects. The goal of the statistical techniques that focus on observational data is to create an analysis that resembles what would occur had the treatment been randomly assigned. In RCTs, the balance is achieved on participant characteristics that occur before the treatment is administered. The success of randomization in creating balance can be assessed before any outcome measurements are taken. Therefore, in observational studies, the first goal of a statistical technique is to create balance between treatments on characteristics that are assessed before the actual treatment is administered. Once this balance has been achieved, outcome measurements can be ascertained and compared between groups. In practice, this goal is often difficult to achieve because the data available for observational studies usually contain measured patient characteristics that are obtained before, during, and after treatment administration, and it is often difficult to determine exactly which patient characteristics are pretreatment or not. Furthermore, there frequently are unmeasured characteristics that are not available, inadequately measured, or unknown. Thus, the statistical methods in observational studies need first to be judged based on their performance in creating a balance on background characteristics between treated and control groups and the impact of outcome data should play no role in this assessment. To adjust for pretreatment imbalances, 2 statistical approaches often used are analysis of covariance methods and propensity score methods. These 2 methods complement each other and generally should be used together rather than choosing between one or the other. Analysis of covariance refers here to standard statistical analyses that produce estimates of treatment effects adjusted for background characteristics (covariates), which are included explicitly in a statistical (regression) model. With observational studies, this technique can produce biased estimates of treatment effects if there is extreme imbalance of the background characteristics and/or the treatment effect

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1001/jama.297.3.314

Cites

7 of 7 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 7 references

Cited by

See all 350

Metadata

Authors
D’Agostino, R. B.
Venue
JAMA
Published
2007-01-17
Volume
297
Issue
3
Pages
314
ISSN
  • 0002-9955 (ISSN-L)
  • 0098-7484
OpenAlex
W2161330753
Cited by
350
References
7
FWCI
29.13
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Estimating Treatment Effects Using Observational Data. https://app.cochat.ai/papers/10.1001/jama.297.3.314
The paper
D’Agostino, R. B. (2007). Estimating Treatment Effects Using Observational Data. JAMA. https://doi.org/10.1001/jama.297.3.314

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.