From Sample Average Treatment Effect to Population Average Treatment Effect on the Treated: Combining Experimental with Observational Studies to Estimate Population Treatment Effects
Open accessThe DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Summary: Randomized controlled trials (RCTs) can provide unbiased estimates of sample average treatment effects. However, a common concern is that RCTs may fail to provide unbiased estimates of population average treatment effects. We derive the assumptions that are required to identify population average treatment effects from RCTs. We provide placebo tests, which formally follow from the identifying assumptions and can assess whether they hold. We offer new research designs for estimating population effects that use non-randomized studies to adjust the RCT data. This approach is considered in a cost-effectiveness analysis of a clinical intervention: pulmonary artery catheterization.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Large Sample Properties of Generalized Method of Moments Estimators
Hansen, L. P. (1982) · Econometrica · doi:10.2307/1912775 · Cited by 13,467
Information theory and statistical mechanics
Jaynes, E. T. (1957) · Physical Review · doi:10.1103/physrev.106.620 · Cited by 12,931
Social norms and energy conservation
Allcott, H. (2011) · Journal of Public Economics · doi:10.1016/j.jpubeco.2011.03.003 · Cited by 2,802 · cited 2×
“Allcott (2011) showed that in their setting non-experimental estimates have poor external validity, and that is worse than when nonexperimental effects are predicted by using experimental results from another location.”
BackgroundExternal validity of randomised controlled trials: “To whom do the results of this trial apply?”
Rothwell, P. M. (2005) · The Lancet · doi:10.1016/s0140-6736(04)17670-8 · Cited by 2,544 · cited 3×
“However, despite the pragmatic nature of the RCT, commentators suggested that the patients and centres differed from those where PAC was used in routine clinical practice (Sakr et al., 2005).”
BackgroundCharacterizing Selection Bias Using Experimental Data
Heckman, J., Ichimura, H., Smith, J., & Todd, P. (1998) · Econometrica · doi:10.2307/2999630 · Cited by 2,286
Structural Equations, Treatment Effects, and Econometric Policy Evaluation1
Heckman, J. J., & Vytlacil, E. (2005) · Econometrica · doi:10.1111/j.1468-0262.2005.00594.x · Cited by 1,220
Testing Statistical Hypotheses of Equivalence and Noninferiority
Wellek, S. (2010) · doi:10.1201/ebk1439808184 · Cited by 548 · cited 1×
“We follow the recommendations of Hartman and Hidalgo (2011) and define equivalence as a mean difference between the reweighted sample treated and the true population treated of no more than 0.2 standardized differences and use the t-test for equivalence that is defined in Wellek (2010).”
MethodInfluentialMultiple-bias modelling for analysis of observational data
Greenland, S. (2005) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/j.1467-985x.2004.00349.x · Cited by 497
Cited by
Coppock, A., & McClellan, O. A. (2019) · Research & Politics · doi:10.1177/2053168018822174 · Cited by 987
Generalizability of heterogeneous treatment effect estimates across samples
Coppock, A., Leeper, T. J., & Mullinix, K. J. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1808083115 · Cited by 445
Methods for Population-Adjusted Indirect Comparisons in Health Technology Appraisal
Phillippo, D. M., Ades, A. E., Dias, S., Palmer, S., Abrams, K. R., & Welton, N. J. (2018) · Medical Decision Making · doi:10.1177/0272989x17725740 · Cited by 396
Characterizing treatment pathways at scale using the OHDSI network
Hripcsak, G., Ryan, P. B., Duke, J. D., Shah, N. H., Park, R. W., Huser, V., Suchard, M. A., Schuemie, M. J., DeFalco, F. J., Perotte, A., et al. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1510502113 · Cited by 326
A Review of Generalizability and Transportability
Degtiar, I., & Rose, S. (2023) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-042522-103837 · Cited by 295
Metadata
- Authors
- Hartman, E., Grieve, R., Ramsahai, R., & Sekhon, J. S.
- Venue
- Journal of the Royal Statistical Society Series A: Statistics in Society
- Publisher
- Oxford University Press (OUP)
- Published
- 2015-01-27
- Volume
- 178
- Issue
- 3
- Pages
- 757-778
- ISSN
- 0964-1998 (ISSN-L)
- 1467-985X
- OpenAlex
- W2037577035
- Cited by
- 149
- References
- 14
- FWCI
- 14.31
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: From Sample Average Treatment Effect to Population Average Treatment Effect on the Treated: Combining Experimental with Observational Studies to Estimate Population Treatment Effects. https://app.cochat.ai/papers/10.1111/rssa.12094
- The paper
- Hartman, E., Grieve, R., Ramsahai, R., & Sekhon, J. S. (2015). From Sample Average Treatment Effect to Population Average Treatment Effect on the Treated: Combining Experimental with Observational Studies to Estimate Population Treatment Effects. Journal of the Royal Statistical Society Series A: Statistics in Society. https://doi.org/10.1111/rssa.12094
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.