Statistics and Causal Inference
The DOI matches its Crossref record; 60 of the 62 references it cites were found in a registry or an index.
Abstract
Problems involving causal inference have dogged at the heels of statistics since its earliest days. Correlation does not imply causation, and yet causal conclusions drawn from a carefully designed experiment are often valid. What can a statistical model say about causation? This question is addressed by using a particular model for causal inference (Holland and Rubin 1983; Rubin 1974) to critique the discussions of other writers on causation and causal inference. These include selected philosophers, medical researchers, statisticians, econometricians, and proponents of causal modeling.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“As is usually the case, due to the fundamental problem of causal inference (Holland, 1986), we only observe one of the two potential outcomes for each unit i .”
From What's trending in difference-in-differences? A synthesis of the recent econometrics literature (2023) · cites this paper as Holland, 1986
In the citing paper
“causal effects can never be observed directly”
From Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable (2014) · cites this paper as Holland 1986
In the citing paper
“In uplift modeling, however, the actual outcome that is estimated is unobserved, and therefore the error made by the model cannot be measured at the individual customer level.”
From Why you should stop predicting customer churn and start using uplift models (2021) · cites this paper as [34]
In the citing paper
“Historical data containing information on observed customer behavior never allows classifying customers in the four groups shown in Table 1, as the net e ↵ ect of treatment cannot be observed for an individual customer due to the fundamental problem of causal inference [34].”
From Why you should stop predicting customer churn and start using uplift models (2021) · cites this paper as [34]
In the citing paper
“Uplift or, in other words, whether a customer is persuadable, a lost cause, do-notdisturb or a sure thing, cannot be observed due to the fundamental problem of causal inference [34].”
From Why you should stop predicting customer churn and start using uplift models (2021) · cites this paper as [34]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Investigating causal relations by econometric models and cross-spectral methods
Granger, C. W. J. (1969) · Econometrica · doi:10.2307/1912791 · Cited by 22,989
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436
The environment and disease: association or causation?
Hill, A. B. (2015) · Journal of the Royal Society of Medicine · doi:10.1177/0141076814562718 · Cited by 7,285
The Environment and Disease: Association or Causation?
Hill, A. B. (1965) · Proceedings of the Royal Society of Medicine · doi:10.1177/003591576505800503 · Cited by 6,974
Journal of The American Statistical Association
Fienberg, S. E. (2005) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess1317 · Cited by 6,125
An Essay concerning Human Understanding
Locke, J. (1690) · The Clarendon Edition of the Works of John Locke: An Essay Concerning Human Understanding · doi:10.1093/oseo/instance.00018020 · Cited by 5,192
Rosenbaum, P. R., & Rubin, D. B. (1985) · The American Statistician · doi:10.2307/2683903 · Cited by 4,774
Reducing Bias in Observational Studies Using Subclassification on the Propensity Score
Rosenbaum, P. R., & Rubin, D. B. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10478078 · Cited by 3,082
Bayesian inference for causal effects: The role of randomization
Rubin, D. B. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344064 · Cited by 2,503 · cited 2×
“This has been done extensively, and the reader is referred to Rubin (1974, 1977, 1978), Rosenbaum (1984a,b,c), Rosenbaum and Rubin (1983a,b, 1984a,b, 1985a,b), and Holland and Rubin (1980, 1983).”
Background
Research works printed but not linked: 5
- 10.1016/B978-0-12-224150-5.50005-8 · doi:10.1016/b978-0-12-224150-5.50005-8
- Hume , D. 1740 . A Treatise on Human Nature
- 10.1080/00031305.1985.10479383 · doi:10.1080/00031305.1985.10479383 · Paper page
- 10.1080/01621459.1980.10477517 · doi:10.1080/01621459.1980.10477517 · Paper page
- Saris , W. and Stronkhorst , H. 1984 . Causal Modelling in Non-experimental Research , Amsterdam : Sociometric Research Foundation .
Cited by
Mediation in experimental and nonexperimental studies: New procedures and recommendations.
Shrout, P. E., & Bolger, N. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.4.422 · Cited by 11,335
Mostly Harmless Econometrics: An Empiricist's Companion
Angrist, J. D., & Pischke, J.-S. (2009) · doi:10.1515/9781400829828 · Cited by 9,467
“Important references developing this idea are Rubin (1974, 1977), and Holland (1986), who refers to a causal framework involving potential outcomes as the Rubin Causal Model.”
BackgroundMoher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883
Vandenbroucke, J. P., von Elm, E., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., Egger, M., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040297 · Cited by 8,613
Difference-in-differences with variation in treatment timing
Goodman-Bacon, A. (2021) · Journal of Econometrics · doi:10.1016/j.jeconom.2021.03.014 · Cited by 8,046
Metadata
- Authors
- Holland, P. W.
- Affiliations
- Educational Testing Service (US)
- Corresponding author
- Holland, Paul W.
- ORCID
- Holland, Paul W.
- Venue
- Journal of the American Statistical Association
- Publisher
- Informa UK Limited
- Published
- 1986-12
- Volume
- 81
- Issue
- 396
- Pages
- 945-960
- ISSN
- 0162-1459 (ISSN-L)
- 1537-274X
- OpenAlex
- W1978108654
- Cited by
- 5,293
- References
- 62
- Citations by year
- 2026: 188 · 2025: 260 · 2024: 246 · 2023: 266 · 2022: 274 · 2021: 323 · 2020: 302 · 2019: 269 · 2018: 259 · 2017: 202 · 2016: 212 · 2015: 229 · 2014: 271 · 2013: 224 · 2012: 187
- FWCI
- 14.28
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of the American Statistical Association (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Philosophy of Biology and Scientific Explanation
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Keywords
- causal inference, causal models, correlation versus causation, randomized experiments, counterfactual reasoning, philosophy of statistics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Statistics and Causal Inference. https://app.cochat.ai/papers/10.1080/01621459.1986.10478354
- The paper
- Holland, P. W. (1986). Statistics and Causal Inference. Journal of the American Statistical Association. https://doi.org/10.1080/01621459.1986.10478354
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.