Estimating causal effects of treatments in randomized and nonrandomized studies
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Presents a discussion of matching, randomization, random sampling, and other methods of controlling extraneous variation. The objective was to specify the benefits of randomization in estimating causal effects of treatments. It is concluded that randomization should be employed whenever possible but that the use of carefully controlled nonrandomized data to estimate causal effects is a reasonable and necessary procedure in many cases.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“That work argues models may memorize variable names but lack knowledge of the underlying observational distributions ( P ( X,Y ) ) required to identify traps like confounding (Rubin, 1974).”
From Diagnosing and Mitigating Sycophancy and Skepticism in LLM Causal Judgment (2026) · cites this paper as Rubin, 1974
In the citing paper
“Specifically, the assumption that a subunit’s own output or outcomes are not affected by any other unit’s implementation assignment (what is called SUTVA (99)) is invalid, as interactions and synergistic effects underlie many of our implementation strategies.”
From An Overview of Research and Evaluation Designs for Dissemination and Implementation (2017) · cites this paper as [99]
Citations
Cites
Statistical Methods for Research Workers
(1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,880
(2001) · Empirical Direction in Design and Analysis · doi:10.4324/9781410600004-24 · Cited by 6,808
SCHEFFE, H. (1960) · Soil Science · doi:10.1097/00010694-196006000-00016 · Cited by 5,516
Testing Statistical Hypotheses
(2021) · Wiley Series in Probability and Statistics · doi:10.1002/9781119243830.ch12 · Cited by 5,106
Design and Analysis of Experiments
(2007) · Modern Engineering Statistics · doi:10.1002/9780470187548.ch12 · Cited by 1,424
Controlling Bias in Observational Studies: A Review
Cochran, W. G. (2006) · Matched Sampling for Causal Effects · doi:10.1017/cbo9780511810725.005 · Cited by 958 · cited 1×
“Recent work on methods of reducing bias in nonrandomized studies is summarized in Cochran and Rubin (1974).”
MethodThe University Group Diabetes Program. A further statistical analysis of the mortality findings
Cornfield, J. (1971) · JAMA · doi:10.1001/jama.217.12.1676 · Cited by 119
University Group Diabetes Program
Smelo, L. S. (1971) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1971.03180260057027 · Cited by 115
Design and Analysis of Industrial Experiments.
E., R. T., & Davies, O. L. (1954) · OR · doi:10.2307/3007149 · Cited by 111
Statistics: A Guide to the Unknown.
Pine, V. R., Tanur, J. M., Mosteller, F. C., Kruskal, W., Link, R. F., Pieters, R. S., & Rising, G. R. (1974) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2062882 · Cited by 89
Cited by
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Self-citationAustin, P. C. (2011) · Multivariate Behavioral Research · doi:10.1080/00273171.2011.568786 · Cited by 12,242
“I first describe the potential outcomes framework, which has also been described as the Rubin Causal Model (Rubin, 1974).”
MethodDifference-in-differences with variation in treatment timing
Goodman-Bacon, A. (2021) · Journal of Econometrics · doi:10.1016/j.jeconom.2021.03.014 · Cited by 8,046
SOME PRACTICAL GUIDANCE FOR THE IMPLEMENTATION OF PROPENSITY SCORE MATCHING
Caliendo, M., & Kopeinig, S. (2008) · Journal of Economic Surveys · doi:10.1111/j.1467-6419.2007.00527.x · Cited by 6,238
“Rubin (1974) , Rosenbaum and Rubin (1983, 1985a) or Lechner (1998).”
MethodInfluentialMacKinnon, D. P., Fairchild, A. J., & Fritz, M. S. (2007) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085542 · Cited by 5,688
Matching Methods for Causal Inference: A Review and a Look Forward
Stuart, E. A. (2010) · Statistical Science · doi:10.1214/09-sts313 · Cited by 5,478
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293
Recent Developments in the Econometrics of Program Evaluation
Imbens, G. W., & Wooldridge, J. M. (2009) · Journal of Economic Literature · doi:10.1257/jel.47.1.5 · Cited by 4,926
Edwards, J. R., & Lambert, L. S. (2007) · Psychological Methods · doi:10.1037/1082-989x.12.1.1 · Cited by 4,711
“One useful approach to evaluate causality for models such as those in our framework has been developed by Rubin and colleagues (Holland, 1986, 1988; Little & Rubin, 2000; Rubin, 1974, 1978) and has been called the Rubin causal model (RCM).”
BackgroundMethodInfluentialAustin, P. C., & Stuart, E. A. (2015) · Statistics in Medicine · doi:10.1002/sim.6607 · Cited by 4,495
“The potential outcomes framework assumes that each subject has a pair of potential outcomes: Yi(0) and Yi(1), the outcomes under the control treatment and the active treatment, respectively, when received under identical circumstances [12].”
BackgroundIdentification of Causal Effects Using Instrumental Variables
Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476902 · Cited by 4,230
Self-citationMatching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference
Ho, D. E., Imai, K., King, G., & Stuart, E. A. (2007) · Political Analysis · doi:10.1093/pan/mpl013 · Cited by 4,205
Equivalence of the Mediation, Confounding and Suppression Effect
MacKinnon, D. P., Krull, J. L., & Lockwood, C. M. (2000) · Prevention Science · doi:10.1023/a:1026595011371 · Cited by 4,188
“Holland (1988) and Robins and Greenland (1992) have proposed several alternatives to establishing mediation and confounding based on Rubin’s causal model (Rubin, 1974) and related methods.”
BackgroundRegression discontinuity designs: A guide to practice
Imbens, G. W., & Lemieux, T. (2008) · Journal of Econometrics · doi:10.1016/j.jeconom.2007.05.001 · Cited by 3,694
Using Big Data to Emulate a Target Trial When a Randomized Trial Is Not Available: Table 1.
Hernán, M. A., & Robins, J. M. (2016) · American Journal of Epidemiology · doi:10.1093/aje/kwv254 · Cited by 3,115
“This framework channels the existing counterfactual theory for comparing the effects of point treatments (3) and sustained treatment strategies (4–6), organizes analytic approaches dispersed throughout the literature, provides a structured process for the criticism of observational studies, and helps avoid common meth…”
BackgroundThe Economics and Econometrics of Active Labor Market Programs
Heckman, J. J., Lalonde, R. J., & Smith, J. A. (1999) · Handbook of Labor Economics · doi:10.1016/s1573-4463(99)03012-6 · Cited by 3,059
Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review
Imbens, G. W. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023651 · Cited by 2,994
Estimation and Inference of Heterogeneous Treatment Effects using Random Forests
Wager, S., & Athey, S. (2018) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1319839 · Cited by 2,917
Statistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791
“72 The crucial idea is to set up the causal inference problem as one of missing data, as defined in Rubin’s (1976) article, where the missing data are the values of the potential outcomes under the treatment not received and the observed data include the values of the potential outcomes under the received treatments.”
BackgroundEstimation of Average Treatment Effects Based on Propensity Scores
Becker, S. O., & Ichino, A. (2002) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0200200403 · Cited by 2,754
Social norms and energy conservation
Allcott, H. (2011) · Journal of Public Economics · doi:10.1016/j.jpubeco.2011.03.003 · Cited by 2,802
“Nearly all are within the confidence intervals of the small sample pilots by Schultz et al. (2007) and Nolan et al.”
BackgroundBayesian inference for causal effects: The role of randomization
Rubin, D. B. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344064 · Cited by 2,503
Self-citationOn making causal claims: A review and recommendations
Antonakis, J., Bendahan, S., Jacquart, P., & Lalive, R. (2010) · The Leadership Quarterly · doi:10.1016/j.leaqua.2010.10.010 · Cited by 2,441
“To test whether a causal relation is real, the model's predictions must be examined from the counterfactual model (Morgan & Winship, 2007; Rubin, 1974;Winship &Morgan, 1999).”
BackgroundAngrist, J. D., & Krueger, A. B. (2001) · Journal of Economic Perspectives · doi:10.1257/jep.15.4.69 · Cited by 2,355
Causal inference in statistics: An overview
Pearl, J. (2009) · Statistics Surveys · doi:10.1214/09-ss057 · Cited by 2,336
“…equation models (SEM) used in economics and social science (Goldberger, 1973; Duncan, 1975), the potentialoutcome framework of Neyman (1923) and Rubin (1974), and the graphical models developed for probabilistic reasoning and causal analysis (Pearl, 1988; Lauritzen, 1996; Spirtes et al., 2000;…”
BackgroundMethodInfluentialCausal effects in nonexperimental studies: Reevaluating the evaluation of training programs
Dehejia, R. H., & Wahba, S. (1999) · Journal of the American Statistical Association · doi:10.1080/01621459.1999.10473858 · Cited by 2,395
Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score
Hirano, K., Imbens, G. W., & Ridder, G. (2003) · Econometrica · doi:10.1111/1468-0262.00442 · Cited by 2,355
“3 Implicit in this notation is the stability assumption or SUTVA (Rubin (1978)) that units are not affected by receipt of treatment by others, and that there is only one version of the treatment.”
InfluentialCausal diagrams for empirical research
PEARL, J. (1995) · Biometrika · doi:10.1093/biomet/82.4.669 · Cited by 2,355
“In contrast to conditional probabilities, structural equa-tions communicate stable counterfactual information, thus forming a clear correspon-dence between causal diagrams and Rubin's model of potential response [Rubin 1974,Holland 88].”
Semiparametric Difference-in-Differences Estimators
Abadie, A. (2005) · The Review of Economic Studies · doi:10.1111/0034-6527.00321 · Cited by 2,286
Opportunities and obstacles for deep learning in biology and medicine
Ching, T., Himmelstein, D. S., Beaulieu-Jones, B. K., Kalinin, A. A., Do, B. T., Way, G. P., Ferrero, E., Agapow, P.-M., Zietz, M., Hoffman, M. M., et al. (2018) · Journal of The Royal Society Interface · doi:10.1098/rsif.2017.0387 · Cited by 2,310
“Causal inference is often framed in terms of counterfactual question [267].”
BackgroundCausal Inference Using Potential Outcomes: Design, Modeling, Decisions
Rubin, D. B. (2005) · Journal of the American Statistical Association · doi:10.1198/016214504000001880 · Cited by 2,173
“…in the preceding Fisher (1918) quotation and in many other places, such as the economics literature (e.g., Haavelmo 1943; Tinbergen 1930; Hurwicz 1962), I can find no explicit use of that notation to describe causal effects in nonrandomized studies until a half century later (in Rubin 1974).”
BackgroundSelf-citationOptimal Bandwidth Choice for the Regression Discontinuity Estimator
Imbens, G., & Kalyanaraman, K. (2012) · The Review of Economic Studies · doi:10.1093/restud/rdr043 · Cited by 2,126
What's trending in difference-in-differences? A synthesis of the recent econometrics literature
Roth, J., Sant’Anna, P. H. C., Bilinski, A., & Poe, J. (2023) · Journal of Econometrics · doi:10.1016/j.jeconom.2023.03.008 · Cited by 2,027
“We adopt a potential outcomes framework for the observed outcome, as in, e.g., Rubin (1974) and Robins (1986).”
Method(2009) · Cited by 2,013
Hainmueller, J., Hopkins, D. J., & Yamamoto, T. (2014) · Political Analysis · doi:10.1093/pan/mpt024 · Cited by 1,990
“In this study, we use the potential outcomes framework of causal inference (Neyman 1923; Rubin 1974) to formally analyze the causal properties of conjoint analysis.”
Athey, S., Tibshirani, J., & Wager, S. (2019) · The Annals of Statistics · doi:10.1214/18-aos1709 · Cited by 1,870
Measuring the impact of COVID-19 vaccine misinformation on vaccination intent in the UK and USA
Loomba, S., de Figueiredo, A., Piatek, S. J., de Graaf, K., & Larson, H. J. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01056-1 · Cited by 1,800
Endogeneity in Empirical Corporate Finance1
Roberts, M. R., & Whited, T. M. (2013) · Handbook of the Economics of Finance · doi:10.1016/b978-0-44-453594-8.00007-0 · Cited by 2,459
Kraemer, H. C., Stice, E., Kazdin, A., Offord, D., & Kupfer, D. (2001) · American Journal of Psychiatry · doi:10.1176/appi.ajp.158.6.848 · Cited by 1,712
Why Propensity Scores Should Not Be Used for Matching
King, G., & Nielsen, R. (2019) · Political Analysis · doi:10.1017/pan.2019.11 · Cited by 1,706
Lunceford, J. K., & Davidian, M. (2004) · Statistics in Medicine · doi:10.1002/sim.1903 · Cited by 1,674
Empirical Strategies in Labor Economics
Angrist, J. D., & Krueger, A. B. (1999) · Handbook of Labor Economics · doi:10.1016/s1573-4463(99)03004-7 · Cited by 1,628
Recursive partitioning for heterogeneous causal effects
Athey, S., & Imbens, G. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1510489113 · Cited by 1,586
Big Data: New Tricks for Econometrics
Varian, H. R. (2014) · Journal of Economic Perspectives · doi:10.1257/jep.28.2.3 · Cited by 1,557
Sekhon, J. S. (2011) · Journal of Statistical Software · doi:10.18637/jss.v042.i07 · Cited by 1,543
“The Rubin causal model conceptualizes causal inference in terms of potential outcomes under treatment and control, only one of which is observed for each unit (Holland 1986; SplawaNeyman 1923; Rubin 1974, 1978, 1990).”
IMAI, K., KEELE, L., TINGLEY, D., & YAMAMOTO, T. (2011) · American Political Science Review · doi:10.1017/s0003055411000414 · Cited by 1,537
Principal Stratification in Causal Inference
Frangakis, C. E., & Rubin, D. B. (2002) · Biometrics · doi:10.1111/j.0006-341x.2002.00021.x · Cited by 1,511
“…be a comparison between the ordered sets of potential outcomes on a common set of units, e.g., a comparison between ( " $ # ) £ 1 0 2 4 3 set5 ' 6 and ( " $ # 7 ¦ 8 0 2 9 3 set@ A 6 ¥ (2 § 1) given the groups of units, set5 and set@ , being compared are identical (Neyman, 1923, Rubin, 1974, 1978).”
Self-citationThe Online Laboratory: Conducting Experiments in a Real Labor Market∗Preprint
Zeckhauser, R. J. (2016) · Cited by 1,530
Using Synthetic Controls: Feasibility, Data Requirements, and Methodological Aspects
Abadie, A. (2021) · Journal of Economic Literature · doi:10.1257/jel.20191450 · Cited by 1,486
“4 Y 1t I and Y jt N are the potential outcomes of Rubin’s model for causal inference (see, e.g., Rubin 1974, Holland 1986).”
BackgroundA tutorial on propensity score estimation for multiple treatments using generalized boosted models
McCaffrey, D. F., Griffin, B. A., Almirall, D., Slaughter, M. E., Ramchand, R., & Burgette, L. F. (2013) · Statistics in Medicine · doi:10.1002/sim.5753 · Cited by 1,450
“Following the potential outcomes approach for causal inference [25, 26], every youth in the population has a potential outcome that will result if he or she receives services from each of the three alternative treatment programs.”
BackgroundAustin, P. C. (2014) · Statistics in Medicine · doi:10.1002/sim.5984 · Cited by 1,422
“In a setting with two possible treatments, the potential outcomes framework assumes that each subject has a pair of potential outcomes: Yi (0) and Yi (1), the outcomes under the control and the active treatment, respectively [12].”
BackgroundBias-Corrected Matching Estimators for Average Treatment Effects
Abadie, A., & Imbens, G. W. (2011) · Journal of Business & Economic Statistics · doi:10.1198/jbes.2009.07333 · Cited by 1,416
“The purpose of this article is to investigate the properties of estimators that combine matching with a bias correction proposed in Rubin (1973) and Quade (1982), and derive the large sample properties of a nonparametric extension of the biascorrected estimator.”
MethodMaxwell, S. E., Cole, D. A., & Mitchell, M. A. (2011) · Multivariate Behavioral Research · doi:10.1080/00273171.2011.606716 · Cited by 1,338
“In particular, Rubin’s causal model (Rubin, 1974; see also Shadish, 2010; West & Thoemmes, 2010) provides an alternative framework that has led to valuable insights about alternative approaches for studying causation in general and mediation in particular.”
BackgroundAngrist, J. D., & Imbens, G. W. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476535 · Cited by 1,341
Standards of Evidence: Criteria for Efficacy, Effectiveness and Dissemination
Flay, B. R., Biglan, A., Boruch, R. F., Castro, F. G., Gottfredson, D., Kellam, S., Mościcki, E. K., Schinke, S., Valentine, J. C., & Ji, P. (2005) · Prevention Science · doi:10.1007/s11121-005-5553-y · Cited by 1,338
“Otherwise, claims of effectiveness are likely to be biased or untrue and it is necessary to consider competing explanations that could lead to the expected outcome (Bertrand et al., 2002; Holland, 1986; Manski, 1995; Rubin, 1974; Shadish et al., 2002).”
BackgroundOslo Manual 2018: Guidelines for Collecting, Reporting and Using Data on Innovation, 4th Edition
OECD, & Eurostat (2018) · The Measurement of Scientific, Technological and Innovation Activities · doi:10.1787/9789264304604-en · Cited by 1,307
Multilevel Modeling of Individual and Group Level Mediated Effects
Krull, J. L., & MacKinnon, D. P. (2001) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3602_06 · Cited by 1,330
“A detailed study of the underlying causal relationships in multilevel models using Rubin’s causal model (Rubin, 1974) is beyond the scope of this article.”
MethodConcrete Problems in AI Safety
Amodei, D., Olah, C., Steinhardt, J., Christiano, P., Schulman, J., & Mané, D. (2016) · arXiv · doi:10.48550/arxiv.1606.06565 · Cited by 1,314
“The first is counterfactual reasoning [106, 129, 117, 30], where one asks “what would have happened if the world were different in a certain way”? In some sense, distributional shift can be thought of as a particular type of counterfactual, and so understanding counterfactual reasoning is likely to help in making syst…”
BackgroundCorrecting for Endogeneity in Strategic Management Research
Hamilton, B. H., & Nickerson, J. A. (2003) · Strategic Organization · doi:10.1177/1476127003001001218 · Cited by 1,309
“Studies such as Wooldridge (1995, 2002), Vella and Verbeek (1998), and Dustmann and Rochina-Barrachina (2000) describe how to construct selection-correction terms for the panel data selection model, while studies such as Chib and Hamilton (2000, 2001) describe simulation-based econometric approaches.”
MethodKang, J. D. Y., & Schafer, J. L. (2007) · Statistical Science · doi:10.1214/07-sts227 · Cited by 797
“The notion of potential outcomes was introduced by Neyman (1923) for randomized experiments and by Rubin (1974a) for nonrandomized studies.”
Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable
Elwert, F., & Winship, C. (2014) · Annual Review of Sociology · doi:10.1146/annurev-soc-071913-043455 · Cited by 1,168
Tests of the three-path mediated effect
Taylor, A. B., MacKinnon, D. P., & Tein, J.-Y. (2008) · Organizational Research Methods · doi:10.1177/1094428107300344 · Cited by 1,209
Using Randomization in Development Economics Research: A Toolkit
Duflo, E., Glennerster, R., & Kremer, M. (2006) · National Bureau of Economic Research · doi:10.3386/t0333 · Cited by 1,191
Assignment to Treatment Group on the Basis of a Covariate
Rubin, D. B. (1977) · Journal of Educational Statistics · doi:10.3102/10769986002001001 · Cited by 1,155
Self-citationInterpersonal expectancy effects: the first 345 studies
Rosenthal, R., & Rubin, D. B. (1978) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00075506 · Cited by 1,158
Self-citationDiamond, A., & Sekhon, J. S. (2013) · Review of Economics and Statistics · doi:10.1162/rest_a_00318 · Cited by 1,102
Correlation and Simple Linear Regression
Zou, K. H., Tuncali, K., & Silverman, S. G. (2003) · Radiology · doi:10.1148/radiol.2273011499 · Cited by 1,086
Identification and Inference in Nonlinear Difference-in-Differences Models
Athey, S., & Imbens, G. W. (2006) · Econometrica · doi:10.1111/j.1468-0262.2006.00668.x · Cited by 1,084
Uggen, C. (2000) · American Sociological Review · doi:10.1177/000312240006500403 · Cited by 1,079
Thinking Clearly About Correlations and Causation: Graphical Causal Models for Observational Data
Rohrer, J. M. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245917745629 · Cited by 1,002
“A solid rule of thumb is that researchers should not control for such posttreatment variables (Rosenbaum, 1984; Rubin, 1974).”
BackgroundThe Propensity Score with Continuous Treatments
Hirano, K., & Imbens, G. W. (2004) · Wiley Series in Probability and Statistics · doi:10.1002/0470090456.ch7 · Cited by 1,064
Metalearners for estimating heterogeneous treatment effects using machine learning
Künzel, S. R., Sekhon, J. S., Bickel, P. J., & Yu, B. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1804597116 · Cited by 1,056
“Framework and Definitions We use the Neyman–Rubin potential outcome framework (11, 12) and assume a superpopulation or distribution P from which a realization of N independent random variables is given as the training data.”
MethodAn Evaluation of the Swedish System of Active Labor Market Programs in the 1990s
Sianesi, B. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023723 · Cited by 1,053
“For the potentialoutcome framework, the main references are Fisher (1935), Neyman (1935), Rubin (1974), Roy (1951), and Quandt (1972).”
MethodInvited Commentary: Propensity Scores
Joffe, M. M., & Rosenbaum, P. R. (1999) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a010011 · Cited by 1,048
Rubin, D. B. (2007) · Statistics in Medicine · doi:10.1002/sim.2739 · Cited by 1,047
“But evidently this notation was not formally extended to non-randomized settings until 1974 by Rubin [3], as discussed in [10, 11, 13, 14].”
BackgroundSelf-citationImpact of a Confounding Variable on a Regression Coefficient
FRANK, K. A. (2000) · Sociological Methods & Research · doi:10.1177/0049124100029002001 · Cited by 1,032
Pearl, J. (2022) · Probabilistic and Causal Inference · doi:10.1145/3501714.3501736 · Cited by 1,033
“The subscripted notation Yx is borrowed from the potential-outcome framework of Rubin (1974).”
MethodEstimating causal effects from epidemiological data
Hernán, M. A., & Robins, J. M. (2006) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2004.029496 · Cited by 1,028
Dealing with limited overlap in estimation of average treatment effects
Crump, R. K., Hotz, V. J., Imbens, G. W., & Mitnik, O. A. (2009) · Biometrika · doi:10.1093/biomet/asn055 · Cited by 1,007
“Using the potential outcome notation popularized by Rubin (1974), let Yi(0) denote the outcome for unit i under control and Yi(1) the outcome under treatment.”
InfluentialResources, Instruction, and Research
Cohen, D. K., Raudenbush, S. W., & Ball, D. L. (2003) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737025002119 · Cited by 983
Inferring causation from time series in Earth system sciences
Runge, J., Bathiany, S., Bollt, E., Camps-Valls, G., Coumou, D., Deyle, E., Glymour, C., Kretschmer, M., Mahecha, M. D., Muñoz-Marí, J., et al. (2019) · Nature Communications · doi:10.1038/s41467-019-10105-3 · Cited by 984
“Importantly, in the past few decades the works of Pearl, Spirtes, Glymour, Scheines, and Rubin 3,4,12,35 have grounded causal reasoning and inference as a rigorous mathematical framework, elucidating the conditions under which discovering causal graphical models, also called Bayesian networks 36 ,…”
BackgroundBalancing Covariates via Propensity Score Weighting
Li, F., Morgan, K. L., & Zaslavsky, A. M. (2018) · Journal of the American Statistical Association · doi:10.1080/01621459.2016.1260466 · Cited by 962
“(1) For causal comparisons, we adopt the potential outcome framework (Rubin 1974, 1978; Imbens and Rubin 2015).”
MethodDetecting and quantifying causal associations in large nonlinear time series datasets
Runge, J., Nowack, P., Kretschmer, M., Flaxman, S., & Sejdinovic, D. (2019) · Science Advances · doi:10.1126/sciadv.aau4996 · Cited by 979
An introduction to inverse probability of treatment weighting in observational research
Chesnaye, N. C., Stel, V. S., Tripepi, G., Dekker, F. W., Fu, E. L., Zoccali, C., & Jager, K. J. (2022) · Clinical Kidney Journal · doi:10.1093/ckj/sfab158 · Cited by 951
“Treatment effects obtained using IPTW may be interpreted as causal under the following assumptions: exchangeability, no misspecification of the propensity score model, positivity and consistency [30].”
MethodInferring causal impact using Bayesian structural time-series models
Brodersen, K. H., Gallusser, F., Koehler, J., Remy, N., & Scott, S. L. (2015) · The Annals of Applied Statistics · doi:10.1214/14-aoas788 · Cited by 961
Confounding and Collapsibility in Causal Inference
Greenland, S., Pearl, J., & Robins, J. M. (1999) · Statistical Science · doi:10.1214/ss/1009211805 · Cited by 933
Design-based analysis in Difference-In-Differences settings with staggered adoption
Athey, S., & Imbens, G. W. (2022) · Journal of Econometrics · doi:10.1016/j.jeconom.2020.10.012 · Cited by 917
Generalized Synthetic Control Method: Causal Inference with Interactive Fixed Effects Models
Xu, Y. (2017) · Political Analysis · doi:10.1017/pan.2016.2 · Cited by 938
Arjovsky, M., Bottou, L., Gulrajani, I., & Lopez-Paz, D. (2019) · arXiv · doi:10.48550/arxiv.1907.02893 · Cited by 927
“Rubin’s ignorability [44] plays the same role.”
Semiparametric instrumental variable estimation of treatment response models
Abadie, A. (2003) · Journal of Econometrics · doi:10.1016/s0304-4076(02)00201-4 · Cited by 901
“As in Rubin (1974, 1977), we deÿne Y 1 and Y 0 as the potential outcomes that an individual would attain with and without being exposed to the treatment.”
BackgroundFrom Violence to Voting: War and Political Participation in Uganda
BLATTMAN, C. (2009) · American Political Science Review · doi:10.1017/s0003055409090212 · Cited by 898
THE ESTIMATION OF CAUSAL EFFECTS FROM OBSERVATIONAL DATA
Winship, C., & Morgan, S. L. (1999) · Annual Review of Sociology · doi:10.1146/annurev.soc.25.1.659 · Cited by 890
Parental involvement on student academic achievement: A meta-analysis
Castro, M., Expósito-Casas, E., López-Martín, E., Lizasoain, L., Navarro-Asencio, E., & Gaviria, J. L. (2015) · Educational Research Review · doi:10.1016/j.edurev.2015.01.002 · Cited by 983
“Any causal relation is counterfactual (Holland, 1986; Rubin, 1974, 2005; West & Thoemmes, 2010), and the observed data do not necessarily reflect the actual causal chain, because each observed datum is just the observed part of the whole causal relationship.”
BackgroundChief Executive Officer Equity Incentives and Accounting Irregularities
ARMSTRONG, C. S., JAGOLINZER, A. D., & LARCKER, D. F. (2010) · Journal of Accounting Research · doi:10.1111/j.1475-679x.2009.00361.x · Cited by 875
Supervised Machine Learning: A Brief Primer
Jiang, T., Gradus, J. L., & Rosellini, A. J. (2020) · Behavior Therapy · doi:10.1016/j.beth.2020.05.002 · Cited by 847
“Causal inference methods have existed for decades (Rubin, 1974), but the integration of supervised learning methods is more recent.”
BackgroundRegression Discontinuity Designs: A Guide to Practice
Imbens, G., & Lemieux, T. (2007) · National Bureau of Economic Research · doi:10.3386/w13039 · Cited by 853
Angrist, J. D. (2001) · Journal of Business & Economic Statistics · doi:10.1198/07350010152472571 · Cited by 846
“This approach to causal inference goes back at least to R. A. Fisher, but the modern version is usually attributed to Rubin (1974, 1977).”
BackgroundLongitudinal and Panel Data: Analysis and Applications in the Social Sciences
Frees, E. W. (2004) · Cambridge University Press eBooks · doi:10.1017/cbo9780511790928 · Cited by 839
For objective causal inference, design trumps analysis
Rubin, D. B. (2008) · The Annals of Applied Statistics · doi:10.1214/08-aoas187 · Cited by 831
“But evidently this notation was not formally extended to nonrandomized settings until Rubin (1974), as discussed in Rubin (1990a, 2005) and Imbens and Rubin (2008a, 2008b).”
BackgroundMethodInfluentialSelf-citationEstimating and testing mediation and moderation in within-subject designs.
Judd, C. M., Kenny, D. A., & McClelland, G. H. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.2.115 · Cited by 846
“Accordingly, following the model of causal inference developed by Rubin (1974) (1978) and Holland (1986, 1988; see also West, Biesanz, & Pitts, 2000), we assume both temporal stability (i.e., the value of an observation does not depend on when the treatment is delivered) and causal transience…”
BackgroundMethod
Metadata
- Authors
- Rubin, D. B.
- Affiliations
- Educational Testing Service (US)
- Corresponding author
- Rubin, Donald B.
- ORCID
- Rubin, Donald B.
- Venue
- Journal of Educational Psychology
- Published
- 1974-10
- Volume
- 66
- Issue
- 5
- Pages
- 688-701
- ISSN
- 0022-0663 (ISSN-L)
- 1939-2176
- OpenAlex
- W2132917208
- Cited by
- 9,436
- References
- 10
- Citations by year
- 2026: 490 · 2025: 658 · 2024: 612 · 2023: 587 · 2022: 589 · 2021: 636 · 2020: 625 · 2019: 554 · 2018: 493 · 2017: 389 · 2016: 370 · 2015: 382 · 2014: 406 · 2013: 343 · 2012: 325
- FWCI
- 2.83
- Type
- journal article
- Language
- en
- Open access
- green
- nrs.harvard.edu
- Licence
- cc-by
- Locations
- Journal of Educational Psychology (publishedVersion)
- Digital Access to Scholarship at Harvard (DASH) (Harvard University) (submittedVersion, cc-by)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Education › Educational Research and Methods
- Keywords
- causal effect estimation, randomization, non-randomized studies, matching, random sampling, treatment effects, observational studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.