Estimating causal effects of treatments in randomized and nonrandomized studies
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Presents a discussion of matching, randomization, random sampling, and other methods of controlling extraneous variation. The objective was to specify the benefits of randomization in estimating causal effects of treatments. It is concluded that randomization should be employed whenever possible but that the use of carefully controlled nonrandomized data to estimate causal effects is a reasonable and necessary procedure in many cases.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“That work argues models may memorize variable names but lack knowledge of the underlying observational distributions ( P ( X,Y ) ) required to identify traps like confounding (Rubin, 1974).”
From Diagnosing and Mitigating Sycophancy and Skepticism in LLM Causal Judgment (2026) · cites this paper as Rubin, 1974
In the citing paper
“Specifically, the assumption that a subunit’s own output or outcomes are not affected by any other unit’s implementation assignment (what is called SUTVA (99)) is invalid, as interactions and synergistic effects underlie many of our implementation strategies.”
From An Overview of Research and Evaluation Designs for Dissemination and Implementation (2017) · cites this paper as [99]
Citations
Cites
Statistical Methods for Research Workers
(1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,880
(2001) · Empirical Direction in Design and Analysis · doi:10.4324/9781410600004-24 · Cited by 6,808
SCHEFFE, H. (1960) · Soil Science · doi:10.1097/00010694-196006000-00016 · Cited by 5,516
Testing Statistical Hypotheses
(2021) · Wiley Series in Probability and Statistics · doi:10.1002/9781119243830.ch12 · Cited by 5,106
Design and Analysis of Experiments
(2007) · Modern Engineering Statistics · doi:10.1002/9780470187548.ch12 · Cited by 1,424
Controlling Bias in Observational Studies: A Review
Cochran, W. G. (2006) · Matched Sampling for Causal Effects · doi:10.1017/cbo9780511810725.005 · Cited by 958 · cited 1×
“Recent work on methods of reducing bias in nonrandomized studies is summarized in Cochran and Rubin (1974).”
MethodThe University Group Diabetes Program. A further statistical analysis of the mortality findings
Cornfield, J. (1971) · JAMA · doi:10.1001/jama.217.12.1676 · Cited by 119
University Group Diabetes Program
Smelo, L. S. (1971) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1971.03180260057027 · Cited by 115
Design and Analysis of Industrial Experiments.
E., R. T., & Davies, O. L. (1954) · OR · doi:10.2307/3007149 · Cited by 111
Statistics: A Guide to the Unknown.
Pine, V. R., Tanur, J. M., Mosteller, F. C., Kruskal, W., Link, R. F., Pieters, R. S., & Rising, G. R. (1974) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2062882 · Cited by 89
Cited by
Items 201–300 of 1,074
The Consistency Statement in Causal Inference: A Definition or an Assumption?
Cole, S. R., & Frangakis, C. E. (2009) · Epidemiology · doi:10.1097/ede.0b013e31818ef366 · Cited by 413
“Such variation can be included in the “technical errors” discussed by Rubin.7 So, x could be revised to be less vague, perhaps as the once daily intake of 40 mg buffered aspirin or not.”
BackgroundBuilding Bridges between Structural and Program Evaluation Approaches to Evaluating Policy
Heckman, J. J. (2010) · Journal of Economic Literature · doi:10.1257/jel.48.2.356 · Cited by 410
Reconsidering the Effects of Education on Political Participation
Kam, C. D., & Palmer, C. L. (2008) · The Journal of Politics · doi:10.1017/s0022381608080651 · Cited by 410
Making Americans healthier: social and economic policy as health policy
(2009) · Choice Reviews Online · doi:10.5860/choice.46-5680 · Cited by 409
Experimental Designs for Identifying Causal Mechanisms
Imai, K., Tingley, D., & Yamamoto, T. (2013) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2012.01032.x · Cited by 408
Frank, K. A., Maroulis, S. J., Duong, M. Q., & Kelcey, B. M. (2013) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373713493129 · Cited by 406
“As a foundation, we draw on Rubin’s causal model (RCM; Rubin, 1974) to express concerns about bias in terms of characteristics of unobserved data.”
BackgroundMethodInfluentialHandling drop‐out in longitudinal studies
Hogan, J. W., Roy, J., & Korkontzelou, C. (2004) · Statistics in Medicine · doi:10.1002/sim.1728 · Cited by 404
Alternatives to the Randomized Controlled Trial
West, S. G., Duan, N., Pequegnat, W., Gaist, P., Des Jarlais, D. C., Holtgrave, D., Szapocznik, J., Fishbein, M., Rapkin, B., Clatts, M., et al. (2008) · American Journal of Public Health · doi:10.2105/ajph.2007.124446 · Cited by 403
Causal impact of masks, policies, behavior on early COVID-19 pandemic in the U.S
Chernozhukov, V., Kasahara, H., & Schrimpf, P. (2021) · Journal of Econometrics · doi:10.1016/j.jeconom.2020.09.003 · Cited by 403
Causal Inference in Public Health
Glass, T. A., Goodman, S. N., Hernán, M. A., & Samet, J. M. (2013) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031811-124606 · Cited by 398
“Rubin DB. 1974.”
MethodInfluentialCorrelations Genuine and Spurious in Pearson and Yule
Aldrich, J. (1995) · Statistical Science · doi:10.1214/ss/1177009870 · Cited by 402
Entropy Balancing is Doubly Robust
Zhao, Q., & Percival, D. (2017) · Journal of Causal Inference · doi:10.1515/jci-2016-0010 · Cited by 394
“We follow the potential outcome language due to Neyman (1923); Rubin (1974).”
BackgroundTargeted Maximum Likelihood Estimation for Causal Inference in Observational Studies
Schuler, M. S., & Rose, S. (2017) · American Journal of Epidemiology · doi:10.1093/aje/kww165 · Cited by 399
“Having exposure groups that are similar with respect to baseline characteristics facilitates estimation of parameters defined in terms of these potential outcomes; indeed, randomization is designed to create comparable exposure groups (16).”
BackgroundInfluentialPayday lenders: Heroes or villains?
Morse, A. (2011) · Journal of Financial Economics · doi:10.1016/j.jfineco.2011.03.022 · Cited by 386
Maldonado, G. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.2.422 · Cited by 399
External validity: From do-calculus to transportability across populations
Pearl, J., & Bareinboim, E. (2013) · Cited by 398
Swedberg, R. (2020) · The Production of Knowledge · doi:10.1017/9781108762519.002 · Cited by 293
Learning Representations for Counterfactual Inference
Johansson, F. D., Shalit, U., & Sontag, D. (2016) · arXiv · doi:10.48550/arxiv.1605.03661 · Cited by 396
“The model described above is known as the Rubin-Neyman causal model (Rubin, 1974; 2011).”
BackgroundMethodChange from baseline and analysis of covariance revisited
Senn, S. (2006) · Statistics in Medicine · doi:10.1002/sim.2682 · Cited by 386
“One possible way is in terms of the Rubin causal model [18].”
BackgroundInfluentialConfounding in Health Research
Greenland, S., & Morgenstern, H. (2001) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.22.1.189 · Cited by 388
Zhao, Z. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023705 · Cited by 389
Frangakis, C. (1999) · Biometrika · doi:10.1093/biomet/86.2.365 · Cited by 387
“In order to address better the diVerent sources of missing information in this problem, we first define potential outcomes separately from a sampling scheme or probabilistic assignment mechanism, an approach dating back to Neyman (1923) in the context of perfect randomised trials, formalised and extended to nonrandomi…”
MethodImai, K., & Yamamoto, T. (2013) · Political Analysis · doi:10.1093/pan/mps040 · Cited by 386
“Under the formal statistical framework of causal inference (Neyman 1923; Rubin 1974; Holland 1986), we write Mi(t) to represent the potential mediator value under the treatment status t¼ 0, 1, where the observed value Mi equals the potential value of the mediator under the observed treatment status…”
MethodThe Online Laboratory: Conducting Experiments in a Real Labor Market
Horton, J., Rand, D., & Zeckhauser, R. (2010) · National Bureau of Economic Research · doi:10.3386/w15961 · Cited by 388
The Housing Market Impacts of Shale Gas Development
Muehlenbachs, L., Spiller, E., & Timmins, C. (2015) · American Economic Review · doi:10.1257/aer.20140079 · Cited by 386
Policy Learning With Observational Data
Athey, S., & Wager, S. (2021) · Econometrica · doi:10.3982/ecta15732 · Cited by 372
“We define the causal effect of the intervention π ( · ) in terms of the potential outcomes model (Neyman, 1923; Rubin, 1974), whereby the { Y i ( w ) } correspond to utilities we would have observed for the i -th sample had the treatment been set to W i = w , and When instruments are present, we…”
MethodMakate, C., Makate, M., Mango, N., & Siziba, S. (2019) · Journal of Environmental Management · doi:10.1016/j.jenvman.2018.10.069 · Cited by 380
Life satisfaction and self-employment: a matching approach
Binder, M., & Coad, A. (2013) · Small Business Economics · doi:10.1007/s11187-011-9413-9 · Cited by 375
“We here understand “causal effect” as defined by Rubin (1974), viz.”
BackgroundAngrist, J. D., Graddy, K., & Imbens, G. W. (2000) · Review of Economic Studies · doi:10.1111/1467-937x.00141 · Cited by 371
Overstated carbon emission reductions from voluntary REDD+ projects in the Brazilian Amazon
West, T. A. P., Börner, J., Sills, E. O., & Kontoleon, A. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2004334117 · Cited by 372
“Rigorous impact evaluations rely on the establishment of credible counterfactuals for what would have happened in the absence of an intervention (48, 49), which are unobservable.”
BackgroundInterference Between Units in Randomized Experiments
Rosenbaum, P. R. (2007) · Journal of the American Statistical Association · doi:10.1198/016214506000001112 · Cited by 371
“” Rubin (1986) called this the “stable unit-treatment value”
BackgroundInfluentialLONG-RUN EFFECTS OF PUBLIC SECTOR SPONSORED TRAINING IN WEST GERMANY
Lechner, M., Miquel, R., & Wunsch, C. (2011) · Journal of the European Economic Association · doi:10.1111/j.1542-4774.2011.01029.x · Cited by 371
“This model is based on the binary potential outcome model (Fischer, 1935, Neyman, 1923, Roy, 1951; Rubin, 1974, 1977) extended by Imbens (2000) and Lechner (2001) to multiple, mutually exclusive states.”
BackgroundMethodHeckman, J. J., & Vytlacil, E. J. (2007) · Handbook of Econometrics · doi:10.1016/s1573-4412(07)06071-0 · Cited by 369
“In this case, the analysis of Rosenbaum and Rubin (1983) tells us that knowledge of (Z, f1, f2) and knowledge of P(Z, f1, f2) are equally useful in identifying all of the treatment parameters conditional on P .”
BackgroundMethodInfluentialLechner, M. (2002) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/1467-985x.0asp2 · Cited by 369
“This model is known as the Roy (1951) and Rubin (1974) model of potential outcomes and causal e ects (see Holland (1986) for an extensive discussion of concepts of causality in statistics, econometrics and other ®elds).”
MethodEarnings and Employment Effects of Continuous Gff-the-Job Training in East Germany After Unification
Lechner, M. (1999) · Journal of Business & Economic Statistics · doi:10.1080/07350015.1999.10524798 · Cited by 368
“The framework that will serve as guideline for the empirical analysis is the potential-outcome approach to causality (i.e. Rubin, 1974).”
BackgroundMethodModeling User Exposure in Recommendation
Liang, D., Charlin, L., McInerney, J., & Blei, D. M. (2016) · Proceedings of the 25th International Conference on World Wide Web · doi:10.1145/2872427.2883090 · Cited by 362
“We establish a connection with the potential outcome framework of Rubin [26].”
MethodKang, J., & Schafer, J. L. (2007) · Statistical Science · Cited by 510
A Survey of Learning Causality with Data: Problems and Methods
Guo, R., Cheng, L., Li, J., Hahn, P. R., & Liu, H. (2021) · ACM Computing Surveys · doi:10.1145/3397269 · Cited by 362
“The potential outcome framework [108, 131] is widely used by practitioners to learn causal effects as it is defined w.”
BackgroundMethodThe Causal Foundations of Structural Equation Modeling
Pearl, J. (2012) · doi:10.21236/ada557445 · Cited by 344
“5 Relations to the Potential Outcome Framework Definition 2 constitutes the bridge between SEM and a framework called “potential outcome” (Rubin, 1974) which is often presented as a “more principled alternative” to SEM (Holland, 1988; Rubin, 2004; Wilkinson et al.”
BackgroundEmsley, R., Dunn, G., & White, I. R. (2010) · Statistical Methods in Medical Research · doi:10.1177/0962280209105014 · Cited by 356
TEMPORAL AND SPATIAL VARIATION IN ENVIRONMENTAL IMPACT ASSESSMENT
Stewart-Oaten, A., & Bence, J. R. (2001) · Ecological Monographs · doi:10.1890/0012-9615(2001)071[0305:tasvie]2.0.co;2 · Cited by 355
On doing relevant and rigorous experiments: Review and recommendations
Lonati, S., Quiroga, B. F., Zehnder, C., & Antonakis, J. (2018) · Journal of Operations Management · doi:10.1016/j.jom.2018.10.003 · Cited by 354
“We hope these methods will receive more attention in the near future, because they allow for solid causal claims on the basis of a rigorous quantitative framework using the counterfactual logic (Rubin, 1974).”
BackgroundMethodRerandomization to improve covariate balance in experiments
Morgan, K. L., & Rubin, D. B. (2012) · The Annals of Statistics · doi:10.1214/12-aos1008 · Cited by 353
“In this section, we assume the Stable Unit Treatment Value Assumption (SUTVA) [Rubin (1980)]: the potential outcomes are fixed and do not change with different possible assignment vectors W.”
InfluentialSelf-citationCausal inference in disease ecology: investigating ecological drivers of disease emergence
Plowright, R. K., Sokolow, S. H., Gorman, M. E., Daszak, P., & Foley, J. E. (2008) · Frontiers in Ecology and the Environment · doi:10.1890/070086 · Cited by 354
“Rubin DB. 1974.”
On class differentials in educational attainment
Erikson, R., Goldthorpe, J. H., Jackson, M., Yaish, M., & Cox, D. R. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0502433102 · Cited by 349
Causal Inference without Counterfactuals
Dawid, A. P. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10474210 · Cited by 347
“Heckerman and Shachter (1995), for example, take a lead in this from Savage (1954), who based his axiomatic account of Bayesian decision theory on the supposed existence of a “state of nature,” entirely unaffected by any decisions taken, which, together with those decisions, determines all variables.”
BackgroundInfluentialMediation analysis methods used in observational research: a scoping review and recommendations
Rijnhart, J. J. M., Lamp, S. J., Valente, M. J., MacKinnon, D. P., Twisk, J. W. R., & Heymans, M. W. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01426-3 · Cited by 345
“In theory, two counterfactual outcomes can be observed for one individual over the same time period, one based on exposure value x and one based on exposure value x* [47, 48].”
BackgroundCausal machine learning for predicting treatment outcomes
Feuerriegel, S., Frauen, D., Melnychuk, V., Schweisthal, J., Hess, K., Curth, A., Bauer, S., Kilbertus, N., Kohane, I. S., & van der Schaar, M. (2024) · Nature Medicine · doi:10.1038/s41591-024-02902-1 · Cited by 343
“However, treatment assignment in RWD is not fully randomized and depends on covariates, so that formal assumptions must be made 14 .”
InfluentialBest Practices in Quasi–Experimental Designs: Matching Methods for Causal Inference
Stuart, E. A., & Rubin, D. B. (2008) · Best Practices in Quantitative Methods · doi:10.4135/9781412995627.d14 · Cited by 335
Self-citationCattaneo, M. D., Frandsen, B. R., & Titiunik, R. (2015) · Journal of Causal Inference · doi:10.1515/jci-2013-0010 · Cited by 346
External Validity: From Do-Calculus to Transportability Across Populations
Pearl, J., & Bareinboim, E. (2014) · Statistical Science · doi:10.1214/14-sts486 · Cited by 345
Climate, conflict, and social stability: what does the evidence say?
Hsiang, S. M., & Burke, M. (2014) · Climatic Change · doi:10.1007/s10584-013-0868-3 · Cited by 342
The Bradford Hill considerations on causality: a counterfactual perspective
Höfler, M. (2005) · Emerging Themes in Epidemiology · doi:10.1186/1742-7622-2-11 · Cited by 340
“The causal effect of X = 1 versus X = 0 within an individual i at the time of treatment or exposure assignment can be defined as [ 13-20 ]:”
Graphs, Causality, and Structural Equation Models
PEARL, J. (1998) · Sociological Methods & Research · doi:10.1177/0049124198027002004 · Cited by 341
Assessing the effect of an influenza vaccine in an encouragement design
Hirano, K., Imbens, G. W., Rubin, D. B., & Zhou, X.-H. (2000) · Biostatistics · doi:10.1093/biostatistics/1.1.69 · Cited by 341
“…et al. (1996), showed that econometric instrumental variables (IV) methods can be interpreted as estimating a well-defined causal effect under the potential outcomes approach to causal inference advocated by Rubin (1974, 1978, 1990b), often referred to as the Rubin Causal Model (Holland, 1986).”
MethodSelf-citationBrookhart, M. A., Wang, P. S., Solomon, D. H., & Schneeweiss, S. (2006) · Epidemiology · doi:10.1097/01.ede.0000193606.58671.c5 · Cited by 341
“The approach depends on the existence of a variable (termed an instrument or instrumental variable) that is causally related to treatment but unrelated to a patient’s potential (counterfactual) outcomes.(37,38) Therefore, an instrumental variable is an external factor that influences an outcome only through its effect…”
BackgroundThe Economic Costs of Organised Crime: Evidence from Southern Italy
Pinotti, P. (2015) · The Economic Journal · doi:10.1111/ecoj.12235 · Cited by 342
Micro-Econometrics for Policy, Program and Treatment Effects
Lee, M.-J. (2005) · doi:10.1093/0199267693.001.0001 · Cited by 339
Applications of multiple imputation in medical studies: from AIDS to NHANES
Barnard, J., & Meng, X.-L. (1999) · Statistical Methods in Medical Research · doi:10.1177/096228029900800103 · Cited by 340
Causal inference with observational data
Nichols, A. (2007) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0800700403 · Cited by 339
Causal Inference without Counterfactuals
Dawid, A. P. (2001) · Applied Logic Series · doi:10.1007/978-94-017-1586-7_3 · Cited by 338
Best methods for the analysis of change: Recent advances, unanswered questions, future directions.
(1991) · American Psychological Association eBooks · doi:10.1037/10099-000 · Cited by 336
Estimating Heterogeneous Treatment Effects with Observational Data
Xie, Y., Brand, J. E., & Jann, B. (2012) · Sociological Methodology · doi:10.1177/0081175012452652 · Cited by 333
“Causal effects, treatment effects, heterogeneity, propensity scores, matching”
BackgroundCorporate governance and the information environment: Evidence from state antitakeover laws
Armstrong, C. S., Balakrishnan, K., & Cohen, D. (2012) · Journal of Accounting and Economics · doi:10.1016/j.jacceco.2011.06.005 · Cited by 335
“To better understand the specification in Equation (1), consider the following example within a potential outcomes framework.8 8 Following Rubin (1974), this framework is referred to as the potential outcomes framework because, for any firm, it is possible to observe only one outcome and not the other.”
BackgroundMethodInfluentialElections and the Regression Discontinuity Design: Lessons from Close U.S. House Races, 1942–2008
Caughey, D., & Sekhon, J. S. (2011) · Political Analysis · doi:10.1093/pan/mpr032 · Cited by 331
“2.1 Theory andAssumptions of the RD Design Hahn, Todd, and Van der Klaauw(2001) andLee (2008) formalize the RD design in the language of the Neyman-Rubin model (Splawa-Neyman, Dabrowska, and Speed 1923/1990; Rubin 1974).”
BackgroundInfluentialCausality and causal inference in epidemiology: the need for a pluralistic approach
Vandenbroucke, J. P., Broadbent, A., & Pearce, N. (2016) · International Journal of Epidemiology · doi:10.1093/ije/dyv341 · Cited by 327
“Donald Rubin’s seminal paper coining the phrase ‘potential outcomes’ was published in 1974.(17) Decades later, more direct links between philosophical and statistical thinking about causation were developed by Spirtes, Glymour and Scheines(18) and by Pearl.”
BackgroundThe use of propensity score matching in the evaluation of active labour market policies
Bryson, A., Dorsett, R., & Purdon, S. (2002) · London School of Economics and Political Science Research Online (London School of Economics and Political Science) · Cited by 410
Elwert, F. (2013) · Handbooks of Sociology and Social Research · doi:10.1007/978-94-007-6094-3_13 · Cited by 325
Does Digital Divide or Provide? The Impact of Cell Phones on Grain Markets in Niger
Aker, J. C. (2008) · SSRN Electronic Journal · doi:10.2139/ssrn.1093374 · Cited by 324
“The standard solution to this problem is to identify a relevant control group and estimate the average treatment effect (ATE) by taking the difference in outcomes for the treated and control groups (Imbens 2004, Rubin 1974, Blattman and Annan 2007).”
BackgroundDirect and Indirect Causal Effects via Potential Outcomes*
Rubin, D. B. (2004) · Scandinavian Journal of Statistics · doi:10.1111/j.1467-9469.2004.02-123.x · Cited by 324
Self-citationTheory as method: small theories of treatments
Lipsey, M. W. (1993) · New Directions for Program Evaluation · doi:10.1002/ev.1637 · Cited by 322
Yoshikawa, H., Weisner, T. S., Kalil, A., & Way, N. (2008) · Developmental Psychology · doi:10.1037/0012-1649.44.2.344 · Cited by 320
“Whether using classic, random-assignment experimental methods or a quasi-experimental approach, the goal is most often an unbiased estimate of the effect of a predictor on a developmental outcome (Foster, 2002; Rubin, 1974; Shadish, Cook, & Campbell, 2002).”
MethodPublic Transfers and Domestic Violence: The Roles of Private Information and Spousal Control
Bobonis, G. J., González-Brenes, M., & Castro, R. (2013) · American Economic Journal: Economic Policy · doi:10.1257/pol.5.1.179 · Cited by 316
Opiates for the Matches: Matching Methods for Causal Inference
Sekhon, J. S. (2009) · Annual Review of Political Science · doi:10.1146/annurev.polisci.11.060606.135444 · Cited by 319
“Rubin (1974, 2006) developed the model into a general framework for causal inference with implications for observational research.”
BackgroundBlinding and expectancy confounds in psychedelic randomized controlled trials
Muthukumaraswamy, S. D., Forsyth, A., & Lumley, T. (2021) · Expert Review of Clinical Pharmacology · doi:10.1080/17512433.2021.1933434 · Cited by 324
Approximate Residual Balancing: Debiased Inference of Average Treatment Effects in High Dimensions
Athey, S., Imbens, G. W., & Wager, S. (2018) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/rssb.12268 · Cited by 311
“Our goal is to estimate average treatment effects in the potential outcomes framework, or Rubin causal model (Rubin, 1974; Imbens and Rubin, 2015).”
BackgroundIntention-to-treat analysis and the goals of clinical trials*
Sheiner, L. B., & Rubin, D. B. (1995) · Clinical Pharmacology & Therapeutics · doi:10.1016/0009-9236(95)90260-0 · Cited by 314
Self-citationAdministrative Records Mask Racially Biased Policing
Knox, D., Lowe, W., & Mummolo, J. (2019) · doi:10.2139/ssrn.3336338 · Cited by 314
The performance of estimators based on the propensity score
Huber, M., Lechner, M., & Wunsch, C. (2013) · Journal of Econometrics · doi:10.1016/j.jeconom.2012.11.006 · Cited by 311
“…to Horvitz and Thompson, 1952) or to the recently introduced titling version by Graham, Pinto and Egel (2011a,b), direct matching estimators (Rubin, 1974, Rosenbaum and Rubin, 1983), and kernel matching estimators (Heckman, Ichimura and Todd, 1998).4 However, many variants of the estimators…”
BackgroundCausal Inference in Accounting Research
GOW, I. D., LARCKER, D. F., & REISS, P. C. (2016) · Journal of Accounting Research · doi:10.1111/1475-679x.12116 · Cited by 307
The role of officer race and gender in police-civilian interactions in Chicago
Ba, B. A., Knox, D., Mummolo, J., & Rivera, R. (2021) · Science · doi:10.1126/science.abd8694 · Cited by 306
Start-up subsidies for the unemployed: Long-term evidence and effect heterogeneity
Caliendo, M., & Künn, S. (2011) · Journal of Public Economics · doi:10.1016/j.jpubeco.2010.11.003 · Cited by 310
“In order to estimate causal effects, we base our analysis on the potential outcome framework, also known as the Roy (1951) - Rubin (1974) model.”
MethodMeine, T. J., Roe, M. T., Chen, A. Y., Patel, M. R., Washam, J. B., Ohman, E. M., Peacock, W. F., Pollack, C. V., Gibler, W. B., & Peterson, E. D. (2005) · American Heart Journal · doi:10.1016/j.ahj.2005.02.010 · Cited by 310
“As an additional way of accounting for nonrandom treatment assignment, we adjusted for factors favoring selection of one treatment over another using propensity scores.(4,5) Using”
MethodKey Factors in the Market for Remanufactured Products
Subramanian, R., & Subramanyam, R. (2012) · Manufacturing & Service Operations Management · doi:10.1287/msom.1110.0368 · Cited by 308
“We employ potential outcomes analysis (e.g., Dehejia and Wahba 1999, Heckman et al. 1997, Rubin 1974)—specifically, propensity score matching (Rosenbaum and Rubin 1983, Rubin and Thomas 1996)—to examine the causal effect of negative reputation on price differential (details of this analysis are…”
MethodZhang, J. L., & Rubin, D. B. (2003) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986028004353 · Cited by 308
“This problem has been called the fundamental problem of casual interference by Holland (1986), where this framework was called the Rubin Causal Model for a series of articles starting with Rubin (1974).”
Self-citationLASSEN, D. D., & SERRITZLEW, S. (2011) · American Political Science Review · doi:10.1017/s000305541100013x · Cited by 305
Balancing Covariates via Propensity Score WeightingPreprint
Li, F., Lock, K., Alan, M., & Zaslavsky, M. (2014) · Cited by 309
Turning Out to Vote: The Costs of Finding and Getting to the Polling Place
BRADY, H. E., & MCNULTY, J. E. (2011) · American Political Science Review · doi:10.1017/s0003055410000596 · Cited by 308
“The trick, of course, is to match on the right characteristics, and this must be done to satisfy what is called the “conditional independence assumption” or the “unconfoundedness” assumption (Holland 1986; Neyman 1923; Rubin 1974).”
BackgroundAdministrative Records Mask Racially Biased Policing
KNOX, D., LOWE, W., & MUMMOLO, J. (2020) · American Political Science Review · doi:10.1017/s0003055420000039 · Cited by 314
“We ground our analysis in the potential outcomes framework (Rubin 1974) often used in the study of causal mediation (Imai et al. 2011; Pearl 2001).”
Bounded, efficient and doubly robust estimation with inverse weighting
Tan, Z. (2010) · Biometrika · doi:10.1093/biomet/asq035 · Cited by 305
“A related problem is to estimate population average treatment effects under no unmeasured confounding in causal inference (Neyman, 1923; Rubin, 1974).”
The Impact of Fair Trade Certification for Coffee Farmers in Peru
Ruben, R., & Fort, R. (2012) · World Development · doi:10.1016/j.worlddev.2011.07.030 · Cited by 305
“We rely on a matching approach as a solution for this problem (Heckman, Ichimura, & Todd, 1997; Rosenbaum & Rubin, 1983; Rubin, 1974; Rubin & Thomas, 1996; Smith, 1997).”
MethodAntonakis, J., Bendahan, S., Jacquart, P., & Lalive, R. (2014) · Oxford Handbooks Online · doi:10.1093/oxfordhb/9780199755615.013.007 · Cited by 305
Unbiased Recommender Learning from Missing-Not-At-Random Implicit Feedback
Saito, Y., Yaginuma, S., Nishino, Y., Sakata, H., & Nakata, K. (2020) · Proceedings of the 13th International Conference on Web Search and Data Mining · doi:10.1145/3336191.3371783 · Cited by 295
“The proposed unbiased estimator is an extension of the Inverse Propensity Score (IPS) in causal inference [8, 20, 21] and an estimator in positive-unlabeled learning [2, 15].”
BackgroundMethodInfluentialSensitivity analysis for certain permutation inferences in matched observational studies
ROSENBAUM, P. R. (1987) · Biometrika · doi:10.1093/biomet/74.1.13 · Cited by 289
A Review of Generalizability and Transportability
Degtiar, I., & Rose, S. (2023) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-042522-103837 · Cited by 295
“We also write Y a to represent the potential outcome under a with lowercase a a specific value for random variable A. Potential outcomes are either explicitly assumed in the potential outcomes framework or a consequence of the structural causal model (Rubin, 1974; Pearl, 2000).”
BackgroundExperimental design and primary data analysis methods for comparing adaptive interventions.
Nahum-Shani, I., Qian, M., Almirall, D., Pelham, W. E., Gnagy, B., Fabiano, G. A., Waxmonsky, J. G., Yu, J., & Murphy, S. A. (2012) · Psychological Methods · doi:10.1037/a0029372 · Cited by 298
“The assumption is that each intervention option has the potential to be observed until assignment to intervention options is made (for a more detailed definition of potential outcomes, see Rubin, 1974, as well as Hernán, 2004).”
BackgroundRegression Discontinuity Designs in Epidemiology: Causal Inference Without Randomized Trials
Bor, J., Moscoe, E., Mutevedzi, P., Newell, M.-L., & Bärnighausen, T. (2014) · Epidemiology · doi:10.1097/ede.0000000000000138 · Cited by 291
Schoeler, T., Duncan, L., Cecil, C. M., Ploubidis, G. B., & Pingault, J.-B. (2018) · Psychological Bulletin · doi:10.1037/bul0000171 · Cited by 296
“Such methods are best understood within the counterfactual framework for causal inference (Höfler, 2005; Rubin, 1974, 1990; Rutter, 2007).”
MethodTrustworthy Online Controlled Experiments: A Practical Guide to A/B Testing
Kohavi, R., Tang, D., & Xu, Y. (2020) · doi:10.1017/9781108653985 · Cited by 297
Causal inference for time series
Runge, J., Gerhardus, A., Varando, G., Eyring, V., & Camps-Valls, G. (2023) · Nature Reviews Earth & Environment · doi:10.1038/s43017-023-00431-y · Cited by 288
Metadata
- Authors
- Rubin, D. B.
- Affiliations
- Educational Testing Service (US)
- Corresponding author
- Rubin, Donald B.
- ORCID
- Rubin, Donald B.
- Venue
- Journal of Educational Psychology
- Published
- 1974-10
- Volume
- 66
- Issue
- 5
- Pages
- 688-701
- ISSN
- 0022-0663 (ISSN-L)
- 1939-2176
- OpenAlex
- W2132917208
- Cited by
- 9,436
- References
- 10
- Citations by year
- 2026: 490 · 2025: 658 · 2024: 612 · 2023: 587 · 2022: 589 · 2021: 636 · 2020: 625 · 2019: 554 · 2018: 493 · 2017: 389 · 2016: 370 · 2015: 382 · 2014: 406 · 2013: 343 · 2012: 325
- FWCI
- 2.83
- Type
- journal article
- Language
- en
- Open access
- green
- nrs.harvard.edu
- Licence
- cc-by
- Locations
- Journal of Educational Psychology (publishedVersion)
- Digital Access to Scholarship at Harvard (DASH) (Harvard University) (submittedVersion, cc-by)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Education › Educational Research and Methods
- Keywords
- causal effect estimation, randomization, non-randomized studies, matching, random sampling, treatment effects, observational studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.