Estimating causal effects of treatments in randomized and nonrandomized studies
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Presents a discussion of matching, randomization, random sampling, and other methods of controlling extraneous variation. The objective was to specify the benefits of randomization in estimating causal effects of treatments. It is concluded that randomization should be employed whenever possible but that the use of carefully controlled nonrandomized data to estimate causal effects is a reasonable and necessary procedure in many cases.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“That work argues models may memorize variable names but lack knowledge of the underlying observational distributions ( P ( X,Y ) ) required to identify traps like confounding (Rubin, 1974).”
From Diagnosing and Mitigating Sycophancy and Skepticism in LLM Causal Judgment (2026) · cites this paper as Rubin, 1974
In the citing paper
“Specifically, the assumption that a subunit’s own output or outcomes are not affected by any other unit’s implementation assignment (what is called SUTVA (99)) is invalid, as interactions and synergistic effects underlie many of our implementation strategies.”
From An Overview of Research and Evaluation Designs for Dissemination and Implementation (2017) · cites this paper as [99]
Citations
Cites
Statistical Methods for Research Workers
(1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,880
(2001) · Empirical Direction in Design and Analysis · doi:10.4324/9781410600004-24 · Cited by 6,808
SCHEFFE, H. (1960) · Soil Science · doi:10.1097/00010694-196006000-00016 · Cited by 5,516
Testing Statistical Hypotheses
(2021) · Wiley Series in Probability and Statistics · doi:10.1002/9781119243830.ch12 · Cited by 5,106
Design and Analysis of Experiments
(2007) · Modern Engineering Statistics · doi:10.1002/9780470187548.ch12 · Cited by 1,424
Controlling Bias in Observational Studies: A Review
Cochran, W. G. (2006) · Matched Sampling for Causal Effects · doi:10.1017/cbo9780511810725.005 · Cited by 958 · cited 1×
“Recent work on methods of reducing bias in nonrandomized studies is summarized in Cochran and Rubin (1974).”
MethodThe University Group Diabetes Program. A further statistical analysis of the mortality findings
Cornfield, J. (1971) · JAMA · doi:10.1001/jama.217.12.1676 · Cited by 119
University Group Diabetes Program
Smelo, L. S. (1971) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1971.03180260057027 · Cited by 115
Design and Analysis of Industrial Experiments.
E., R. T., & Davies, O. L. (1954) · OR · doi:10.2307/3007149 · Cited by 111
Statistics: A Guide to the Unknown.
Pine, V. R., Tanur, J. M., Mosteller, F. C., Kruskal, W., Link, R. F., Pieters, R. S., & Rising, G. R. (1974) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2062882 · Cited by 89
Cited by
Items 101–200 of 1,074
Total, Direct, and Indirect Effects in Logit and Probit Models
Breen, R., Karlson, K. B., & Holm, A. (2013) · Sociological Methods & Research · doi:10.1177/0049124113494572 · Cited by 818
“While most treatments of causal mediation analysis use the potential outcomes framework of Rubin (1974, 1978), we refrain from doing this here and rather use the equivalent expression in terms of conditional independence between covariates and unobservables.”
MethodDissecting the Social: On the Principles of Analytical Sociology
Hedstrom, P. (2005) · doi:10.1017/cbo9780511488801 · Cited by 816
Elite Influence on Public Opinion in an Informed Electorate
BULLOCK, J. G. (2011) · American Political Science Review · doi:10.1017/s0003055411000165 · Cited by 777
Causal Effects in Non-Experimental Studies: Re-Evaluating the Evaluation of Training Programs
Dehejia, R., & Wahba, S. (1998) · National Bureau of Economic Research · doi:10.3386/w6586 · Cited by 805
Advances in Mediation Analysis: A Survey and Synthesis of New Developments
Preacher, K. J. (2015) · Annual Review of Psychology · doi:10.1146/annurev-psych-010814-015258 · Cited by 793
“The design-based tradition, beginning with the influential work of Donald Campbell (e.g., Campbell & Stanley 1963), has long emphasized the importance of strengthening internal validity, the validity of inferences about the causal nature of observed effects (Shadish et al. 2002).”
BackgroundElectoral Rules and Corruption
Persson, T., Tabellini, G., & Trebbi, F. (2003) · Journal of the European Economic Association · doi:10.1162/154247603322493203 · Cited by 782
“To exploit the control group, we then need a central identifying assumption, conditional independence also known as the selection on observables assumption (Rosenbaum and Rubin, 1983, Rubin, 1974, 1977).”
Mediation analysis in epidemiology: methods, interpretation and bias
Richiardi, L., Bellocco, R., & Zugna, D. (2013) · International Journal of Epidemiology · doi:10.1093/ije/dyt127 · Cited by 781
Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction
Imbens, G. W., & Rubin, D. B. (2015) · Thammasat University Digital Collections · Cited by 838
Self-citationOn the Empirics of Social Capital
Durlauf, S. N. (2002) · The Economic Journal · doi:10.1111/1468-0297.00079 · Cited by 770
“avoided via the appropriate use of randomization. In some respects, the Rubin (1974)”
Van Breukelen, G. J. P. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.02.007 · Cited by 765
“Following [2,6,9], the effect of a treatment G (1 5 yes, 0 5 no) on an outcome Y for person i is defined as the difference Di between that person’s outcome under treatment and under no treatment.”
BackgroundMethodAn Introduction to Causal Inference
Pearl, J. (2010) · The International Journal of Biostatistics · doi:10.2202/1557-4679.1203 · Cited by 755
Information from Markets Near and Far: Mobile Phones and Agricultural Markets in Niger
Aker, J. C. (2010) · American Economic Journal: Applied Economics · doi:10.1257/app.2.3.46 · Cited by 746
Difference-in-Differences with Variation in Treatment Timing
Goodman-Bacon, A. (2018) · doi:10.3386/w25018 · Cited by 757
Little, R. J., & Rubin, D. B. (2000) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.21.1.121 · Cited by 721
“Rubin (57, 60, 62) provided a formal framework that extended the idea beyond randomized experiments and randomization-based inference; this extended framework also allows the formal consideration of complications, such as unintended missing data and noncompliance.”
BackgroundSelf-citationThe Effects of Public R&D Subsidies on Firms' Innovation Activities: The Case of Eastern Germany
Almus, M., & Czarnitzki, D. (2003) · Journal of Business & Economic Statistics · doi:10.1198/073500103288618918 · Cited by 740
“We apply a nonparametric matching approach that goes back to the model of potential outcomes developed by Roy (1951) and Rubin (1974).”
MethodDoes Diversification Cause the 'Diversification Discount'?
Villalonga, B. (2000) · SSRN Electronic Journal · doi:10.2139/ssrn.227828 · Cited by 737
Lechner, M. (2001) · ZEW Economic Studies · doi:10.1007/978-3-642-57615-7_3 · Cited by 710
Rubin, D. B. (1979) · Journal of the American Statistical Association · doi:10.1080/01621459.1979.10482513 · Cited by 705
Self-citationAbadie, A., Angrist, J., & Imbens, G. (2002) · Econometrica · doi:10.1111/1468-0262.00270 · Cited by 701
Domestic Audience Costs in International Relations: An Experimental Approach
Tomz, M. (2007) · International Organization · doi:10.1017/s0020818307070282 · Cited by 699
Handbook of Evaluation Research
Ross, L., & Cronbach, L. J. (1976) · Educational Researcher · doi:10.2307/1174773 · Cited by 698
Detecting and quantifying causal associations in large nonlinear time series datasets
Runge, J., Nowack, P., Kretschmer, M., Flaxman, S., & Sejdinović, D. (2019) · Publication Database PIK (Potsdam Institute for Climate Impact Research (PIK)) · Cited by 713
Matched Sampling for Causal Effects
Rubin, D. B. (2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511810725 · Cited by 676
Self-citationInstrumental variable methods for causal inference
Baiocchi, M., Cheng, J., & Small, D. S. (2014) · Statistics in Medicine · doi:10.1002/sim.6128 · Cited by 683
Eight Myths About Causality and Structural Equation Models
Bollen, K. A., & Pearl, J. (2013) · Handbooks of Sociology and Social Research · doi:10.1007/978-94-007-6094-3_15 · Cited by 645
“Many statisticians clung to this paradigm as long as they could, and later on, when mathematical analysis of causal relations became necessary, they developed the Neyman–Rubin “potential outcome” (PO) notation (Rubin 1974) and continued to oppose structural equations as a threat to principled science (Rubin 2004, 2009…”
Austin, P. C. (2010) · American Journal of Epidemiology · doi:10.1093/aje/kwq224 · Cited by 673
“In an empirical example, Rosenbaum and Rubin show that the bias due to incomplete matching can be substantial (28).”
InfluentialEstimating Incumbency Advantage Without Bias
King, G., & Gelman, A. (1990) · Digital Access to Scholarship at Harvard (DASH) (Harvard University) · Cited by 672
Agnostic notes on regression adjustments to experimental data: Reexamining Freedman’s critique
Lin, W. (2013) · The Annals of Applied Statistics · doi:10.1214/12-aoas583 · Cited by 641
“(iv) The tyranny estimator can also be seen as a one-step variant of Rubin and van der Laan’s (2011) two-step “targeted ANCOVA.” Their estimator is equivalent to the difference in means of the residuals from a weighted least squares regression of Yi on zi , with the same weights as in remark (iii). (v) When is the usu…”
BackgroundMethodInfluentialHarding, D. J. (2003) · American Journal of Sociology · doi:10.1086/379217 · Cited by 644
Grandstanding, certification and the underpricing of venture capital backed IPOs
Lee, P. M., & Wahal, S. (2004) · Journal of Financial Economics · doi:10.1016/j.jfineco.2003.09.003 · Cited by 638
Sex offender recidivism: a review
Furby, L., Weinrott, M. R., & Blackshaw, L. (1989) · Psychological Bulletin · doi:10.1037/0033-2909.105.1.3 · Cited by 640
Does Attack Advertising Demobilize the Electorate?
Ansolabehere, S., Iyengar, S., Simon, A., & Valentino, N. (1994) · American Political Science Review · doi:10.2307/2082710 · Cited by 627
Causal inference and the data-fusion problem
Bareinboim, E., & Pearl, J. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1510507113 · Cited by 621
“Remarkably, the axioms that characterize counterfactuals in the SCM coincide with those that govern potential outcomes in Rubin’s causal model (8) where YxðuÞ stands for the potential outcome of unit u, had u been assigned treatment X = x.”
ResultThe Nonparametric Identification of Treatment Effects in Duration Models
Abbring, J. H., & van den Berg, G. J. (2003) · Econometrica · doi:10.1111/1468-0262.00456 · Cited by 616
“Unlike Neyman and much of the more recent literature (e.g. Rubin (1974), Holland (1986), and Heckman, LaLonde, and Smith (1999)), we have to deal with infinitely—actually uncountably—many potential outcome variables.3 For a careful discussion, we explicitly introduce the probability space (Ω F P)…”
ResultValid post-selection inference
Berk, R., Brown, L., Buja, A., Zhang, K., & Zhao, L. (2013) · The Annals of Statistics · doi:10.1214/12-aos1077 · Cited by 599
Cambridge Handbook of Experimental Political Science
(2011) · Cambridge University Press eBooks · doi:10.1017/cbo9780511921452 · Cited by 611
Understanding and Using Mediators and Moderators
Wu, A. D., & Zumbo, B. D. (2008) · Social Indicators Research · doi:10.1007/s11205-007-9143-1 · Cited by 598
“There is a long history of philosophical and scientific debate about what constitutes causation and the methodology to demonstrate it (e.g., Holland 1986; Kenny 1979; Pearl 2000; Rogosa 1987; Rosenbaum 1984; Rubin 1974, 1986; Sobel 1995, 2005).”
BackgroundResultAnsari, A., Mela, C. F., & Neslin, S. A. (2008) · Journal of Marketing Research · doi:10.1509/jmkr.45.1.60 · Cited by 594
Untangling the Causal Effects of Sex on Judging
Boyd, C. L., Epstein, L., & Martin, A. D. (2010) · American Journal of Political Science · doi:10.1111/j.1540-5907.2010.00437.x · Cited by 591
Brand, J. E., & Xie, Y. (2010) · American Sociological Review · doi:10.1177/0003122410363567 · Cited by 587
“There are, however, a few differences across data sources in the measurement of these variables.”
BackgroundVanderWeele, T. J., & Robinson, W. R. (2014) · Epidemiology · doi:10.1097/ede.0000000000000105 · Cited by 567
Marginal Structural Models for the Estimation of Direct and Indirect Effects
VanderWeele, T. J. (2009) · Epidemiology · doi:10.1097/ede.0b013e31818f69ce · Cited by 583
The Statistical Analysis of fMRI Data
Lindquist, M. A. (2008) · Statistical Science · doi:10.1214/09-sts282 · Cited by 563
“However, the idea of causality is a very deep and important philosophical issue (Rubin, 1974; Pearl, 2000).”
BackgroundA Tale of Two Cultures: Qualitative and Quantitative Research in the Social Sciences
Goertz, G., & Mahoney, J. (2012) · Cited by 583
Durable effects of concentrated disadvantage on verbal ability among African-American children
Sampson, R. J., Sharkey, P., & Raudenbush, S. W. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0710189104 · Cited by 576
Design approaches to experimental mediation
Pirlott, A. G., & MacKinnon, D. P. (2016) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2015.09.012 · Cited by 575
“…of those outlined by Shadish et al. (2002), e.g., considerations for causal relations, Hill (1971), the potential outcomes model (Holland, 1988; Rubin, 1974, 1977), and related causal inference models (Pearl, 2000; Robins & Greenland, 1992) but the work by Shadish et al. (2002) remains widely…”
BackgroundThe Econometrics of Randomized Experiments
(2017) · Handbook of Economic Field Experiments · doi:10.1016/bs.hefe.2016.10.003 · Cited by 562
“In part of the discussion in this chapter, therefore, we view the sample at hand as the full population of interest, following the approaches taken by Fisher (1925, 1935), Neyman (1935), and subsequently by Rubin (1974, 1978, 2007).”
MethodWodtke, G. T., Harding, D. J., & Elwert, F. (2011) · American Sociological Review · doi:10.1177/0003122411420816 · Cited by 567
“This study relies on potential outcomes notation to define causal effects of time-varying neighborhood exposures on high school graduation (Holland 1986; Robins, Hernán, and Brumback 2000; Rubin 1974).”
BackgroundRouse, C. E. (1998) · The Quarterly Journal of Economics · doi:10.1162/003355398555685 · Cited by 570
“, Rubin [1974] and Efron and Feldman [1991]), the parameter i, is referred to as the "intentionto-treat" effect.”
BackgroundInterpretation and identification of causal mediation
Pearl, J. (2014) · Psychological Methods · doi:10.1037/a0036434 · Cited by 554
“Counterfactual thinking in statistics (Holland, 1988; Rubin, 1974) and epidemiology (Robins and Greenland, 1992), together with a formal semantics based on non-parametric structural equations (Balke and Pearl, 1995; Halpern, 1998; Pearl, 2001) have given causal mediation analysis a sound theoretical basis and have ext…”
Gomila, R. (2021) · Journal of Experimental Psychology: General · doi:10.1037/xge0000920 · Cited by 561
A "SMART" Design for Building Individualized Treatment Sequences
Lei, H., Nahum-Shani, I., Lynch, K., Oslin, D., & Murphy, S. A. (2012) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032511-143152 · Cited by 557
“These questions may concern the comparison of different intervention options at different stages of the intervention.”
BackgroundQuasi-oracle estimation of heterogeneous treatment effects
Nie, X., & Wager, S. (2021) · Biometrika · doi:10.1093/biomet/asaa076 · Cited by 545
“We formalize our problem in terms of the potential outcomes framework (Neyman, 1923; Rubin, 1974).”
MethodThe Estimation of Causal Effects by Difference-in-Difference MethodsPreprint
Lechner, M. (2011) · RePEc: Research Papers in Economics · Cited by 552
Diagnosing and responding to violations in the positivity assumption
Petersen, M. L., Porter, K. E., Gruber, S., Wang, Y., & van der Laan, M. J. (2012) · Statistical Methods in Medical Research · doi:10.1177/0962280210386207 · Cited by 548
“The choice h(a, V)1⁄4 g0(a WV) results in weaker positivity assumption (8), by allowing the IPTW estimator to extrapolate to sparse areas of the joint distribution of (A, V) using the model m(a, V W ).”
InfluentialChapter 61 Using Randomization in Development Economics Research: A Toolkit
Duflo, E., Glennerster, R., & Kremer, M. (2007) · Handbook of Development Economics · doi:10.1016/s1573-4471(07)04061-2 · Cited by 545
The Dangers of Extreme Counterfactuals
King, G., & Zeng, L. (2006) · Political Analysis · doi:10.1093/pan/mpj004 · Cited by 540
“These definitions of causal effects are used in a wide variety of literatures (Rubin 1974; Holland 1986; King et al. 1994; Robins 1999a, 1999b; Pearl 2000).”
BackgroundBurgess, S., Daniel, R. M., Butterworth, A. S., Thompson, S. G., & the EPIC-InterAct Consortium (2015) · International Journal of Epidemiology · doi:10.1093/ije/dyu176 · Cited by 543
“It employs genetic variants to remove bias due to confounding and reverse causation [1].”
BackgroundEvaluating Value-Added Models for Teacher Accountability
McCaffrey, D. F., Lockwood, J. R., Koretz, D. M., & Hamilton, L. S. (2003) · PsycEXTRA Dataset · doi:10.1037/e658712010-001 · Cited by 541
Explaining Causal Findings Without Bias: Detecting and Assessing Direct Effects
ACHARYA, A., BLACKWELL, M., & SEN, M. (2016) · American Political Science Review · doi:10.1017/s0003055416000216 · Cited by 532
“To develop the framework, we rely on the potential outcomes model of causal inference (Holland 1986; Neyman 1923; Rubin 1974), a counterfactual-based framework (that we summarize only briefly here).”
MethodBayesian inference for causal effects in randomized experiments with noncompliance
Imbens, G. W., & Rubin, D. B. (1997) · The Annals of Statistics · doi:10.1214/aos/1034276631 · Cited by 538
“In the general approach, labeled the Rubin causal model (RCM) by Holland (1986) for work starting with Rubin (1974, 1975), causal inference problems are framed in terms of potentially observable outcomes, which are the responses of all units to all treatments.”
MethodSelf-citationRegression Discontinuity in Time: Considerations for Empirical Applications
Hausman, C., & Rapson, D. S. (2018) · Annual Review of Resource Economics · doi:10.1146/annurev-resource-121517-033306 · Cited by 528
Recent Developments in the Econometrics of Program Evaluation
Imbens, G., & Wooldridge, J. (2008) · National Bureau of Economic Research · doi:10.3386/w14251 · Cited by 533
Average causal effects from nonrandomized studies: A practical guide and simulated example.
Schafer, J. L., & Kang, J. (2008) · Psychological Methods · doi:10.1037/a0014268 · Cited by 529
Sensitivity to Exogeneity Assumptions in Program Evaluation
Imbens, G. W. (2003) · American Economic Review · doi:10.1257/000282803321946921 · Cited by 529
“Donald.”
MethodInfluentialTesting hypotheses on specific environmental causal effects on behavior.
Rutter, M., Pickles, A., Murray, R., & Eaves, L. (2001) · Psychological Bulletin · doi:10.1037//0033-2909.127.3.291 · Cited by 518
The Consequences of Child Soldiering
Blattman, C., & Annan, J. (2010) · Review of Economics and Statistics · doi:10.1162/rest_a_00036 · Cited by 517
“The standard solution to this problem is the counterfactual approach, whereby a relevant control group is found and the average treatment effect (ATE) is estimated by taking the difference in the outcomes of the treated and controls (Imbens, 2004; Rubin, 1974).”
Evaluating Anti-Poverty Programs
Ravallion, M. (2005) · World Bank, Washington, DC eBooks · doi:10.1596/1813-9450-3625 · Cited by 507
“10 Rubin (1980) dubbed it the stable unit treatment value assumption (SUTVA).”
An Overview of Research and Evaluation Designs for Dissemination and Implementation
Brown, C. H., Curran, G., Palinkas, L. A., Aarons, G. A., Wells, K. B., Jones, L., Collins, L. M., Duan, N., Mittman, B. S., Wallace, A., et al. (2017) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031816-044215 · Cited by 509
“subunit’s own output or outcomes are not affected by any other unit’s implementation assignment (what is called SUTVA (99)) is invalid, as interactions and synergistic effects underlie many of our implementation strategies.”
BackgroundDoes Professor Quality Matter? Evidence from Random Assignment of Students to Professors
Carrell, S. E., & West, J. E. (2010) · Journal of Political Economy · doi:10.1086/653808 · Cited by 508
Lechner, M. (2002) · Review of Economics and Statistics · doi:10.1162/003465302317411488 · Cited by 499
“…microeconometric evaluation methods are mostly concerned with the effects of being or not being in a particular program, whereas, for example in active labor market policies (ALMP), there is usually a range of heterogeneous subprograms, such as training, public employment programs, or job…”
BackgroundMethodMatrix Completion Methods for Causal Panel Data Models
Athey, S., Bayati, M., Doudchenko, N., Imbens, G., & Khosravi, K. (2018) · doi:10.3386/w25132 · Cited by 497
Curtis, L. H., Hammill, B. G., Eisenstein, E. L., Kramer, J. M., & Anstrom, K. J. (2007) · Medical Care · doi:10.1097/mlr.0b013e31806518ac · Cited by 494
“K ˆ aUiaXi, ˆ 0, a {1,2}. ( 3 ) where the treatment-specific censoring distribution Ka(t) typically is estimated using Kaplan–Meier estimates of the censoring distribution.”
MethodShadish, W. R., Clark, M. H., & Steiner, P. M. (2008) · Journal of the American Statistical Association · doi:10.1198/016214508000000733 · Cited by 479
“As has been argued in causal inference in general (Rubin 1974; Holland 1986), the best approximation to this true counterfactual may be a group of participants whose assignment method (random or nonrandom) was itself randomly assigned to them, with all other features of the experiment held equal.”
BackgroundMethodAngrist, J. D. (1998) · Econometrica · doi:10.2307/2998558 · Cited by 490
The importance of covariate selection in controlling for selection bias in observational studies.
Steiner, P. M., Cook, T. D., Shadish, W. R., & Clark, M. H. (2010) · Psychological Methods · doi:10.1037/a0018719 · Cited by 490
“However, only one is actually observed in practice, that is, Y ϭ Y 0 ͑1 Ϫ Z͒ ϩ Y 1 Z (Holland, 1986; Rubin, 1974).”
BackgroundFormal mode of statistical inference for causal effects
Rubin, D. B. (1990) · Journal of Statistical Planning and Inference · doi:10.1016/0378-3758(90)90077-8 · Cited by 483
Self-citationEfficient Estimation of Average Treatment Effects Using the Estimated Propensity Score
Hirano, K., Imbens, G. W., & Ridder, G. (2002) · SSRN Electronic Journal · doi:10.2139/ssrn.324940 · Cited by 480
Covariance Adjustment in Randomized Experiments and Observational Studies
Rosenbaum, P. R. (2002) · Statistical Science · doi:10.1214/ss/1042727942 · Cited by 477
“There are n subjects, j = 1, . . . , n, and subject j has two potential responses: the response rTj that would be observed if j were assigned to treatment, and the response rCj that would be observed if j were assigned to control (Neyman, 1923; Rubin, 1974, 1977).”
BackgroundMatching Methods in Practice: Three Examples
Imbens, G. W. (2015) · Journal of Human Resources · doi:10.3368/jhr.50.2.373 · Cited by 445
“The set up used in the current paper is by now the standard one in this literature, using the potential outcome framework for causal inference that builds on Fisher (1925) and Neyman (1923) and was extended to observational studies by Rubin (1974).”
MethodHigh-speed rail and CO2 emissions in urban China: A spatial difference-in-differences approach
Jia, R., Shao, S., & Yang, L. (2021) · Energy Economics · doi:10.1016/j.eneco.2021.105271 · Cited by 465
Estimating Outcome Distributions for Compliers in Instrumental Variables Models
Imbens, G. W., & Rubin, D. B. (1997) · The Review of Economic Studies · doi:10.2307/2971731 · Cited by 468
Self-citationSobel, M. E. (2006) · Journal of the American Statistical Association · doi:10.1198/016214506000000636 · Cited by 468
“To clarify these issues, I first extend the framework for causal inference developed primarily by Rubin (1974, 1977, 1978, 1980), defining neighborhood (treatment) effects when interference is present.”
BackgroundMethodInfluentialBetter LATE Than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009)
Imbens, G. W. (2010) · Journal of Economic Literature · doi:10.1257/jel.48.2.399 · Cited by 278
Natural Experiments in the Social Sciences: A Design-Based Approach
Dunning, T. (2012) · Thammasat University Digital Collections · Cited by 466
Statistics in Epidemiology: The Case-Control Study
Breslow, N. E. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476660 · Cited by 463
“Source: Scott and Wild (1986). Reprinted with permission.”
BackgroundThe causal effects of ideas on policies
Yee, A. S. (1996) · International Organization · doi:10.1017/s0020818300001673 · Cited by 463
A definition of causal effect for epidemiological research
Hernán, M. A. (2004) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2002.006361 · Cited by 462
A unified framework of longitudinal models to examine reciprocal relations.
Usami, S., Murayama, K., & Hamaker, E. L. (2019) · Psychological Methods · doi:10.1037/met0000210 · Cited by 437
“Specifically, we will place these models within the potential outcome (or counterfactual) approach (Rubin Causal Model; Rubin, 1974), which is currently considered the standard framework for defining causal effects (e.g. Imai, Keele & Tingley, 2010 and Huang & Yuan, 2017 for mediation analysis).”
MethodComparing Personal Trajectories and Drawing Causal Inferences from Longitudinal Data
Raudenbush, S. W. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.501 · Cited by 458
VanderWeele, T. J., & Arah, O. A. (2011) · Epidemiology · doi:10.1097/ede.0b013e3181f74493 · Cited by 452
“We will use the potential outcomes or counterfactual framework.(28) –30 Let treatment A denote the treatment”
MethodNonparametric Estimation of Average Treatment Effects under Exogeneity: A Review
Imbens, G. (2003) · National Bureau of Economic Research · doi:10.3386/t0294 · Cited by 446
Rethinking real-time electricity pricing
Allcott, H. (2011) · Resource and Energy Economics · doi:10.1016/j.reseneeco.2011.06.003 · Cited by 441
“This can be formalized using the "potential outcomes" framework of Rubin (1974) and the program evaluation literature that builds on his approach.”
MethodEconometric Methods for Program Evaluation
Abadie, A., & Cattaneo, M. D. (2018) · Annual Review of Economics · doi:10.1146/annurev-economics-080217-053402 · Cited by 431
“Following Neyman (1923), Rubin (1974) and many others, we use potential outcomes to define causal parameters: Yw represents the potential value of the outcome when the value of the treatment variable, W , is set to w.”
MethodA New Criterion for Confounder Selection
VanderWeele, T. J., & Shpitser, I. (2011) · Biometrics · doi:10.1111/j.1541-0420.2011.01619.x · Cited by 434
“Within the potential outcomes framework (Rubin 1974, 1978, 1990), we let Ya denote the potential outcome for Y if treatment A were set, possibly contrary to fact, to the value a.”
BackgroundNew evidence on the finite sample properties of propensity score reweighting and matching estimators
Busso, M., DiNardo, J., & McCrary, J. (2014) · Review of Economics and Statistics · doi:10.1162/rest_a_00431 · Cited by 428
“Expanding on Frölich’s analysis, this paper analyzes empirical as well as hypothetical DGPs and also examines the effect of misspecification.”
MethodSite Selection Bias in Program Evaluation *
Allcott, H. (2015) · The Quarterly Journal of Economics · doi:10.1093/qje/qjv015 · Cited by 426
“Consider the standard Rubin (1974) Causal Model.”
The Bias Due to Incomplete Matching
Rosenbaum, P. R. (2006) · Matched Sampling for Causal Effects · doi:10.1017/cbo9780511810725.020 · Cited by 422
Race as a Bundle of Sticks: Designs that Estimate Effects of Seemingly Immutable Characteristics
Sen, M., & Wasow, O. (2016) · Annual Review of Political Science · doi:10.1146/annurev-polisci-032015-010015 · Cited by 422
“(The literature on the potential outcomes framework is voluminous — e.g., Angrist, Imbens, and Rubin (1996); Holland (1986); Splawa-Neyman, Dabrowska, and Speed (1990); Rubin (1974; 2005) — and we attempt only a bare-bones introduction.)”
BackgroundA Microeconometric Evaluation of the Active Labour Market Policy in Switzerland
Gerfin, M., & Lechner, M. (2002) · The Economic Journal · doi:10.1111/1468-0297.00072 · Cited by 416
“This model is known as the Roy (1951) -Rubin (1974) model of potential outcomes and causal effects.”
Metadata
- Authors
- Rubin, D. B.
- Affiliations
- Educational Testing Service (US)
- Corresponding author
- Rubin, Donald B.
- ORCID
- Rubin, Donald B.
- Venue
- Journal of Educational Psychology
- Published
- 1974-10
- Volume
- 66
- Issue
- 5
- Pages
- 688-701
- ISSN
- 0022-0663 (ISSN-L)
- 1939-2176
- OpenAlex
- W2132917208
- Cited by
- 9,436
- References
- 10
- Citations by year
- 2026: 490 · 2025: 658 · 2024: 612 · 2023: 587 · 2022: 589 · 2021: 636 · 2020: 625 · 2019: 554 · 2018: 493 · 2017: 389 · 2016: 370 · 2015: 382 · 2014: 406 · 2013: 343 · 2012: 325
- FWCI
- 2.83
- Type
- journal article
- Language
- en
- Open access
- green
- nrs.harvard.edu
- Licence
- cc-by
- Locations
- Journal of Educational Psychology (publishedVersion)
- Digital Access to Scholarship at Harvard (DASH) (Harvard University) (submittedVersion, cc-by)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Education › Educational Research and Methods
- Keywords
- causal effect estimation, randomization, non-randomized studies, matching, random sampling, treatment effects, observational studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.