Estimating causal effects of treatments in randomized and nonrandomized studies
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Presents a discussion of matching, randomization, random sampling, and other methods of controlling extraneous variation. The objective was to specify the benefits of randomization in estimating causal effects of treatments. It is concluded that randomization should be employed whenever possible but that the use of carefully controlled nonrandomized data to estimate causal effects is a reasonable and necessary procedure in many cases.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“That work argues models may memorize variable names but lack knowledge of the underlying observational distributions ( P ( X,Y ) ) required to identify traps like confounding (Rubin, 1974).”
From Diagnosing and Mitigating Sycophancy and Skepticism in LLM Causal Judgment (2026) · cites this paper as Rubin, 1974
In the citing paper
“Specifically, the assumption that a subunit’s own output or outcomes are not affected by any other unit’s implementation assignment (what is called SUTVA (99)) is invalid, as interactions and synergistic effects underlie many of our implementation strategies.”
From An Overview of Research and Evaluation Designs for Dissemination and Implementation (2017) · cites this paper as [99]
Citations
Cites
Statistical Methods for Research Workers
(1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,880
(2001) · Empirical Direction in Design and Analysis · doi:10.4324/9781410600004-24 · Cited by 6,808
SCHEFFE, H. (1960) · Soil Science · doi:10.1097/00010694-196006000-00016 · Cited by 5,516
Testing Statistical Hypotheses
(2021) · Wiley Series in Probability and Statistics · doi:10.1002/9781119243830.ch12 · Cited by 5,106
Design and Analysis of Experiments
(2007) · Modern Engineering Statistics · doi:10.1002/9780470187548.ch12 · Cited by 1,424
Controlling Bias in Observational Studies: A Review
Cochran, W. G. (2006) · Matched Sampling for Causal Effects · doi:10.1017/cbo9780511810725.005 · Cited by 958 · cited 1×
“Recent work on methods of reducing bias in nonrandomized studies is summarized in Cochran and Rubin (1974).”
MethodThe University Group Diabetes Program. A further statistical analysis of the mortality findings
Cornfield, J. (1971) · JAMA · doi:10.1001/jama.217.12.1676 · Cited by 119
University Group Diabetes Program
Smelo, L. S. (1971) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1971.03180260057027 · Cited by 115
Design and Analysis of Industrial Experiments.
E., R. T., & Davies, O. L. (1954) · OR · doi:10.2307/3007149 · Cited by 111
Statistics: A Guide to the Unknown.
Pine, V. R., Tanur, J. M., Mosteller, F. C., Kruskal, W., Link, R. F., Pieters, R. S., & Rising, G. R. (1974) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2062882 · Cited by 89
Cited by
Items 501–600 of 1,074
Contamination in trials of educational interventions
Keogh-Brown, M., Bachmann, M., Shepstone, L., Hewitt, C., Howe, A., Ramsay, C., Song, F., Miles, J., Torgerson, D., Miles, S., et al. (2007) · Health Technology Assessment · doi:10.3310/hta11430 · Cited by 168
(Why) Should We Use SEM? Pros and Cons of Structural Equation Modeling
Nachtigall, C., Kroehne, U., Funke, F., & Steyer, R. (2003) · doi:10.23668/psycharchives.12783 · Cited by 165
The Neyman— Rubin Model of Causal Inference and Estimation Via Matching Methods
Sekhon, J. (2009) · The Oxford Handbook of Political Methodology · doi:10.1093/oxfordhb/9780199286546.003.0011 · Cited by 165
“Rubin (2006, 1974), among others, including most notably Cochran (1965; 1953), developed the model into a general framework for causal inference with implications for observational research.”
BackgroundAn evaluation of the active labour market programmes in SwedenPreprint
Sianesi, B. (2001) · RePEc: Research Papers in Economics · Cited by 188
Statistical mediation analysis.
MacKinnon, D. P., Cheong, J., & Pirlott, A. G. (2012) · APA handbook of research methods in psychology, Vol 2: Research designs: Quantitative, qualitative, neuropsychological, and biological. · doi:10.1037/13620-018 · Cited by 141
Using Census and Survey Data to Estimate Poverty and Inequality for Small Areas
Tarozzi, A., & Deaton, A. (2009) · Review of Economics and Statistics · doi:10.1162/rest.91.4.773 · Cited by 166
“been used extensively in statistics and econometrics. Following the seminal work by Rubin (1974)”
MethodGeneral Forms of Finite Population Central Limit Theorems with Applications to Causal Inference
Li, X., & Ding, P. (2017) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1295865 · Cited by 167
“…and the sampling process induces randomness in the estimators (see Cochran 1977); in randomized experiments, the potential outcomes (Neyman 1923; Rubin 1974) of the experimental units are fixed, and the physical randomization acts as the “reasoned basis” (Fisher 1935) for conducting statistical…”
MethodEducation as a Lifelong Process
Blossfeld, H.-P., & von Maurice, J. (2019) · Edition ZfE · doi:10.1007/978-3-658-23162-0_2 · Cited by 167
Attachment and coping with chronic disease
Schmidt, S., Nachtigall, C., Wuethrich-Martone, O., & Strauss, B. (2002) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(02)00335-5 · Cited by 167
“Since the work of Rubin [42], the term average causal effect (ACE) has become the basis of causal inference and its application outside randomised experiments.”
BackgroundBasic problems in interaction assessment.
Greenland, S. (1993) · Environmental Health Perspectives · doi:10.1289/ehp.93101s459 · Cited by 166
“Modern development began in philosophy literature (4) and in educational statistics (5); another line of development was introduced into epidemiology by Rothman (6).”
BackgroundChoice as an Alternative to Control in Observational Studies
Rosenbaum, P. R. (1999) · Statistical Science · doi:10.1214/ss/1009212410 · Cited by 166
“This section briefly reviews for later use a notation for causal effects that was introduced by Neyman (1923) in the context of experiments and developed by Rubin (1974, 1977) for use in observational studies.”
MethodRegression and Weighting Methods for Causal Inference Using Instrumental Variables
Tan, Z. (2006) · Journal of the American Statistical Association · doi:10.1198/016214505000001366 · Cited by 166
Building a Stronger Instrument in an Observational Study of Perinatal Care for Premature Infants
Baiocchi, M., Small, D. S., Lorch, S., & Rosenbaum, P. R. (2010) · Journal of the American Statistical Association · doi:10.1198/jasa.2010.ap09490 · Cited by 166
“For any outcome, each subject has two potential responses, one seen under treatment, Zij = 1, and the other seen under control, Zij = 0 (see Neyman 1923; Rubin 1974).”
BackgroundHainmueller, J., & Kern, H. L. (2008) · Electoral Studies · doi:10.1016/j.electstud.2007.10.006 · Cited by 166
“In order to yield unbiased causal estimates, previously used models had to make the assumption that treatment assignment is unconfounded conditional on the included control variables (Rubin, 1974; Rosenbaum, 2002).”
Does Schooling Increase or Reduce Social Inequality?
Raudenbush, S. W., & Eschmann, R. D. (2015) · Annual Review of Sociology · doi:10.1146/annurev-soc-071913-043406 · Cited by 164
“We therefore adopt the counterfactual account of causality, in which a causal effect is a comparison between two potential outcomes, each observable under an alternative course of action (Heckman 1976; Holland 1986; Neyman 1935; Roy 1951; Rubin 1974, 1978; see Morgan & Winship 2007 for a review).”
BackgroundMethodMacKinnon, D. P., Valente, M. J., & Gonzalez, O. (2020) · Prevention Science · doi:10.1007/s11121-019-01076-4 · Cited by 165
“The potential outcomes framework for estimating causal effects (Holland 1986, 1988; Rubin 1974) distinguishes an individual’s observed and counterfactual outcomes.”
BackgroundLechner, M., Miquel, R., & Wunsch, C. (2007) · German Economic Review · doi:10.1111/j.1468-0475.2007.00415.x · Cited by 164
Money or Ideas? A Field Experiment on Constraints to Entrepreneurship in Rural Pakistan
Gine, X., & Mansuri, G. (2014) · World Bank, Washington, DC eBooks · doi:10.1596/1813-9450-6959 · Cited by 166
“We do not report average treatment on the treated estimates because non-participants may well have been influenced by participants in their own CO, given the frequent interaction between CO members, thereby violating SUTVA (Rubin, 1974).”
BackgroundConformal Inference of Counterfactuals and Individual Treatment Effects
Lei, L., & Candès, E. J. (2021) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/rssb.12445 · Cited by 166
Can landscape ecology untangle the complexity of antibiotic resistance?
Singer, R. S., Ward, M. P., & Maldonado, G. (2006) · Nature Reviews Microbiology · doi:10.1038/nrmicro1553 · Cited by 164
“” This idea has since been referred to as counterfactual causality because the only study design that can assess accurately the existence of a causal relationship and the strength of the association between cause and effect is one in which a population is simultaneously exposed and unexposed to the caus”
BackgroundAhern, J., Hubbard, A., & Galea, S. (2009) · American Journal of Epidemiology · doi:10.1093/aje/kwp015 · Cited by 164
Causal Inference in the Social and Behavioral Sciences
Sobel, M. E. (1995) · Springer eBooks · doi:10.1007/978-1-4899-1292-3_1 · Cited by 188
Crump, R., Hotz, V. J., Imbens, G., & Mitnik, O. (2006) · National Bureau of Economic Research · doi:10.3386/t0330 · Cited by 159
“Using the potential outcome notation popularized by Rubin (1974) , let Yi(0) denote the outcome for unit i under control and Yi(1) the outcome under treatment.”
InfluentialComparison of “Risk-Adjusted” Hospital Outcomes
Shahian, D. M., & Normand, S.-L. T. (2008) · Circulation · doi:10.1161/circulationaha.107.747873 · Cited by 163
Does Education Increase Political Participation?
Mayer, A. K. (2011) · The Journal of Politics · doi:10.1017/s002238161100034x · Cited by 162
The Effects of Immigrant Concentration on Changes in Neighborhood Crime Rates
MacDonald, J. M., Hipp, J. R., & Gill, C. (2013) · Journal of Quantitative Criminology · doi:10.1007/s10940-012-9176-8 · Cited by 161
“We apply a potential outcomes causal model (see Rubin 1974; Angrist and Krueger 2001; Angrist, Imbens, and Rubin 1996) as our method for identifying the immigrant concentration effect, or the difference between the expected changes in crime (denoted by ∆Yi) observed among 8 Approximately 85% of the…”
MethodThe specification of the propensity score in multilevel observational studies
Arpino, B., & Mealli, F. (2011) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2010.11.008 · Cited by 161
“Several applications in social sciences are characterized by a hierarchical structure of data: units at the first level (e.g., individuals) clustered into groups (e.g., provinces).”
BackgroundAuntie Knows Best? Public Broadcasters and Current Affairs Knowledge
Soroka, S., Andrew, B., Aalberg, T., Iyengar, S., Curran, J., Coen, S., Hayashi, K., Jones, P., Mazzoleni, G., Woong Rhee, J., et al. (2013) · British Journal of Political Science · doi:10.1017/s0007123412000555 · Cited by 162
Potential Impacts of Antibiotic Use in Poultry Production
Singer, R. S., & Hofacre, C. L. (2006) · Avian Diseases · doi:10.1637/7569-033106r.1 · Cited by 161
“That is an impossible study because we can not both expose and unexpose the same farms at the same time; therefore, the hypothetical alternative is termed counterfactual (52,78,90).”
BackgroundGilbert, P. B., Bosch, R. J., & Hudgens, M. G. (2003) · Biometrics · doi:10.1111/1541-0420.00063 · Cited by 161
“This framework defines causal estimands using potential outcomes (Rubin, 1974, 1978; Holland, 1986).”
Volpe Martincus, C., & Carballo, J. (2010) · Journal of Development Economics · doi:10.1016/j.jdeveco.2009.02.007 · Cited by 160
“In general, most evaluation exercises take the main assumptions of the Roy (1951)–Rubin (1974) model as granted.12 Specifically, crossand general equilibrium effects are ignored.”
BackgroundEstimation with missing data: beyond double robustness
Han, P., & Wang, L. (2013) · Biometrika · doi:10.1093/biomet/ass087 · Cited by 159
The Identification Zoo: Meanings of Identification in Econometrics
Lewbel, A. (2019) · Journal of Economic Literature · doi:10.1257/jel.20181361 · Cited by 229
“(2013), Lazzati (2015), Angelucci and Di Maro (2016), and Laffers and Mellace (2016) for examples of dealing with SUTVA violations by each of these methods.”
BackgroundMethodInfluentialPromisingInterventions, O’Connell, M. E., Boat, T. F., & Warner, K. E. (2009) · Cited by 188
Battistin, E., & Rettore, E. (2008) · Journal of Econometrics · doi:10.1016/j.jeconom.2007.05.006 · Cited by 159
A ‘Green Button’ For Using Aggregate Patient Data At The Point Of Care
Longhurst, C. A., Harrington, R. A., & Shah, N. H. (2014) · Health Affairs · doi:10.1377/hlthaff.2014.0099 · Cited by 159
The Anticipated Capitalisation Effect of a New Metro Line on Housing Prices*
Agostini, C. A., & Palmucci, G. A. (2008) · Fiscal Studies · doi:10.1111/j.1475-5890.2008.00074.x · Cited by 158
Omitted variable bias: A threat to estimating causal relationships
Wilms, R., Mäthner, E., Winnen, L., & Lanwehr, R. (2021) · Methods in Psychology · doi:10.1016/j.metip.2021.100075 · Cited by 159
Estimating treatment effects in randomized clinical trials in the presence of non-compliance
Nagelkerke, N., Fidler, V., Bernsen, R., & Borgdorff, M. (2000) · Statistics in Medicine · doi:10.1002/1097-0258(20000730)19:14<1849::aid-sim506>3.0.co;2-1 · Cited by 159
Hogan, J. W., & Lancaster, T. (2004) · Statistical Methods in Medical Research · doi:10.1191/0962280204sm351ra · Cited by 158
Gender Interactions within Hierarchies: Evidence from the Political Arena
Gagliarducci, S., & Paserman, M. D. (2012) · The Review of Economic Studies · doi:10.1093/restud/rdr046 · Cited by 158
Globalisation and poverty in Senegal: a worst case scenario?
Maertens, M., Colen, L., & Swinnen, J. F. M. (2011) · European Review of Agricultural Economics · doi:10.1093/erae/jbq053 · Cited by 157
Evaluation of credit guarantee policy using propensity score matching
Oh, I., Lee, J.-D., Heshmati, A., & Choi, G.-G. (2009) · Small Business Economics · doi:10.1007/s11187-008-9102-5 · Cited by 158
“In other words, the effect of program can be defined as ‘what would have happened to those who, in fact, did receive treatment, if they had not received treatment (or vice versa)?’ (Rubin, 1974).”
BackgroundInfluentialArpino, B., Pronzato, C., & Tavares, L. P. (2014) · European Journal of Population / Revue européenne de Démographie · doi:10.1007/s10680-014-9319-8 · Cited by 188
“We use the potential outcome framework (Neyman, 1923; Rubin, 1974) to formalize the problem.”
InfluentialModern Algorithms for Matching in Observational Studies
Rosenbaum, P. R. (2019) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-031219-041058 · Cited by 185
“…p er so na l u se o nl y. Balancing property of propensity scores: observed covariates x are conditionally independent of treatment Z given the propensity score on bone density is a comparison of rT and rC , such as rT − rC , but this is not observed for any child (see Neyman 1990 and Rubin 1974).”
Adjusting Treatment Effect Estimates by Post-Stratification in Randomized Experiments
Miratrix, L. W., Sekhon, J. S., & Yu, B. (2013) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2012.01048.x · Cited by 156
“This avenue for a robust analysis, revitalized by Rubin in the 1970s (Rubin, 1974), has recently had much appeal.”
BackgroundThe Self Not Taken: How Alternative Selves Develop and How They Influence Our Professional Lives
Obodaru, O. (2012) · Academy of Management Review · doi:10.5465/amr.2009.0358 · Cited by 139
Improving the External Validity of Conjoint Analysis: The Essential Role of Profile Distribution
Cuesta, B. D. L., Egami, N., & Imai, K. (2021) · Political Analysis · doi:10.1017/pan.2020.40 · Cited by 187
“Using the potential outcomes framework (Neyman, 1923; Rubin, 1974), let Yijkptq represent the potential outcome for respondent i when the stacked vector of J profiles Tik “ t are presented to respondent i as the kth task.”
Conditional Permutation Tests and the Propensity Score in Observational Studies
Rosenbaum, P. R. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10478082 · Cited by 156
How Satisfied are the Self-Employed? A Life Domain View
Binder, M., & Coad, A. (2015) · Journal of Happiness Studies · doi:10.1007/s10902-015-9650-8 · Cited by 180
“Matching estimates (Rubin 1974; Imbens 2004; Caliendo and Kopeinig 2008) allow us to more carefully select a control group of similar individuals to those who go into self-employment (‘‘perfect twins’’ with the one exception that these control individuals do not actually get into self-employment but remain either empl…”
Identifiability, exchangeability and confounding revisited
Greenland, S., & Robins, J. M. (2009) · Epidemiologic Perspectives & Innovations · doi:10.1186/1742-5573-6-4 · Cited by 155
“Rubin [ 29 ,30] introduced the term "potential outcomes" and formalized a set of assumptions that identified average causal effects within the model.”
BackgroundCausal processes in psychology are heterogeneous.
Bolger, N., Zee, K. S., Rossignac-Milon, M., & Hassin, R. R. (2019) · Journal of Experimental Psychology: General · doi:10.1037/xge0000558 · Cited by 154
“But if, as has been argued by Rubin and others (Imbens & Rubin, 2015; Morgan & Winship, 2014; Rubin, 1974), a single causal effect in a between-subjects experiment is equal to an average causal effect in a within-subjects experiment, then experimentalists should consider this in interpretations of between-subjects res…”
BackgroundRevisiting field experimentation: Field notes for the future.
Shadish, W. R. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.3 · Cited by 153
Causal Inference in Recommender Systems: A Survey and Future Directions
Gao, C., Zheng, Y., Wang, W., Feng, F., He, X., & Li, Y. (2024) · ACM Transactions on Information Systems · doi:10.1145/3639048 · Cited by 279
“As an approach to information filtering, the recommender system has been widely deployed on various platforms in recent decades, such as TikTok, YouTube, Twitter, etc.”
BackgroundMethodInfluentialHigh Noon for Microfinance Impact Evaluations: Re-investigating the Evidence from Bangladesh
Duvendack, M., & Palmer‐Jones, R. (2012) · The Journal of Development Studies · doi:10.1080/00220388.2011.646989 · Cited by 179
Executive Decline and Dysfunction Precedes Declines in Memory: The Women's Health and Aging Study II
Carlson, M. C., Xue, Q.-L., Zhou, J., & Fried, L. P. (2009) · The Journals of Gerontology Series A: Biological Sciences and Medical Sciences · doi:10.1093/gerona/gln008 · Cited by 153
Assessing time-varying causal effect moderation in mobile health
Boruvka, A., Almirall, D., Witkiewitz, K., & Murphy, S. A. (2018) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1305274 · Cited by 152
“To define treatment effects below, we adopt potential outcomes (Rubin 1974; Robins 1989; Neyman 1990) notation.”
Hitchcock, C. (2003) · The British Journal for the Philosophy of Science · doi:10.1093/bjps/54.1.1 · Cited by 151
Offline Multi-Action Policy Learning: Generalization and Optimization
Zhou, Z., Athey, S. C., & Wager, S. (2022) · Operations Research · doi:10.1287/opre.2022.2271 · Cited by 283
On the Consistency Rule in Causal Inference: Axiom, Definition, Assumption, or Theorem?
Pearl, J. (2010) · Epidemiology · doi:10.1097/ede.0b013e3181f5d3fd · Cited by 151
Does contract farming improve smallholder income? The case of avocado farmers in Kenya
Mwambi, M. M., Oduol, J., Mshenga, P. M., & Saidi, M. (2016) · Journal of Agribusiness in Developing and Emerging Economies · doi:10.1108/jadee-05-2013-0019 · Cited by 185
“As in Rubin (1974, 1977), we define Y1 and Y0 as potential outcomes that an individual would attain with and without being exposed to the treatment.”
MethodApplied Bayesian Modeling And Causal Inference From Incomplete-Data Perspectives
Gelman, A., & Xiaoli, M. (2014) · Cited by 156
Rodriguez, S., & Lieber, H. (2020) · Journal of Experiential Education · doi:10.1177/1053825920919462 · Cited by 230
“Since Rubin and his colleagues first conceptualized the idea of causal inference (Rubin, 1974), applied researchers have sought to establish valid counterfactuals in observational data.”
BackgroundCausal Inference on the Difference of the Restricted Mean Lifetime Between Two Groups
Chen, P., & Tsiatis, A. A. (2001) · Biometrics · doi:10.1111/j.0006-341x.2001.01030.x · Cited by 185
“Rubin (1978) refers to this as the strong ignorability assumption.”
BackgroundInstrumental Variables Estimation of Average Treatment Effects in Econometrics and Epidemiology
Angrist, J. D. (1991) · National Bureau of Economic Research · doi:10.3386/t0115 · Cited by 168
Karlsson, P., & Bergmark, A. (2015) · Addiction · doi:10.1111/add.12799 · Cited by 148
“[16]), and defines the effect as the difference between the observed outcome and the outcome that would have been”
BackgroundProgram Evaluation and Research Designs
DiNardo, J., & Lee, D. S. (2011) · Handbook of Labor Economics · doi:10.1016/s0169-7218(11)00411-4 · Cited by 140
“The distinction between these situations has sometimes been blurred: the Neyman–Holland–Rubin Model (Splawa-Neyman et al., 1990, 1935; Rubin, 1990, 1974, 1986; Holland, 1986), which we discuss later, has been used in situations both where the investigator does have detailed institutional knowledge…”
Identifying the Effect of Changing the Policy Threshold in Regression Discontinuity Models
Dong, Y., & Lewbel, A. (2015) · Review of Economics and Statistics · doi:10.1162/rest_a_00510 · Cited by 150
“As in Rubin (1974), let Y (1) and Y(0) denote the potential outcomes when one is treated or not treated, respectively, so the observed outcome is Y = Y (1) T + Y (0) (1 − T).”
BackgroundPropensity Score Analysis: Recent Debate and Discussion
Guo, S., Fräser, M. W., & Chen, Q. (2020) · Journal of the Society for Social Work and Research · doi:10.1086/711393 · Cited by 185
“Based on the counterfactual framework (Neyman, 1923/1935; Rubin, 1974, 1986), thematching estimators directly impute themissing data at the unit level by using a vector norm.”
BackgroundStatistical power in randomized intervention studies with noncompliance.
Jo, B. (2002) · Psychological Methods · doi:10.1037//1082-989x.7.2.178 · Cited by 150
“Statistical assumptions required to make causal inferences are clearly addressed in Rubin’s causal model (RCM; Holland, 1986; Rubin, 1974, 1978, 1980) approach.”
BackgroundRouse, C. E. (1997) · National Bureau of Economic Research · doi:10.3386/w5964 · Cited by 168
Estimating Individual Treatment Effect in Observational Data Using Random Forest Methods
Lu, M., Sadiq, S., Feaster, D. J., & Ishwaran, H. (2018) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2017.1356325 · Cited by 149
“Definition (1) relies on what is called the counterfactual framework, or potential outcomes model (Neyman et al., 1990; Rubin, 1974).”
BackgroundDesvendando os Mistérios do Coeficiente de Correlação de Pearson (r)
Filho, D. B. F., & Júnior, J. A. D. S. (2009) · Revista Política Hoje · Cited by 915
Becker, M., Lüdtke, O., Trautwein, U., Köller, O., & Baumert, J. (2012) · Journal of Educational Psychology · doi:10.1037/a0027608 · Cited by 148
What makes articles highly cited?
Antonakis, J., Bastardoz, N., Liu, Y., & Schriesheim, C. A. (2014) · The Leadership Quarterly · doi:10.1016/j.leaqua.2013.10.014 · Cited by 148
Sensitivity Analysis for Instrumental Variables Regression With Overidentifying Restrictions
Small, D. S. (2007) · Journal of the American Statistical Association · doi:10.1198/016214507000000608 · Cited by 148
“we use the potential outcomes approach (Neyman, 1923; Rubin, 1974 ).”
Methodmma: An R Package for Mediation Analysis with Multiple Mediators
Yu, Q., & Ли, Б. (2017) · Journal of Open Research Software · doi:10.5334/jors.160 · Cited by 168
Politics with the People: Building a Directly Representative Democracy
Neblo, M. A., Esterling, K., & Lazer, D. M. J. (2018) · Cited by 149
Using Propensity Scores for Causal Inference: Pitfalls and Tips
Shiba, K., & Kawahara, T. (2021) · Journal of Epidemiology · doi:10.2188/jea.je20210145 · Cited by 183
Representation Learning for Treatment Effect Estimation from Observational Data
Yao, L., Li, S., Li, Y., Huai, M., Gao, J., & Zhang, A. (2018) · neural information processing systems · Cited by 340
Job Displacement among Single Mothers: Effects on Children’s Outcomes in Young Adulthood
Brand, J. E., & Thomas, J. S. (2014) · American Journal of Sociology · doi:10.1086/675409 · Cited by 184
“…the effect of maternal displacement is defined as the difference between the two potential outcomes in the treated and the untreated states ðd 5 1,0; Rubin 1974; Imbens 2004; Heckman 2005; Morgan and Winship 2007Þ: di 5 y d51 i 2 y d50 i : ð1Þ That is, we ask whether children whose mothers were…”
BackgroundIDENTIFYING CAUSAL MECHANISMS (PRIMARILY) BASED ON INVERSE PROBABILITY WEIGHTING
Huber, M. (2013) · Journal of Applied Econometrics · doi:10.1002/jae.2341 · Cited by 194
“This corresponds to the missing at random assumption of Rubin (1976).20 The latter allows correcting for attrition bias by weighting observations in the estimation by R/Pr(R= 1|D,W,X), with R being the binary response indicator (see, for instance, Wooldridge, 2002, 2007).”
MethodDesign sensitivity in observational studies
Rosenbaum, P. (2004) · Biometrika · doi:10.1093/biomet/91.1.153 · Cited by 175
“1.1. Review: Notation for a Paired Randomized Experiment[11] [21] [ 36 ] [2].”
BackgroundInfluentialDevelopment, Discouragement, or Diversion? New Evidence on the Effects of College Remediation Policy
Scott-Clayton, J., & Rodriguez, O. (2015) · Education Finance and Policy · doi:10.1162/edfp_a_00150 · Cited by 145
Propensity‐score matching with competing risks in survival analysis
Austin, P. C., & Fine, J. P. (2018) · Statistics in Medicine · doi:10.1002/sim.8008 · Cited by 161
Biostatistical Methods in Epidemiology
(2002) · Technometrics · doi:10.1198/004017002320256693 · Cited by 146
De Stavola, B. L., Daniel, R. M., Ploubidis, G. B., & Micali, N. (2015) · American Journal of Epidemiology · doi:10.1093/aje/kwu239 · Cited by 145
“The causal inference framework (11, 12) invokes potential outcomes (30).”
A Simple Method for Principal Strata Effects When the Outcome Has Been Truncated Due to Death
Chiba, Y., & VanderWeele, T. J. (2011) · American Journal of Epidemiology · doi:10.1093/aje/kwq418 · Cited by 154
Doubly robust learning for estimating individualized treatment with censored data
Zhao, Y., Zeng, D., Laber, E. B., Song, R., Yuan, M., & Kosorok, M. R. (2014) · Biometrika · doi:10.1093/biomet/asu050 · Cited by 197
“Thus, there are no unmeasured confounders (Rubin, 1974, 1978; Splawa-Neyman et al., 1990).”
Forastiere, L., Airoldi, E. M., & Mealli, F. (2020) · Journal of the American Statistical Association · doi:10.1080/01621459.2020.1768100 · Cited by 300
“Our first aim is to formulate the problem under the potential outcome framework (Rubin 1974, 1986) and to define causal estimands that are best suited for network data.”
BackgroundMethods for time‐varying exposure related problems in pharmacoepidemiology: An overview
Pazzagli, L., Linder, M., Zhang, M., Vágó, E., Stang, P., Myers, D., Andersen, M. T., & Bahmanyar, S. (2017) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.4372 · Cited by 169
“These models work under an extension for longitudinal data, of the potential outcomes framework proposed by Rubin.(33) One of the most common and intuitive ways to estimate the parameters of a MSM is using the inverse probability of treatment weighted estimator (IPTW).”
MethodNuru-Jeter, A. M., Michaels, E. K., Thomas, M. D., Reeves, A. N., Thorpe, R. J., & LaVeist, T. A. (2018) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040617-014230 · Cited by 145
“A distinct feature of causal inference is the articulation of a coun-terfactual quantity (106, 108, 109).”
Health shocks and risk aversion
Decker, S., & Schmitz, H. (2016) · Journal of Health Economics · doi:10.1016/j.jhealeco.2016.09.006 · Cited by 177
“Schupp (2007) analyses the first wave of grip strength data of the SOEP and reports that many respondents even enjoyed participating in the measurements as a nice break from the survey questionnaires.”
Evaluating environmental programs: The perspective of modern evaluation research
Frondel, M., & Schmidt, C. Μ. (2005) · Ecological Economics · doi:10.1016/j.ecolecon.2004.12.013 · Cited by 171
Electoral Rules and Politicians' Behavior: A Micro Test
Gagliarducci, S., Nannicini, T., & Naticchioni, P. (2011) · American Economic Journal Economic Policy · doi:10.1257/pol.3.3.144 · Cited by 185
Causal mediation analysis in economics: Objectives, assumptions, models
Celli, V. (2021) · Journal of Economic Surveys · doi:10.1111/joes.12452 · Cited by 193
“As mentioned in the previous section, most recent research in mediation analysis considers more general identi cation approaches based on the potential outcome framework, commonly used in treatment evaluation (Rubin, 1974) to overcome the limits of structural models.”
BackgroundMethodFrom LATE to MTE: Alternative methods for the evaluation of policy interventions
Cornelissen, T., Dustmann, C., Raute, A., & Schönberg, U. (2016) · Labour Economics · doi:10.1016/j.labeco.2016.06.004 · Cited by 143
“We model these potential outcomes as Y0i = μ0(Xi) + U0i (1) Y1i = μ1(Xi) + U1i (2) 4 The potential outcome model, often also referred to as the “Rubin causal model” is a building block for the literature on causal inference and goes back to Rubin (1974) and Holland (1986).”
BackgroundStatistics and causal inference: A review
Pearl, J. (2003) · Test · doi:10.1007/bf02595718 · Cited by 144
“9By “untested” I mean untested using frequency data in nonexperimental studies. ments.”
BackgroundMachine learning estimation of heterogeneous causal effects: Empirical Monte Carlo evidence
Knaus, M. C., Lechner, M., & Strittmatter, A. (2020) · Econometrics Journal · doi:10.1093/ectj/utaa014 · Cited by 211
“We describe the parameters of interest using Rubin’s (1974) potential outcome framework.”
MethodCarbon pricing and power sector decarbonization: Evidence from the UK
Leroutier, M. (2021) · Journal of Environmental Economics and Management · doi:10.1016/j.jeem.2021.102580 · Cited by 175
Metadata
- Authors
- Rubin, D. B.
- Affiliations
- Educational Testing Service (US)
- Corresponding author
- Rubin, Donald B.
- ORCID
- Rubin, Donald B.
- Venue
- Journal of Educational Psychology
- Published
- 1974-10
- Volume
- 66
- Issue
- 5
- Pages
- 688-701
- ISSN
- 0022-0663 (ISSN-L)
- 1939-2176
- OpenAlex
- W2132917208
- Cited by
- 9,436
- References
- 10
- Citations by year
- 2026: 490 · 2025: 658 · 2024: 612 · 2023: 587 · 2022: 589 · 2021: 636 · 2020: 625 · 2019: 554 · 2018: 493 · 2017: 389 · 2016: 370 · 2015: 382 · 2014: 406 · 2013: 343 · 2012: 325
- FWCI
- 2.83
- Type
- journal article
- Language
- en
- Open access
- green
- nrs.harvard.edu
- Licence
- cc-by
- Locations
- Journal of Educational Psychology (publishedVersion)
- Digital Access to Scholarship at Harvard (DASH) (Harvard University) (submittedVersion, cc-by)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Education › Educational Research and Methods
- Keywords
- causal effect estimation, randomization, non-randomized studies, matching, random sampling, treatment effects, observational studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.