Estimating causal effects of treatments in randomized and nonrandomized studies
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Presents a discussion of matching, randomization, random sampling, and other methods of controlling extraneous variation. The objective was to specify the benefits of randomization in estimating causal effects of treatments. It is concluded that randomization should be employed whenever possible but that the use of carefully controlled nonrandomized data to estimate causal effects is a reasonable and necessary procedure in many cases.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“That work argues models may memorize variable names but lack knowledge of the underlying observational distributions ( P ( X,Y ) ) required to identify traps like confounding (Rubin, 1974).”
From Diagnosing and Mitigating Sycophancy and Skepticism in LLM Causal Judgment (2026) · cites this paper as Rubin, 1974
In the citing paper
“Specifically, the assumption that a subunit’s own output or outcomes are not affected by any other unit’s implementation assignment (what is called SUTVA (99)) is invalid, as interactions and synergistic effects underlie many of our implementation strategies.”
From An Overview of Research and Evaluation Designs for Dissemination and Implementation (2017) · cites this paper as [99]
Citations
Cites
Statistical Methods for Research Workers
(1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,880
(2001) · Empirical Direction in Design and Analysis · doi:10.4324/9781410600004-24 · Cited by 6,808
SCHEFFE, H. (1960) · Soil Science · doi:10.1097/00010694-196006000-00016 · Cited by 5,516
Testing Statistical Hypotheses
(2021) · Wiley Series in Probability and Statistics · doi:10.1002/9781119243830.ch12 · Cited by 5,106
Design and Analysis of Experiments
(2007) · Modern Engineering Statistics · doi:10.1002/9780470187548.ch12 · Cited by 1,424
Controlling Bias in Observational Studies: A Review
Cochran, W. G. (2006) · Matched Sampling for Causal Effects · doi:10.1017/cbo9780511810725.005 · Cited by 958 · cited 1×
“Recent work on methods of reducing bias in nonrandomized studies is summarized in Cochran and Rubin (1974).”
MethodThe University Group Diabetes Program. A further statistical analysis of the mortality findings
Cornfield, J. (1971) · JAMA · doi:10.1001/jama.217.12.1676 · Cited by 119
University Group Diabetes Program
Smelo, L. S. (1971) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1971.03180260057027 · Cited by 115
Design and Analysis of Industrial Experiments.
E., R. T., & Davies, O. L. (1954) · OR · doi:10.2307/3007149 · Cited by 111
Statistics: A Guide to the Unknown.
Pine, V. R., Tanur, J. M., Mosteller, F. C., Kruskal, W., Link, R. F., Pieters, R. S., & Rising, G. R. (1974) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2062882 · Cited by 89
Cited by
Items 301–400 of 1,074
Quasi-experimental and experimental approaches to environmental economics
Greenstone, M., & Gayer, T. (2009) · Journal of Environmental Economics and Management · doi:10.1016/j.jeem.2008.02.004 · Cited by 295
Does retirement trigger ill health?
Behncke, S. (2012) · Health Economics · doi:10.1002/hec.1712 · Cited by 289
“This assumption is also called selection on observables or unconfoundedness (Rubin, 1974)”
BackgroundA multiple imputation strategy for clinical trials with truncation of patient data
Lavori, P. W., Dawson, R., & Shera, D. (1995) · Statistics in Medicine · doi:10.1002/sim.4780141707 · Cited by 291
Propensity score matching with R: conventional methods and new features
Zhao, Q.-Y., Luo, J.-C., Su, Y., Zhang, Y.-J., Tu, G.-W., & Luo, Z. (2021) · Annals of Translational Medicine · doi:10.21037/atm-20-3998 · Cited by 291
Chakraborty, B., & Murphy, S. A. (2014) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-022513-115553 · Cited by 286
Sampling‐Based versus Design‐Based Uncertainty in Regression Analysis
Abadie, A., Athey, S., Imbens, G. W., & Wooldridge, J. M. (2020) · Econometrica · doi:10.3982/ecta12675 · Cited by 285
Causation in epidemiology: Table 1
Parascandola, M., & Weed, D. L. (2001) · Journal of Epidemiology and Community Health · doi:10.1136/jech.55.12.905 · Cited by 276
“A counterfactual cause makes a difference in the outcome (or the probability of the outcome) when it is present, compared with when it is absent, while all else is held constant.”
BackgroundWhat are randomised controlled trials good for?
Cartwright, N. (2010) · Philosophical Studies · doi:10.1007/s11098-009-9450-2 · Cited by 284
“The counterfactual account is noteworthy here (see especially Cartwright (1989) and Rubin (1974) and discussions thereof), but the link there requires more heroic assumptions than the link from the probabilistic theory.”
BackgroundRecent developments in the econometrics of program evaluation
Wooldridge, J. M., & Imbens, G. (2008) · doi:10.1920/wp.cem.2008.2408 · Cited by 283
Combining propensity score matching and group-based trajectory analysis in an observational study.
Haviland, A., Nagin, D. S., & Rosenbaum, P. R. (2007) · Psychological Methods · doi:10.1037/1082-989x.12.3.247 · Cited by 282
Kang, H., Zhang, A., Cai, T. T., & Small, D. S. (2016) · Journal of the American Statistical Association · doi:10.1080/01621459.2014.994705 · Cited by 265
Does contract farming improve welfare? A review
Bellemare, M. F., & Bloem, J. R. (2018) · World Development · doi:10.1016/j.worlddev.2018.08.018 · Cited by 280
Rosenbaum, P. R. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10477060 · Cited by 279
Mixed method data collection strategies
(2007) · Choice Reviews Online · doi:10.5860/choice.44-6909 · Cited by 278
How to do a good systematic review of effects in international development: a tool kit
Waddington, H., White, H., Snilstveit, B., Hombrados, J. G., Vojtkova, M., Davies, P., Bhavsar, A., Eyers, J., Koehlmoos, T. P., Petticrew, M., et al. (2012) · Journal of Development Effectiveness · doi:10.1080/19439342.2012.711765 · Cited by 278
“A good effect size estimate should be comparable across studies – that is, independent of units of measurement – and only reflect effect magnitude for each study, and not other factors such as sample size (Lipsey and Wilson 2001, see also Duvendack et al. 2012).”
BackgroundResultCausality: Some Statistical Aspects
Cox, D. R. (1992) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982962 · Cited by 277
“See Rubin (1974) and for an introductory account and discussion see Holland (1986).”
BackgroundEducation and Political Participation
Persson, M. (2015) · British Journal of Political Science · doi:10.1017/s0007123413000409 · Cited by 263
The Role of Exchangeability in Inference
Lindley, D. V., & Novick, M. R. (1981) · The Annals of Statistics · doi:10.1214/aos/1176345331 · Cited by 276
Causal embeddings for recommendation
Bonner, S., & Vasile, F. (2018) · Proceedings of the 12th ACM Conference on Recommender Systems · doi:10.1145/3240323.3240360 · Cited by 234
Aakvik, A., Heckman, J. J., & Vytlacil, E. J. (2005) · Journal of Econometrics · doi:10.1016/j.jeconom.2004.04.002 · Cited by 274
“…we present a class of latent variable models that can be used to generate and produce structure on the Neyman (1923), Fisher (1935), Cox (1958) and Rubin (1974) model of potential outcomes, that can be used to estimate structural econometric models and that can be used to analyze discrete,…”
MethodCalcagno, J. C., & Long, B. T. (2008) · National Bureau of Economic Research · doi:10.3386/w14194 · Cited by 270
Estimating Local Fiscal Multipliers
Suárez Serrato, J. C., & Wingender, P. (2016) · doi:10.3386/w22425 · Cited by 270
Barnard, J., Frangakis, C. E., Hill, J. L., & Rubin, D. B. (2003) · Journal of the American Statistical Association · doi:10.1198/016214503000071 · Cited by 268
Self-citationCausal inference under multiple versions of treatment
VanderWeele, T. J., & Hernan, M. A. (2013) · Journal of Causal Inference · doi:10.1515/jci-2012-0002 · Cited by 267
“Furthermore, within a deterministic potential outcomes framework [2, 3], even when studying direct and indirect effects, once treatment is assigned this fixes the potential outcome for an individual, whereas in the multiple versions of treatment context, the potential outcome is not fixed by treatment alone; it is not…”
Methodological Wishes for the Next Decade and How to Make Wishes Come True
Aguinis, H., & Edwards, J. R. (2014) · Journal of Management Studies · doi:10.1111/joms.12058 · Cited by 267
“One effective approach to rule out alternative causal explanations is the counterfactual model of causation developed by Rubin and colleagues (Holland, 1986; Little and Rubin, 2000; Rubin, 1974, 1978).”
New Statistical Learning Methods for Estimating Optimal Dynamic Treatment Regimes
Zhao, Y.-Q., Zeng, D., Laber, E. B., & Kosorok, M. R. (2015) · Journal of the American Statistical Association · doi:10.1080/01621459.2014.937488 · Cited by 267
“A convenient way to formalize the problem in finding optimal DTRs is through potential outcomes (Rubin 1974, 1978; Robins 1986; Splawa-Neyman, Dabrowska, and Speed 1990), the value of the response variable that would be achieved, if perhaps contrary to fact, the patient had been assigned to…”
BackgroundModel Selection, Confounder Control, and Marginal Structural Models: Review and New Applications
Joffe, M. M., Ten Have, T. R., Feldman, H. I., & Kimmel, S. E. (2004) · The American Statistician · doi:10.1198/000313004x5824 · Cited by 266
“The potential outcomes approach to causality defines the effect of an intervention (e.g., treatment or exposure) as a comparison of what would happen to some individual or group under different treatment or exposure conditions (Rubin 1974).”
BackgroundChain Graph Models and their Causal Interpretations
Lauritzen, S. L., & Richardson, T. S. (2002) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00340 · Cited by 265
Effect Analysis and Causation in Linear Structural Equation Models
Sobel, M. E. (1990) · Psychometrika · doi:10.1007/bf02294763 · Cited by 264
Does knowledge diffusion between university and industry increase innovativeness?
Lööf, H., & Broström, A. (2008) · The Journal of Technology Transfer · doi:10.1007/s10961-006-9001-3 · Cited by 264
“Rosenbaum and Rubin (1983) prove that given that the Y0 outcomes are independent of collaboration participation conditional on X, they are also independent of participation conditional on the propensity score, Pr(U=1|X).”
BackgroundMethodCausal Inference in Infectious Diseases
Halloran, M. E., & Struchiner, C. J. (1995) · Epidemiology · doi:10.1097/00001648-199503000-00010 · Cited by 263
Commitments to Save: A Field Experiment in Rural Malawi
Brune, L., Giné, X., Goldberg, J., & Yang, D. (2011) · doi:10.1596/1813-9450-5748 · Cited by 257
“It is plausible that members without accounts are influenced by the training script itself or by members who do open accounts in the same club, either of which would violate SUTVA (Rubin, 1974).”
BackgroundCustomer Acquisition via Display Advertising Using Multi-Armed Bandit Experiments
Schwartz, E. M., Bradlow, E. T., & Fader, P. S. (2017) · Marketing Science · doi:10.1287/mksc.2016.1023 · Cited by 260
Socially Responsible AI Algorithms: Issues, Purposes, and Challenges
Cheng, L., Varshney, K. R., & Liu, H. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12814 · Cited by 261
Cook, T. D. (2002) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737024003175 · Cited by 257
“Control groups generated through random assignment provide the best counterfactual to describe what would have happened to students in a treatment group if they had not been exposed to the treatment (Rubin, 1974; Holland, 1986).”
BackgroundSeeking Causal Explanations in Social Epidemiology
Kaufman, J. S., & Cooper, R. S. (1999) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a009969 · Cited by 256
“We noted above that this has been referred to as "ignorability" of the exposure assignment (11), but it is also related to what Rubin described as the "stability assumption" (10, 26).”
BackgroundInfluentialMcNamee, R. (2003) · Occupational and Environmental Medicine · doi:10.1136/oem.60.3.227 · Cited by 253
MacKinnon, D. P., & Pirlott, A. G. (2015) · Personality and Social Psychology Review · doi:10.1177/1088868314542878 · Cited by 255
“So randomization enables causal interpretation of the a coefficient (the relation between X and M) and c coefficient (the total relation between X and Y), as noted by Holland (1988) in the application of the counterfactual approaches to mediation (Rubin, 1974; Sobel, 2008).”
BackgroundPropensity score weighting with multilevel data
Li, F., Zaslavsky, A. M., & Landrum, M. B. (2013) · Statistics in Medicine · doi:10.1002/sim.5786 · Cited by 256
The Importance of Replication in Wildlife Research
Johnson, D. H. (2002) · The Journal of Wildlife Management · doi:10.2307/3802926 · Cited by 256
When Can History Be Our Guide? The Pitfalls of Counterfactual Inference
KING, G., & ZENG, L. (2007) · International Studies Quarterly · doi:10.1111/j.1468-2478.2007.00445.x · Cited by 256
Causal inference in economics and marketing
Varian, H. R. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1510479113 · Cited by 254
The high cost of medical care for patients who present late (CD4<200 cells/μL) with HIV infection
Krentz, H., Auld, M., & Gill, M. (2004) · HIV Medicine · doi:10.1111/j.1468-1293.2004.00193.x · Cited by 254
Leyrat, C., Seaman, S. R., White, I. R., Douglas, I., Smeeth, L., Kim, J., Resche-Rigon, M., Carpenter, J. R., & Williamson, E. J. (2019) · Statistical Methods in Medical Research · doi:10.1177/0962280217713032 · Cited by 249
“The PS approach is best understood using the potential outcomes framework [27], in which the causal effect of the treatment is defined as the difference between the two potential outcomes Y Z=0 and Y , which are the outcomes that would have been observed if an individual had been not treated and treated, respectively…”
BackgroundGreen, D. P., & Kern, H. L. (2012) · Public Opinion Quarterly · doi:10.1093/poq/nfs036 · Cited by 250
Beyond Subjective and Objective in Statistics
Gelman, A., & Hennig, C. (2017) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/rssa.12276 · Cited by 250
Firearm Violence Exposure and Serious Violent Behavior
Bingenheimer, J. B., Brennan, R. T., & Earls, F. J. (2005) · Science · doi:10.1126/science.1110096 · Cited by 245
Propensity Score Matching in Criminology and Criminal Justice
Apel, R. J., & Sweeten, G. (2010) · Handbook of Quantitative Criminology · doi:10.1007/978-0-387-77650-7_26 · Cited by 241
“An understanding of propensity score matching is aided by familiarity with the language and logic of counterfactual estimation, known also as the analysis of potential outcomes (see Rubin 1974, 1977 ).”
BackgroundThe Causal Effects of Rural-to-Urban Migration on Children’s Well-being in China
Xu, H., & Xie, Y. (2015) · European Sociological Review · doi:10.1093/esr/jcv009 · Cited by 245
Causal inference based on counterfactuals
Höfler, M. (2005) · BMC Medical Research Methodology · doi:10.1186/1471-2288-5-28 · Cited by 245
Mensah, J., Oppong, J. R., & Schmidt, C. M. (2010) · Health Economics · doi:10.1002/hec.1633 · Cited by 242
Causal Inference About the Effects of Interventions From Observational Studies in Medical Journals
Dahabreh, I. J., & Bibbins-Domingo, K. (2024) · JAMA · doi:10.1001/jama.2024.7741 · Cited by 242
From association to causation: some remarks on the history of statistics
Freedman, D. (1999) · Statistical Science · doi:10.1214/ss/1009212409 · Cited by 242
Long-run labour market and health effects of individual sports activities
Lechner, M. (2009) · Journal of Health Economics · doi:10.1016/j.jhealeco.2009.05.003 · Cited by 241
“This is called the problem of ‘selection bias’ in the econometric literature (see Heckman et al., 1999), and ‘confounding’ in the statistical literature (e.g., Rubin, 1974).”
BackgroundRobins, J. M., Greenland, S., & Hu, F.-C. (1999) · Journal of the American Statistical Association · doi:10.1080/01621459.1999.10474168 · Cited by 242
A randomized controlled trial of different policing strategies at hot spots of violent crime
Taylor, B., Koper, C. S., & Woods, D. J. (2011) · Journal of Experimental Criminology · doi:10.1007/s11292-010-9120-6 · Cited by 240
“RCTs provide the best counterfactual describing what would have happened to the treatment group if it had not been exposed to the treatment (Rubin 1974; Holland 1986).”
BackgroundA Penalized Synthetic Control Estimator for Disaggregated Data
Abadie, A., & L’Hour, J. (2021) · Journal of the American Statistical Association · doi:10.1080/01621459.2021.1971535 · Cited by 238
“Starting with LaLonde (1986), many studies have used data from the National Supported Work Demonstration (NSW) to demonstrate the applicability and performance of alternative estimators of treatment effects (see, e.g., Dehejia and Wahba 2002; Smith and Todd 2005; Abadie and Imbens 2011).”
MethodNonparametric IV estimation of local average treatment effects with covariates
Frölich, M. (2007) · Journal of Econometrics · doi:10.1016/j.jeconom.2006.06.004 · Cited by 239
PALER, L. (2013) · American Political Science Review · doi:10.1017/s0003055413000415 · Cited by 237
Instrumental Variables in Sociology and the Social Sciences
Bollen, K. A. (2012) · Annual Review of Sociology · doi:10.1146/annurev-soc-081309-150141 · Cited by 235
Nonparametric Tests for Treatment Effect Heterogeneity
Crump, R. K., Hotz, V. J., Imbens, G. W., & Mitnik, O. A. (2008) · Review of Economics and Statistics · doi:10.1162/rest.90.3.389 · Cited by 235
Does eco-certification have environmental benefits? Organic coffee in Costa Rica
Blackman, A., & Naranjo, M. A. (2012) · Ecological Economics · doi:10.1016/j.ecolecon.2012.08.001 · Cited by 234
Impact of Village Savings and Loan Associations: Evidence from a cluster randomized trial
Ksoll, C., Lilleør, H. B., Lønborg, J. H., & Rasmussen, O. D. (2016) · Journal of Development Economics · doi:10.1016/j.jdeveco.2015.12.003 · Cited by 234
When physics meets machine learning: a survey of physics-informed machine learning
Meng, C., Griesemer, S., Cao, D., Seo, S., & Liu, Y. (2025) · Machine Learning for Computational Science and Engineering · doi:10.1007/s44379-025-00016-0 · Cited by 222
“[66–68] introduce the problem and provide a mathematical framework for causal reasoning and inference under causal graphical models (also known as Bayesian networks (BN) [69]).”
Little, R. J., & Yau, L. H. Y. (1998) · Psychological Methods · doi:10.1037//1082-989x.3.2.147 · Cited by 234
A Potential Outcomes View of Value-Added Assessment in Education
Rubin, D. B., Stuart, E. A., & Zanutto, E. L. (2004) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986029001103 · Cited by 233
“In this discussion we approach value-added assessment from a “potential outcomes” (Rubin Causal Model, RCM) point of view (Rubin 1974, 1978, 2003; Holland 1986; Little and Rubin 2001), with the goal of clarifying the estimation goals and understanding the limitations of data for the types of…”
BackgroundMethodInfluentialSelf-citationA Distributional Approach for Causal Inference Using Propensity Scores
Tan, Z. (2006) · Journal of the American Statistical Association · doi:10.1198/016214506000000023 · Cited by 232
“The two variables are called potential outcomes (Neyman 1923; Rubin 1974).”
BackgroundCausal Models and Learning from Data: Integrating Causal Modeling and Statistical Estimation
Petersen, M. L., & van der Laan, M. J. (2014) · Epidemiology · doi:10.1097/ede.0000000000000078 · Cited by 231
konfound: Command to quantify robustness of causal inferences
Xu, R., Frank, K. A., Maroulis, S. J., & Rosenberg, J. M. (2019) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x19874223 · Cited by 223
“These replacement cases can come from counterfactual data as in Rubin’s causal model (Rubin 1974) or from a population from which observed cases were not sampled.”
Influence Diagrams for Causal Modelling and Inference
Dawid, A. P. (2002) · International Statistical Review · doi:10.1111/j.1751-5823.2002.tb00354.x · Cited by 230
3. The Foundations of Causal Inference
Pearl, J. (2010) · Sociological Methodology · doi:10.1111/j.1467-9531.2010.01228.x · Cited by 228
“How do we recognize causal expressions in the social science literature? Those versed in the potential-outcome notation (Neyman 1923; Rubin 1974; Holland 1988; Sobel 1996) can recognize such expressions through the subscripts that are attached to counterfactual events and variables—for example, Yx(u) or Zxy.”
BackgroundCausal inference and developmental psychology.
Foster, E. M. (2010) · Developmental Psychology · doi:10.1037/a0020204 · Cited by 227
“My assessment is that the clearest and most influential (re)statement of these ideas can be found in Rubin (1974, 1975).”
BackgroundSpreeuwenberg, M. D., Bartak, A., Croon, M. A., Hagenaars, J. A., Busschbach, J. J. V., Andrea, H., Twisk, J., & Stijnen, T. (2010) · Medical Care · doi:10.1097/mlr.0b013e3181c1328f · Cited by 227
“All variables with a P value smaller than 0.10 were selected for the estimation of the multiple PS.”
BackgroundInfluentialThe Case Study: What it is and What it Does
Gerring, J. (2009) · The Oxford Handbook of Comparative Politics · doi:10.1093/oxfordhb/9780199566020.003.0004 · Cited by 189
Outcome-Adaptive Lasso: Variable Selection for Causal Inference
Shortreed, S. M., & Ertefaie, A. (2017) · Biometrics · doi:10.1111/biom.12679 · Cited by 221
“Methodological advances have improved analytic methods for constructing unbiased treatment effect estimates from observational data (Rubin, 1973, 1974; Robins, 1986; Hernan and Robins, 2006).”
MethodRohrer, J. M., & Murayama, K. (2023) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459221140842 · Cited by 216
“In the potential-outcomes framework (Holland, 1986; Rubin, 1974), individual causal effects are defined as differences in potential values of an outcome variable (Y) under different treatments (A).”
BackgroundMatching Methods in Practice: Three Examples
Imbens, G. (2014) · National Bureau of Economic Research · doi:10.3386/w19959 · Cited by 223
Interventions and Causal Inference
Eberhardt, F., & Scheines, R. (2007) · Philosophy of Science · doi:10.1086/525638 · Cited by 220
“Frederick Eberhardt1 Department of Philosophy and Richard Scheines Carnegie Mellon University”
BackgroundBrookhart, M. A., & Schneeweiss, S. (2007) · The International Journal of Biostatistics · doi:10.2202/1557-4679.1072 · Cited by 222
Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyond
Feder, A., Keith, K. A., Manzoor, E., Pryzant, R., Sridhar, D., Wood-Doughty, Z., Eisenstein, J., Grimmer, J., Reichart, R., Roberts, M. E., et al. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00511 · Cited by 220
“CATEs are used to quantify the heterogeneity of causal effects in different population subgroups.”
BackgroundInfluentialDoes water kill? A call for less casual causal inferences
Hernán, M. A. (2016) · Annals of Epidemiology · doi:10.1016/j.annepidem.2016.08.016 · Cited by 219
“The interventions a can also be classified as (1) infeasible or (2) feasible.”
BackgroundRacial Diversity and Judicial Influence on Appellate Courts
Kastellec, J. P. (2013) · American Journal of Political Science · doi:10.1111/j.1540-5907.2012.00618.x · Cited by 216
Liu, Y., Ruiz-Menjivar, J., Zhang, L., Zhang, J., & Swisher, M. E. (2019) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2019.04.026 · Cited by 212
Assumptions of IV Methods for Observational Epidemiology.
Didelez, V., Meng, S., & Sheehan, N. A. (2010) · Statistical Science · doi:10.1214/09-sts316 · Cited by 214
Instrumental Variables: An Econometrician’s Perspective
Imbens, G. W. (2014) · Statistical Science · doi:10.1214/14-sts480 · Cited by 211
“(starting with Imbens and Angrist, 1994; Angrist, Imbens and Rubin, 1996; Heckman, 1990; Manski, 1990; and Robins, 1986) explicitly uses the potential outcome framework used by Neyman for randomized experiments and generalized to observational studies by Rubin (1974, 1978, 1990).”
BackgroundMethodInfluential2 Education as a lifelong process
Blossfeld, H.-P., & von Maurice, J. (2011) · Zeitschrift für Erziehungswissenschaft · doi:10.1007/s11618-011-0179-2 · Cited by 216
““establishing the causes of effects,” Holland (1986, 1988) and Rubin (1974, 1978, 1980) are concerned with “establishing the effects of causes.” They make clear that it is more to the point to take causes simply as given, and to concentrate on the question of how their effects can be measured securely.”
BackgroundOpium for the Masses: How Foreign Media Can Stabilize Authoritarian Regimes
Kern, H. L., & Hainmueller, J. (2009) · Political Analysis · doi:10.1093/pan/mpp017 · Cited by 216
“We exploit formerly classified survey data and a natural experiment to identify the effect of foreign media exposure using instrumental variable estimators.”
Bridging the Evidence Gap in Obesity Prevention: A Framework to Inform Decision Making
(2010) · PsycEXTRA Dataset · doi:10.1037/e549902010-001 · Cited by 216
Identifiability of path-specific effects
Avin, C., Shpitser, I., & Pearl, J. (2005) · eScholarship (California Digital Library) · Cited by 436
Mobile Phone Coverage and Producer Markets: Evidence from West Africa
Aker, J. C., & Fafchamps, M. (2015) · The World Bank Economic Review · doi:10.1093/wber/lhu006 · Cited by 211
Heterogeneity and Causality: Unit Heterogeneity and Design Sensitivity in Observational Studies
Rosenbaum, P. R. (2005) · The American Statistician · doi:10.1198/000313005x42831 · Cited by 213
“Subject (i, j) has two potential responses, (rTij , rCij), with rTij observed under treatment, Zij = 1, and rCij observed under control, Zij = 0, so the effect of the treatment on (i, j) is rTij − rCij ; see Neyman (1923) and Rubin (1974).”
BackgroundSimulation-Based Sensitivity Analysis for Matching Estimators
Nannicini, T. (2007) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0700700303 · Cited by 212
tmle: An R Package for Targeted Maximum Likelihood Estimation
Gruber, S., & Laan, M. J. V. D. (2012) · Journal of Statistical Software · doi:10.18637/jss.v051.i13 · Cited by 211
“The idea of viewing the efficient influence curve as a path instead of an estimating equation was presented in the seminal article by van der Laan and Rubin (2006), and allows TMLE to be applied to estimate parameters where no estimating equation solution exists.”
BackgroundMethodInfluentialThe Target Trial Framework for Causal Inference From Observational Data: Why and When Is It Helpful?
Hernán, M. A., Dahabreh, I. J., Dickerman, B. A., & Swanson, S. A. (2025) · Annals of Internal Medicine · doi:10.7326/annals-24-01871 · Cited by 202
Estimating causal effects: considering three alternatives to difference-in-differences estimation
O’Neill, S., Kreif, N., Grieve, R., Sutton, M., & Sekhon, J. S. (2016) · Health Services and Outcomes Research Methodology · doi:10.1007/s10742-016-0146-8 · Cited by 210
“Throughout we use the potential outcomes framework (Rubin 1974).”
MethodInstrumental variables methods in experimental criminological research: what, why and how
Angrist, J. D. (2006) · Journal of Experimental Criminology · doi:10.1007/s11292-005-5126-x · Cited by 208
“Treatment migration and treatment dilution are features of one of the most influential randomized trials in criminological research, the Minneapolis domestic violence experiment (MDVE), discussed in Sherman and Berk (1984) and Berk and Sherman (1988).”
BackgroundVolunteering, subjective well-being and public policy
Binder, M., & Freytag, A. (2013) · Journal of Economic Psychology · doi:10.1016/j.joep.2012.11.008 · Cited by 209
Extending inferences from a randomized trial to a new target population
Dahabreh, I. J., Robertson, S. E., Steingrimsson, J. A., Stuart, E. A., & Hernán, M. A. (2020) · Statistics in Medicine · doi:10.1002/sim.8426 · Cited by 208
“We use the random variablesY a to denote the potential (counterfactual) outcomes under intervention to set treatment to a , possibly contrary to fact [23, 24].”
MethodThe Renaissance of Field Experimentation in Evaluating Interventions
Shadish, W. R., & Cook, T. D. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.60.110707.163544 · Cited by 208
Bias in Large Language Models: Origin, Evaluation, and Mitigation
Guo, Y., Guo, M., Su, J., Yang, Z., Zhu, M., Li, H., Qiu, M., & Liu, S. S. (2024) · arXiv · doi:10.48550/arxiv.2411.10915 · Cited by 208
“Addressing these statistical biases requires a range of mitigation strategies, including robust causal inference framework Rubin (1974).”
Metadata
- Authors
- Rubin, D. B.
- Affiliations
- Educational Testing Service (US)
- Corresponding author
- Rubin, Donald B.
- ORCID
- Rubin, Donald B.
- Venue
- Journal of Educational Psychology
- Published
- 1974-10
- Volume
- 66
- Issue
- 5
- Pages
- 688-701
- ISSN
- 0022-0663 (ISSN-L)
- 1939-2176
- OpenAlex
- W2132917208
- Cited by
- 9,436
- References
- 10
- Citations by year
- 2026: 490 · 2025: 658 · 2024: 612 · 2023: 587 · 2022: 589 · 2021: 636 · 2020: 625 · 2019: 554 · 2018: 493 · 2017: 389 · 2016: 370 · 2015: 382 · 2014: 406 · 2013: 343 · 2012: 325
- FWCI
- 2.83
- Type
- journal article
- Language
- en
- Open access
- green
- nrs.harvard.edu
- Licence
- cc-by
- Locations
- Journal of Educational Psychology (publishedVersion)
- Digital Access to Scholarship at Harvard (DASH) (Harvard University) (submittedVersion, cc-by)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Education › Educational Research and Methods
- Keywords
- causal effect estimation, randomization, non-randomized studies, matching, random sampling, treatment effects, observational studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.