Estimating causal effects of treatments in randomized and nonrandomized studies
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Presents a discussion of matching, randomization, random sampling, and other methods of controlling extraneous variation. The objective was to specify the benefits of randomization in estimating causal effects of treatments. It is concluded that randomization should be employed whenever possible but that the use of carefully controlled nonrandomized data to estimate causal effects is a reasonable and necessary procedure in many cases.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“That work argues models may memorize variable names but lack knowledge of the underlying observational distributions ( P ( X,Y ) ) required to identify traps like confounding (Rubin, 1974).”
From Diagnosing and Mitigating Sycophancy and Skepticism in LLM Causal Judgment (2026) · cites this paper as Rubin, 1974
In the citing paper
“Specifically, the assumption that a subunit’s own output or outcomes are not affected by any other unit’s implementation assignment (what is called SUTVA (99)) is invalid, as interactions and synergistic effects underlie many of our implementation strategies.”
From An Overview of Research and Evaluation Designs for Dissemination and Implementation (2017) · cites this paper as [99]
Citations
Cites
Statistical Methods for Research Workers
(1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,880
(2001) · Empirical Direction in Design and Analysis · doi:10.4324/9781410600004-24 · Cited by 6,808
SCHEFFE, H. (1960) · Soil Science · doi:10.1097/00010694-196006000-00016 · Cited by 5,516
Testing Statistical Hypotheses
(2021) · Wiley Series in Probability and Statistics · doi:10.1002/9781119243830.ch12 · Cited by 5,106
Design and Analysis of Experiments
(2007) · Modern Engineering Statistics · doi:10.1002/9780470187548.ch12 · Cited by 1,424
Controlling Bias in Observational Studies: A Review
Cochran, W. G. (2006) · Matched Sampling for Causal Effects · doi:10.1017/cbo9780511810725.005 · Cited by 958 · cited 1×
“Recent work on methods of reducing bias in nonrandomized studies is summarized in Cochran and Rubin (1974).”
MethodThe University Group Diabetes Program. A further statistical analysis of the mortality findings
Cornfield, J. (1971) · JAMA · doi:10.1001/jama.217.12.1676 · Cited by 119
University Group Diabetes Program
Smelo, L. S. (1971) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1971.03180260057027 · Cited by 115
Design and Analysis of Industrial Experiments.
E., R. T., & Davies, O. L. (1954) · OR · doi:10.2307/3007149 · Cited by 111
Statistics: A Guide to the Unknown.
Pine, V. R., Tanur, J. M., Mosteller, F. C., Kruskal, W., Link, R. F., Pieters, R. S., & Rising, G. R. (1974) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2062882 · Cited by 89
Cited by
Items 1,001–1,074 of 1,074
Harder, V. S., Stuart, E. A., & Anthony, J. C. (2008) · American Journal of Epidemiology · doi:10.1093/aje/kwn184 · Cited by 76
“In practice, these standard statistical approaches may be suboptimal and may lead to ill-founded causal inferences (15, 16).”
BackgroundCastleman, B. L., Arnold, K., & Wartman, K. L. (2012) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2011.618214 · Cited by 73
“Having confirmed that random assignment was effective, we can proceed to specifying a model for the average treatment effect (αATE) of the intervention (Rubin, 1974).”
BackgroundImputation approaches for potential outcomes in causal inference
Westreich, D., Edwards, J. K., Cole, S. R., Platt, R. W., Mumford, S. L., & Schisterman, E. F. (2015) · International Journal of Epidemiology · doi:10.1093/ije/dyv135 · Cited by 64
“The fundamental problem of causal inference, and thus of analytical epidemiology, is therefore one of missing data, or the inability to observe all but one potential outcome.(4,5) Yet, when epidemiologists analyse data for the purposes of causal inference, in the absence of explicitly missing data they typically do no…”
BackgroundThe Effectiveness of Private Voucher Education: Evidence From Structural School Switches
Lara, B., Mizala, A., & Repetto, A. (2011) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373711402990 · Cited by 72
“As in the usual Rubin model (Rubin, 1974), we only observe: ) 1 ( 0 1 i i i i i D Y D Y Y − ⋅ + ⋅ = where Y i = Observed post-treatment outcome for individual i.”
MethodScott-Clayton, J., & Minaya, V. (2016) · Economics of Education Review · doi:10.1016/j.econedurev.2015.06.006 · Cited by 72
A serious game for children with Attention Deficit Hyperactivity Disorder: Who benefits the most?
Bul, K. C. M., Doove, L. L., Franken, I. H. A., Oord, S. V. D., Kato, P. M., & Maras, A. (2018) · PLOS ONE · doi:10.1371/journal.pone.0193681 · Cited by 71
Analyzing data from single-case alternating treatments designs.
Manolov, R., & Onghena, P. (2018) · Psychological Methods · doi:10.1037/met0000133 · Cited by 70
Chen, Y., Lee, J.-Y., Sridhar, S. (., Mittal, V., McCallister, K., & Singal, A. G. (2020) · Journal of Marketing · doi:10.1177/0022242920913025 · Cited by 70
“Following the potential outcome framework (Rubin 1974), for each patient i, there are two potential outcomes: if a patient is assigned to the treatment condition, we observe the outcome Yi ¼ Yi1, and if the patient is assigned to the control condition, we observe Yi ¼ Yi0.”
MethodQuantifying the Causal Effect of Individual Mobility on Health Status in Urban Space
Zhang, Y., Xu, F., Xia, T., & Li, Y. (2021) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3494990 · Cited by 68
“However, it is always impossible to observe all potential outcomes for a given individual [63].”
BackgroundMethodVandenbroucke, J., & Pearce, N. (2015) · American Journal of Epidemiology · doi:10.1093/aje/kwv225 · Cited by 67
“2015;182(10):826–833 American Journal of Epidemiology © The Author 2015.”
BackgroundFinancial inclusion and welfare in South Africa: Is there a gender gap?
Nanziri, E. L. (2016) · Journal of African Development · doi:10.5325/jafrideve.18.2.0109 · Cited by 65
Causal Reasoning from Longitudinal Data*
Arjas, E., & Parner, J. (2004) · Scandinavian Journal of Statistics · doi:10.1111/j.1467-9469.2004.02-134.x · Cited by 65
“In the field of medical statistics a framework called the Rubin causal model (Rubin, 1974, 1978; Holland, 1986), based upon ideas of Neyman (1923), has gained popularity.”
BackgroundPanel Experiments and Dynamic Causal Effects: A Finite Population Perspective
Bojinov, I., Rambachan, A., & Shephard, N. (2021) · Quantitative Economics · doi:10.3982/qe1744 · Cited by 60
“Combining this assumption with a further requirement that every unit receives the same version of the treatment is often referred to as the “Stable Unit Treatment Value Assumption,” in cross-sectional applications (Rubin, 1980) or the “Temporal Stable Unit Treatment Value Assumption” in time series experiments (Bojino…”
MethodMohatt, G. V., Fok, C. C. T., Henry, D., & Allen, J. (2014) · American Journal of Community Psychology · doi:10.1007/s10464-014-9646-2 · Cited by 59
“This Stable Unit Treatment Value Assumption (SUTVA; Rubin 1974) is violated in multisite CBPR studies when each community can design local intervention.”
Bonhomme, S., & Sauder, U. (2011) · Review of Economics and Statistics · doi:10.1162/rest_a_00164 · Cited by 58
“Following Rubin (1974) and Heckman (1990), we adopt the potential outcome framework and denote as Y 0i2 the second period outcome that individual i would have had in the absence of the treatment.”
MethodEffectiveness of Localized Lockdowns in the COVID-19 Pandemic
Li, Y., Undurraga, E. A., & Zubizarreta, J. R. (2020) · doi:10.1101/2020.08.25.20182071 · Cited by 58
“Based on the potential outcomes framework for causal inference (23, 24), we used the 70 augmented synthetic control method to analyze the progression of the epidemic in comparable municipalities that underwent different lockdown interventions (25, 26), varying the duration of the intervention (∆D) and the proportion o…”
MethodCausal Analysis in the Health Sciences
Greenland, S. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10473924 · Cited by 61
Koper, C. S., Taylor, B. G., & Woods, D. J. (2013) · Journal of Experimental Criminology · doi:10.1007/s11292-012-9170-z · Cited by 56
“Hence, randomized experiments provide the best counterfactual describing what would have happened to the treatment group if it had not been exposed to the treatment (Rubin 1974; Holland 1986).”
Cheung, Y. K., Chakraborty, B., & Davidson, K. W. (2015) · Biometrics · doi:10.1111/biom.12258 · Cited by 55
Does incarceration length affect labor market outcomes?
Landersø, R. (2015) · The Journal of Law and Economics · doi:10.1086/682911 · Cited by 53
“I assess this treatment effect following the terminology first introduced by Rubin (1974), expanded by Rosenbaum and Rubin (1983), and adopted by the general treatment literature and define the treatment effect on the treated group conditional on observable characteristics as d dATT = |”
MethodAssessing ‘what works’ in international development: meta-analysis for sophisticated dummies
Duvendack, M., Hombrados, J. G., Palmer-Jones, R., & Waddington, H. (2012) · Journal of Development Effectiveness · doi:10.1080/19439342.2012.710642 · Cited by 52
Capitalism and Freedom: Manumissions and the Slave Market in Louisiana, 1725–1820
COLE, S. (2005) · The Journal of Economic History · doi:10.1017/s0022050705000380 · Cited by 50
Causal models for longitudinal and panel data: a survey
Arkhangelsky, D., & Imbens, G. (2024) · The Econometrics Journal · doi:10.1093/ectj/utae014 · Cited by 50
Design and Analysis of Experiments in Networks: Reducing Bias from Interference
Eckles, D., Karrer, B., & Ugander, J. (2017) · Journal of Causal Inference · doi:10.1515/jci-2015-0021 · Cited by 49
Lee, A., Inceoglu, I., Hauser, O., & Greene, M. (2022) · The Leadership Quarterly · doi:10.1016/j.leaqua.2020.101426 · Cited by 48
A decision support framework to implement optimal personalized marketing interventions
Guelman, L., Guillén, M., & Pérez-Marín, A. M. (2015) · Decision Support Systems · doi:10.1016/j.dss.2015.01.010 · Cited by 48
Sunlight: Fine-grained Targeting Detection at Scale with Statistical Confidence
Lecuyer, M., Spahn, R., Spiliopolous, Y., Chaintreau, A., Geambasu, R., & Hsu, D. (2015) · Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2810103.2813614 · Cited by 48
Do Agile Managed Information Systems Projects Fail Due to a Lack of Emotional Intelligence?
Luong, T. T., Sivarajah, U., & Weerakkody, V. (2021) · Information Systems Frontiers · doi:10.1007/s10796-019-09962-6 · Cited by 45
“A framework for quasi-experimentation has first been formalized by Rubin (1974).”
MethodA Framework for Separating Individual-Level Treatment Effects From Spillover Effects
Huber, M., & Steinmayr, A. (2021) · Journal of Business & Economic Statistics · doi:10.1080/07350015.2019.1668795 · Cited by 42
“Using the potential outcome notation, see, for instance, Rubin (1974), let Di,k(z1, . . . , zR) denote the potential individual treatment state of subject i in region k when setting intensities Z in regions 1 to R to the respective values z1, . . . , zR.”
BackgroundScreening Experiments for Developing Dynamic Treatment Regimes
Murphy, S. A., & Bingham, D. (2009) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.0119 · Cited by 41
“Observational analyses attempt to infer causal relations from nonrandomized comparisons and are subject to bias when the compared groups differ in ways other than by type of treatment (Rubin 1974, 1978).”
BackgroundPropensity Score Matching for Education Data: Worked Examples
Powell, M. G., Hull, D. M., & Beaujean, A. A. (2020) · The Journal of Experimental Education · doi:10.1080/00220973.2018.1541850 · Cited by 40
“Department of Education (2016). Because the IES views propensity scores favorably, it is only a matter of time before intervention studies begin using them, which will then require education researchers to be able to inter-”
BackgroundKim, J. Y., Bartholomew, K., & Ewing, R. (2020) · Transportation Research Part A: Policy and Practice · doi:10.1016/j.tra.2020.03.019 · Cited by 37
Cerdá, M., DiGangi, J., Galea, S., & Koenen, K. (2012) · Depression and Anxiety · doi:10.1002/da.21947 · Cited by 34
“Departing from a potential outcomes framework, which considers the potential outcome an individual would have obtained if, contrary to fact, he/she had not been exposed to violence,[102, 103] the validity of a natural experiment relies on a set of assumptions: (1) the exogenous assignment to change in violence is igno…”
BackgroundThe impact of e-procurement on institutional quality
Mélon, L., & Spruk, R. (2020) · Journal of Public Procurement · doi:10.1108/jopp-07-2019-0050 · Cited by 33
What was lost? A causal estimate of fourth down behavior in the National Football League
Yam, D. R., & Lopez, M. J. (2019) · Journal of Sports Analytics · doi:10.3233/jsa-190294 · Cited by 33
“Statistically, this conundrum is known as the fundamental problem of causal inference, as we are missing the fourth down outcome that isn’t observed (Rubin, 1974).”
BackgroundApproaches to addressing missing values, measurement error, and confounding in epidemiologic studies
van Smeden, M., Penning de Vries, B. B. L., Nab, L., & Groenwold, R. H. H. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.11.006 · Cited by 32
(2014) · RePEc: Research Papers in Economics · Cited by 30
Not All Clinical AI Monitoring Systems Are Created Equal: Review and Recommendations
Feng, J., Xia, F., Singh, K., & Pirracchio, R. (2025) · NEJM AI · doi:10.1056/aira2400657 · Cited by 28
Optimal multilevel matching using network flows: An application to a summer reading intervention
Pimentel, S. D., Page, L. C., Lenard, M., & Keele, L. (2018) · The Annals of Applied Statistics · doi:10.1214/17-aoas1118 · Cited by 26
“Zubizarreta, J. R. and Keele, L. (2016). Optimal Multilevel Matching in Clustered Observational Studies: A Case Study of the Effectiveness of Private Schools Under a Large-Scale Voucher System.”
BackgroundMethodInfluentialOn the uses and abuses of regression models: a call for reform of statistical practice and teaching
Carlin, J. B., & Moreno-Betancur, M. (2023) · arXiv · doi:10.48550/arxiv.2309.06668 · Cited by 26
Aldridge, A., Dowd, W., & Bray, J. (2017) · Addiction · doi:10.1111/add.13653 · Cited by 25
“potential outcomes of the patient with respect to observed covariates [15].”
BackgroundNagengast, B., Brisson, B. M., Hulleman, C. S., Gaspard, H., Häfner, I., & Trautwein, U. (2018) · The Journal of Experimental Education · doi:10.1080/00220973.2017.1289359 · Cited by 24
“The identification of CACEs was formalized by Angrist et al. (1996) in a counterfactual model of causal effects (Rubin, 1974).”
MethodInvestigating Treatment Mediators When Simple Random Assignment to a Control Group is Not Possible.
Doss, B. D., & Atkins, D. C. (2006) · Clinical Psychology: Science and Practice · doi:10.1111/j.1468-2850.2006.00045.x · Cited by 24
Carbon Abatement and Leakage in China's Regional Carbon Emission Trading
Jiang, J., Ye, B., Zeng, Z., Yang, X., Sun, Z., Shao, S., Feng, K., & Tan, X. (2024) · Environmental Science & Technology · doi:10.1021/acs.est.4c04738 · Cited by 23
Laska, E. M., Siegel, C. E., Lin, Z., Bogenschutz, M., & Marmar, C. R. (2020) · Alcoholism: Clinical and Experimental Research · doi:10.1111/acer.14414 · Cited by 23
“We employ a potential outcome framework (Neyman, 1923; Rubin 1974, 2005; Imbens and Rubin, 2015) which starts with the premise that a causal effect is based on a comparison of an individual’s potential outcomes from receiving a treatment and a control.”
MethodKane, M. J., Core, T. J., & Hunt, R. R. (2010) · Psychonomic Bulletin & Review · doi:10.3758/pbr.17.2.206 · Cited by 23
“change results from maturation, senescence, laboratory experimental manipulations, psychotherapeutic techniques, community interventions, or educational programs (see, e.g., Cronbach & Furby, 1970; Hertzog & Nesselroade, 2003; Lord, 1956, 1967; Nesselroade, Stigler, & Baltes, 1980; Rubin, 1974).”
Mayer, A., Zimmermann, J., Hoyer, J., Salzer, S., Wiltink, J., Leibing, E., & Leichsenring, F. (2020) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2019.1671196 · Cited by 21
Social-Science Genomics: Progress, Challenges, and Future Directions
Benjamin, D., Cesarini, D., Turley, P., & Young, A. S. (2024) · doi:10.3386/w32404 · Cited by 20
Too unwell to trust? The effect of mental health on social trust in Europe
Roychowdhury, P. (2021) · Economics & Human Biology · doi:10.1016/j.ehb.2021.101021 · Cited by 18
“Consider the potential outcomes framework (see for example, Neyman, 1923; Fisher, 1935; Roy, 1951; Rubin, 1974).”
BackgroundFlournoy, J. C., Pfeifer, J. H., Moore, W. E., Tackman, A. M., Masten, C. L., Mazziotta, J. C., Iacoboni, M., & Dapretto, M. (2016) · Child Development · doi:10.1111/cdev.12630 · Cited by 18
A systems framework for remedying dysfunction in US democracy
Wang, S. S.-H., Cervas, J., Grofman, B., & Lipsitz, K. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2102154118 · Cited by 16
“This addresses a “fun660 damental problem of causal inference” (90, 91) in observational 661 studies; the inability to test the efficacy of programs under 662”
BackgroundEstimating Treatment Effects: Matching Quantification to the Question
Loughran, T. A., & Mulvey, E. P. (2010) · Handbook of Quantitative Criminology · doi:10.1007/978-0-387-77650-7_9 · Cited by 16
Blinding and expectancy confounds in psychedelic randomised controlled trials
Muthukumaraswamy, S., Forsyth, A., & Lumley, T. (2021) · doi:10.31234/osf.io/q2hzm · Cited by 15
Ticagrelor vs prasugrel for acute coronary syndrome in routine care
Krüger, N., Krefting, J., Kessler, T., Schmieder, R., Starnecker, F., Dutsch, A., Graesser, C., Meyer-Lindemann, U., Storz, T., Pugach, I., et al. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.48389 · Cited by 14
Furia, C. A., Torkar, R., & Feldt, R. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3611667 · Cited by 14
“A notable example is the potential outcomes framework [51], also referred to as the Neyman-Rubin causal model.”
BackgroundThe Experimentalist Looks Within: Toward an Understanding of Within-Subject Experimental Designs
List, J. (2025) · doi:10.3386/w33456 · Cited by 12
Patterns of Effects and Sensitivity Analysis for Differences-in-Differences
Keele, L. J., Small, D. S., Hsu, J. Y., & Fogarty, C. B. (2019) · arXiv · doi:10.48550/arxiv.1901.01869 · Cited by 10
“When subjects select into treatments, outcomes may reflect pretreatment differences in treated and control groups rather than treatment effects (Cochran and Chambers 1965; Rubin 1974).”
BackgroundMethodInfluentialWine, L. D., Pribesh, S., Kimmel, S. C., Dickinson, G., & Church, A. P. (2023) · Library & Information Science Research · doi:10.1016/j.lisr.2023.101252 · Cited by 10
Efficient Difference-in-Differences Estimation with High-Dimensional Common Trend Confounding
Zimmert, M. (2018) · arXiv · doi:10.48550/arxiv.1809.01643 · Cited by 9
Wong, C. K. H., Tong, T., Cheng, G. H. L., Tang, E. H. M., Thokala, P., Tse, E. T. Y., & Lam, C. L. K. (2019) · Diabetes, Obesity and Metabolism · doi:10.1111/dom.13657 · Cited by 7
“SH patients were then matched to control patients based on similarity of propensity scores, ie, similar characteristics.(26,27) Use of calliper criteria improved the quality of nearest-neighbour matching by specifying a maximum tolerance of the propensity score distance between SH patients and control patients.”
MethodSelection Neglect and Political Beliefs
Brundage, M., Little, A. T., & You, S. (2022) · doi:10.31219/osf.io/p49at · Cited by 7
Xu, J., Guo, Y., Wang, F., Xu, H., Lucero, R., Bian, J., & Prosperi, M. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-059715 · Cited by 6
Protocol for Development of a Reporting Guideline for Causal and Counterfactual Prediction Models
(2021) · doi:10.1101/2021.11.19.21266604 · Cited by 6
Mahoney, J., & Owen, A. (2022) · Quality & Quantity · doi:10.1007/s11135-021-01188-6 · Cited by 4
“In particular, we work within the assumptions of the potential outcomes framework and its affiliated counterfactual theory of causality (Rubin 1974; Holland 1986; Morgan and Winship 2015; Pearl 2018).”
BackgroundAdenuga, A. H., & Jack, C. (2025) · Ecological Indicators · doi:10.1016/j.ecolind.2025.113714 · Cited by 4
Sakellariou, C. (2023) · Child Indicators Research · doi:10.1007/s12187-023-10029-x · Cited by 4
“Such models, developed after Heckman’s (1976) original work on causal inference models (see also, Rubin, 1974; Woolridge, 2010), incorporate both selection on observables and unobservables.”
BackgroundMethodDiagnosing and Mitigating Sycophancy and Skepticism in LLM Causal Judgment
Chang, E. Y. (2026) · Findings of the Association for Computational Linguistics: ACL 2026 · doi:10.18653/v1/2026.findings-acl.427 · Cited by 2
“That work argues models may memorize variable names but lack knowledge of the underlying observational distributions ( P ( X, Y ) ) required to identify traps like confounding (Rubin, 1974).”
Confounding Equivalence in Causal Inference
Pearl, J., & Paz, A. (2014) · Journal of Causal Inference · doi:10.1515/jci-2013-0020 · Cited by 35
“…relative to the causal effect of X on Y , if the following equality holds: ∑ z P (y|x, z)P (z) = P (y|do(x)) (3) Equivalently, one can define admissibility using the equalities: P (y|do(x)) = P (Yx = y) (4) where Yx is the counterfactual or “potential outcome” variable (Neyman, 1923; Rubin, 1974).”
InfluentialWhat is the Best Response? Examining the Impact of Police and Their Alternatives
Ba, B., Chen, P., Cheng, T., Eies, M., & Holz, J. (2025) · National Bureau of Economic Research · doi:10.3386/w34344 · Cited by 2
Abba-Aji, M., Cohen, G., Abdalla, S., Wang, R., Gradus, J., & Galea, S. (2026) · PLOS Mental Health · doi:10.1371/journal.pmen.0000317
“In our analysis, we adopt the potential outcomes framework [25,26].”
de Castro, J. A., & Guinea, L. (2026) · International Journal of Public Health · doi:10.3389/ijph.2026.1608475 · Cited by 1
(2001) · RePEc: Research Papers in Economics · Cited by 27,577
(2005) · Cited by 772
(2011) · The University of Bath Online Publications Store (The University of Bath) · Cited by 284
Metadata
- Authors
- Rubin, D. B.
- Affiliations
- Educational Testing Service (US)
- Corresponding author
- Rubin, Donald B.
- ORCID
- Rubin, Donald B.
- Venue
- Journal of Educational Psychology
- Published
- 1974-10
- Volume
- 66
- Issue
- 5
- Pages
- 688-701
- ISSN
- 0022-0663 (ISSN-L)
- 1939-2176
- OpenAlex
- W2132917208
- Cited by
- 9,436
- References
- 10
- Citations by year
- 2026: 490 · 2025: 658 · 2024: 612 · 2023: 587 · 2022: 589 · 2021: 636 · 2020: 625 · 2019: 554 · 2018: 493 · 2017: 389 · 2016: 370 · 2015: 382 · 2014: 406 · 2013: 343 · 2012: 325
- FWCI
- 2.83
- Type
- journal article
- Language
- en
- Open access
- green
- nrs.harvard.edu
- Licence
- cc-by
- Locations
- Journal of Educational Psychology (publishedVersion)
- Digital Access to Scholarship at Harvard (DASH) (Harvard University) (submittedVersion, cc-by)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Education › Educational Research and Methods
- Keywords
- causal effect estimation, randomization, non-randomized studies, matching, random sampling, treatment effects, observational studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.