The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Estimation in Parallel Randomized Experiments
Abstract
Many studies comparing new treatments to standard treatments consist of parallel randomized experiments. In the example considered here, randomized experiments were conducted in eight schools to determine the effectiveness of special coaching programs for the SAT. The purpose here is to illustrate Bayesian and empirical Bayesian techniques that can be used to help summarize the evidence in such data about differences among treatments, thereby obtaining improved estimates of the treatment effect in each experiment, including the one having the largest observed effect. Three main tools are illustrated: 1) graphical techniques for displaying sensitivity within an empirical Bayes framework, 2) simple simulation techniques for generating Bayesian posterior distributions of individual effects and the largest effect, and 3) methods for monitoring the adequacy of the Bayesian model specification by simulating the posterior predictive distribution in hypothetical replications of the same treatments in the same eight schools.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The data are consistent with a standard deviation of 0, but it could also be as high as 10 or 20.”
From Analysis of variance—why it is more important than ever (2005) · cites this paper as Rubin (1981)
Citations
Cites
Statistical Theories of Mental Test Scores
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.2307/1162101 · Cited by 8,022
Journal of The American Statistical Association
Fienberg, S. E. (2005) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess1317 · Cited by 6,125
Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability; Vol. IV
Roy, H. L. L., Lecam, L., & Neyman, J. (1969) · Revue de l'Institut International de Statistique / Review of the International Statistical Institute · doi:10.2307/1402306 · Cited by 2,835
Estimation with Quadratic Loss
James, W., & Stein, C. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-0919-5_30 · Cited by 2,252
Bayes Estimates for the Linear Model
Lindley, D. V., & Smith, A. F. M. (1972) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1972.tb00885.x · Cited by 2,025
Bayesian Inference in Statistical Analysis
Hill, B. M. (1974) · Technometrics · doi:10.1080/00401706.1974.10489222 · Cited by 1,833
Proceedings of the 6th Berkeley Symposium on Mathematical Statistics and Probability
Cam, L. M. L., Neyman, J., & Scott, E. L. (1972) · Medical Entomology and Zoology · Cited by 1,679
Osborn, J. F., & Tukey, J. W. (1978) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2344492 · Cited by 1,190
Sampling and Bayes' Inference in Scientific Modelling and Robustness
Box, G. E. P. (1980) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2982063 · Cited by 924
Efron, B., & Morris, C. (1977) · Scientific American · doi:10.1038/scientificamerican0577-119 · Cited by 739
Cited by
Items 201–279 of 279
Noortgate, W. V. D., & Onghena, P. (2005) · Wiley eBooks · doi:10.1002/0470013192.bsa388 · Cited by 3
Raudenbush, S. W. (2004) · Wiley eBooks · doi:10.1002/0471667196.ess1060 · Cited by 3
Digital Information Provision and Behavior Change: Lessons from Six Experiments in East Africa
Fabregas, R., Kremer, M. R., Lowes, M., On, R., & Zane, G. (2024) · National Bureau of Economic Research · doi:10.3386/w32048 · Cited by 12
Inference after checking multiple Bayesian models for data conflict
Bickel, D. R. (2014) · uO Research (University of Ottawa) · Cited by 3
Bickel, D. R. (2014) · uO Research (University of Ottawa) · Cited by 3
Levy, R. (2026) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/bmsp.70054 · Cited by 2
Gao, G. (2018) · Springer eBooks · doi:10.1007/978-981-13-3609-6_2 · Cited by 2
A Counterfactual Impact Evaluation of EU State Aid in Greece
Pseiridis, Α., & Kostopoulos, I. (2023) · WSEAS TRANSACTIONS ON BUSINESS AND ECONOMICS · doi:10.37394/23207.2023.20.33 · Cited by 2
Relative Jump Distance: A Diagnostic for Nested Sampling
Büchner, J. (2026) · Universe · doi:10.3390/universe12110342 · Cited by 2
Explanatory Cognitive Diagnosis Models Incorporating Item Features
Liao, M., Jiao, H., & He, Q. (2024) · Journal of Intelligence · doi:10.3390/jintelligence12030032 · Cited by 2
Experimental Evidence on Structural State Dependence in Demand
Gabel, S., Guhl, D., Hitsch, G. J., & Kook, J. (2026) · Marketing Science · doi:10.1287/mksc.2024.1274 · Cited by 2
Rubin, D. B. (2006) · Allgemeines Statistisches Archiv · doi:10.1007/s10182-006-0004-z · Cited by 4
Self-citationApproximated Bayes and empirical Bayes confidence intervals—The known variance case
van der Merwe, A. J., Groenewald, P. C. N., & van der Merwe, C. A. (1988) · Annals of the Institute of Statistical Mathematics · doi:10.1007/bf00049430 · Cited by 2
Sahoo, M. M., & Patra, K. C. (2017) · Human and Ecological Risk Assessment An International Journal · doi:10.1080/10807039.2017.1394174 · Cited by 2
Castaing, P., & Gazeaud, J. (2022) · World Bank, Washington, DC eBooks · doi:10.1596/1813-9450-10161 · Cited by 3
Inside the black box: Random effects meta-analysis with zero heterogeneity
Payne, T., & Loadsman, J. A. (2024) · Journal of Critical Care · doi:10.1016/j.jcrc.2024.154529 · Cited by 2
Lund, C., Orkin, K., Witte, M., Walker, J., Davies, T., Haushofer, J., Murray, S. M., Bass, J., Murray, L. K., Tol, W. A., et al. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4826030 · Cited by 2
Confidently Comparing Estimates with the c-value
Trippe, B. L., Deshpande, S. K., & Broderick, T. (2021) · Journal of the American Statistical Association · doi:10.1080/01621459.2022.2153688 · Cited by 2
Combining decision-level data from multiple experiments: what is the pooled estimator doing?
Bland, J. R. (2026) · Journal of the Economic Science Association · doi:10.1017/esa.2026.10031 · Cited by 1
Online and Interactive Bayesian Inference Debugging
Nussbaumer, N., Böck, M., & Cito, J. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3744916.3773215 · Cited by 1
Approximated sensitivity analysis in posterior predictive distribution
Kim, Y., Berliner, L. M., & Kim, D. H. (2014) · Journal of the Korean Statistical Society · doi:10.1016/j.jkss.2014.09.002 · Cited by 1
Latent likelihood ratio tests for assessing spatial kernels in epidemic models
Thong, D., Streftaris, G., & Gibson, G. J. (2020) · Journal of Mathematical Biology · doi:10.1007/s00285-020-01529-3 · Cited by 1
PORTFOLIO IMPACT INVESTMENT MANAGEMENT USING MULTI-OBJECTIVE OPTIMIZATION
Amaral, F. V. A., & Gartner, I. R. (2021) · Pesquisa Operacional · doi:10.1590/0101-7438.2021.041.00245832 · Cited by 1
Titus, M. A. (2010) · SSRN Electronic Journal · doi:10.2139/ssrn.1716049 · Cited by 1
TESTING RESTRICTIONS IN NORMAL DATA MODELS USING GIBBS SAMPLINGPreprint
Ciccarelli, M. (2001) · RePEc: Research Papers in Economics · Cited by 1
Actuarial Inference and Applications of Hidden Markov Models
Till, M. (2011) · UWSpace (University of Waterloo) · Cited by 1
Statistical methods for the standardization of diagnostic assays
Geistanger, A. (2007) · Technische Universität Dortmund Eldorado (Technische Universität Dortmund) · doi:10.17877/de290r-930 · Cited by 1
Assessing and Visualizing Simultaneous Simulation Error
Robertson, N., Flegal, J. M., Vats, D., & Jones, G. L. (2020) · Figshare · doi:10.6084/m9.figshare.12974817 · Cited by 1
Lund, C., Orkin, K., Witte, M., Walker, J., Davies, T., Haushofer, J., Murray, S. M., Bass, J., Murray, L. K., Tol, W. A., et al. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4868762 · Cited by 1
Price Effects in U.S. Merger Retrospectives: A Meta-Analytic ApproachPreprint
Olsen, A., Orchinik, R., & Remer, M. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4872756 · Cited by 1
Simulation-based Calibration of Uncertainty Intervals under Approximate Bayesian EstimationPreprint
Savitsky, T. D., & Gershunskaya, J. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2407.04659 · Cited by 1
Meta-study in the shadow of the future: the effect of continuation probability on strategiesPreprint
Bland, J. R. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.5042608 · Cited by 1
Rickles, J. H. (2012) · eScholarship (California Digital Library) · Cited by 1
Meta‐Analysis in Behavioral Science
Noortgate, W. V. D., & Onghena, P. (2014) · Wiley eBooks · doi:10.1002/9781118445112.stat06654
Raudenbush, S. W. (2014) · Wiley eBooks · doi:10.1002/9781118445112.stat00232
Yum, M.-Y. (2010) · Iowa State University Digital Repository (Iowa State University) · doi:10.31274/etd-180810-2624
Li, S. (2013) · Deep Blue (University of Michigan)
Four Bootstrap Confidence Intervals for the Binomial-Error Model
Lin, M.-H., & Hsiung, C. A. (1992) · Psychometrika · doi:10.1007/bf02294417
Mixtures and diagnostic plots in modelling road traffic vehicle headways
Cowburn, G. J., & Farrow, M. (2007) · Statistical Modelling · doi:10.1177/1471082x0600700105
Draper, D. (1995) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986020002228
Sensitivity of bayes and empirical bayes estimates
Mariotto, A. B. (1990) · Communication in Statistics- Theory and Methods · doi:10.1080/03610929008830452
Testing restrictions in hierarchical normal data models using Gibbs sampling
Ciccarelli, M. (2004) · Research in Economics · doi:10.1016/j.rie.2004.02.003
Li, J. (2008) · D-Scholarship@Pitt (University of Pittsburgh)
Bickel, D. R. (2015) · uO Research (University of Ottawa)
Xu, Y. J. (2003) · UA Campus Repository (The University of Arizona)
Saab, R. (2013) · UVic’s Research and Learning Repository (University of Victoria)
VALID PRIOR-FREE PROBABILISTIC INFERENCE AND ITS APPLICATIONS IN MEDICAL STATISTICS
Leaf, D. E., Yun, H., & Liu, C. (2015) · WORLD SCIENTIFIC eBooks · doi:10.1142/9789814583312_0033
Developing a Bayesian Statistical Approach to Behavioral Intervention Trials
Huh, D. (2012) · ResearchWorks at the University of Washington (University of Washington)
Fast Measurements of Robustness to Changing Priors in Variational BayesPreprint
Giordano, R., Broderick, T., & Jordan, M. I. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.07469
Lerch, M. D. (2016) · Montana State University ScholarWorks (Montana State University)
Farrell, R. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478437
BAYESIAN ANALYSIS OF SOME RANDOMLY CENSORED LIFETIME DISTRIBUTIONS
Danish, M. Y. (2016)
Thupeng, W. M., Mokgweetsi, B., & Mothupi, T. (2019) · American Journal of Theoretical and Applied Statistics · doi:10.11648/j.ajtas.20190806.20
Accelerating Metropolis-Hastings with Lightweight Inference CompilationPreprint
Liang, F., Arora, N., Tehrani, N. K., Li, Y., Tingley, M., & Meijer, E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.12128
Revisiting Empirical Bayes Methods and Applications to Special Types of Data
Duan, X. (2021) · arXiv (Cornell University) · doi:10.20381/ruor-26562
Bayesian hierarchical analysis of a multifaceted program against extreme povertyPreprint
Charlot, L. (2021) · RePEc: Research Papers in Economics · doi:10.13140/rg.2.2.25551.76960
Rubin, D. B. (1987) · Wiley series in probability and statistics · doi:10.1002/9780470316696.refs
Self-citationScott, B. R., Tokarskaya, Z. B., Zhuntova, G. V., Osovets, S. V., & A, B. A. B. (2007) · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · doi:10.2172/923839
Dunning, T., Grossman, G., Humphreys, M., Hyde, S., McIntosh, C., & Nellis, G. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108381390.012
Graham, B. S. (2019) · doi:10.1920/wp.cem.2019.7119 · Cited by 5
(2004) · Wiley series in probability and statistics · doi:10.1002/0470090456.refs
Raudenbush, S. W. (2005) · Wiley eBooks · doi:10.1002/0471667196.ess1060.pub2
Fully Bayesian Inference for Meta-Analytic Deconvolution Using Efron’s Log-Spline Prior
Lee, J.-H., & Sui, D. (2025) · Mathematics · doi:10.3390/math13162639 · Cited by 1
Susmann, H. (2025) · Journal of Applied Statistics Environmental Statistics and Data Science · doi:10.1080/29984688.2025.2547000 · Cited by 1
Statistical Mediation Analysis in Regression Discontinuity Design for Causal Inference
Chen, D. (2021) · Lincoln (University of Nebraska) · Cited by 2
Robust Shrinkage Estimation of Effect Sizes for Bayesian Meta-Analysis Models
Kim, J. (2023) · eScholarship (California Digital Library)
Banking on Cooperation: Testing Evolutionary Theories of Human Cooperation via Microfinance Loans
(11189868), D. F. (2023) · Open Research Exeter (University of Exeter) · Cited by 1
Estuarine acidification mirrors the ocean trend and correlates with the El Niño Southern Oscillation
Grear, J. S. (2025) · Limnology and Oceanography · doi:10.1002/lno.70167
Kreft, B. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5839252
Overestimation or Overplacement? A Meta-Study of Gender Differences in OverconfidencePreprint
Assi, R., & Domotor, E. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5984430
Bayesian Inference Reuse in Multilevel Models
Tolpin, D. (2026) · ACM transactions on probabilistic machine learning. · doi:10.1145/3799415
Mitigating the adverse effects of Climate Change in Developing countries : three essays
Castaing, P. (2021) · theses.fr (ABES) · doi:10.70675/97b5facaz14c6z42b0z8f4aze76f001ea9cb
Horseshoe Diffusions for Multimodal Bayesian PosteriorsPreprint
Mijatović, A., Polson, N. G., & Sokolov, V. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6862023
Amortized Bayesian Inference on Multilevel Models of Arbitrary StructurePreprint
Habermann, D., Bulling, A., Radev, S. T., & Bürkner, P. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.40024
Gao, T., Li, J., Lyu, J., & Gao, J. (2026) · Data · doi:10.3390/data11100268
Carter, S., Jee, E., Karlan, D., & Prémand, P. (2026) · World Bank, Washington, DC eBooks · doi:10.3386/w35991 · Cited by 1
Metadata
- Authors
- Rubin, D. B.
- Affiliations
- Educational Testing Service (US)
- Corresponding author
- Rubin, Donald B.
- ORCID
- Rubin, Donald B.
- Venue
- Journal of Educational Statistics
- Published
- 1981-12
- Volume
- 6
- Issue
- 4
- Pages
- 377-401
- ISSN
- 0362-9791 (ISSN-L)
- OpenAlex
- W2101756511
- Cited by
- 269
- References
- 19
- Citations by year
- 2026: 5 · 2025: 7 · 2024: 19 · 2023: 6 · 2022: 12 · 2021: 8 · 2020: 17 · 2019: 10 · 2018: 8 · 2017: 13 · 2016: 13 · 2015: 10 · 2014: 9 · 2013: 7 · 2012: 3
- FWCI
- 0.54
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Journal of Educational Statistics (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Keywords
- empirical Bayes, Bayesian estimation, treatment effect estimation, sensitivity analysis, posterior predictive distribution, model adequacy assessment, individual treatment effects
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.