Sharp bounds on the variance in randomized experiments
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
We propose a consistent estimator of sharp bounds on the variance of the difference-in-means estimator in completely randomized experiments. Generalizing Robins [Stat. Med. 7 (1988) 773–785], our results resolve a well-known identification problem in causal inference posed by Neyman [Statist. Sci. 5 (1990) 465–472. Reprint of the original 1923 paper]. A practical implication of our results is that the upper bound estimator facilitates the asymptotically narrowest conservative Wald-type confidence intervals, with applications in randomized controlled and clinical trials.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In that case we know we can improve on this variance a little bit exploiting heteroskedasticity, e.g., Aronow et al. [2014], but in general those gains are modest.”
From Design-based analysis in Difference-In-Differences settings with staggered adoption (2022) · cites this paper as Aronow et al. [2014]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bayesian inference for causal effects: The role of randomization
Rubin, D. B. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344064 · Cited by 2,503 · cited 1×
“Associated with each unit i are two potential outcomes [13, 15] under control and treatment, respectively: y0i and y1i.”
BackgroundLehmann, E. L. (1966) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177699260 · Cited by 1,510
Heckman, J. J., Smith, J., & Clements, N. (1997) · The Review of Economic Studies · doi:10.2307/2971729 · Cited by 915 · cited 3×
“See Copas [2], Gadbury, Iyer and Albert [6], Heckman, Smith and Clements [9] and Zhang et al.”
BackgroundAgnostic notes on regression adjustments to experimental data: Reexamining Freedman’s critique
Lin, W. (2013) · The Annals of Applied Statistics · doi:10.1214/12-aoas583 · Cited by 641 · cited 1×
“LEE The estimate V̂ a n is also produced by common estimators that presuppose sampling from an infinite superpopulation, including heteroskedasticityrobust variance estimators [12, 16] and the standard variance estimate for mean differences between independent groups [13].”
BackgroundSurvey Design under the Regression Superpopulation Model
Isaki, C. T., & Fuller, W. A. (1982) · Journal of the American Statistical Association · doi:10.1080/01621459.1982.10477770 · Cited by 439 · cited 2×
“As in Isaki and Fuller [10], we do not assume that the sequences of treatment assignments are nested; instead, each UN hosts its own random assignment.”
BackgroundInequalities for Distributions with Given Marginals
Tchen, A. H. (1980) · The Annals of Probability · doi:10.1214/aop/1176994668 · Cited by 416 · cited 3×
“Defining EQ as the expectation operator with respect to a distribution Q, a result by Hoeffding, recounted in Tchen [17], shows that EHL N (y1y0)≤EHN (y1y0)≤EHH N (y1y0).”
ResultInfluentialOn regression adjustments in experiments with several treatments
Freedman, D. A. (2008) · The Annals of Applied Statistics · doi:10.1214/07-aoas143 · Cited by 177 · cited 6×
“MR0448746 [3] Freedman, D. A. (2008).”
BackgroundMethodInfluentialConfidence intervals for causal parameters
Robins, J. M. (1988) · Statistics in Medicine · doi:10.1002/sim.4780070707 · Cited by 91 · cited 5×
“Generalizing Robins [Stat.”
MethodResultInfluentialSamii, C., & Aronow, P. M. (2011) · Statistics & Probability Letters · doi:10.1016/j.spl.2011.10.024 · Cited by 74 · cited 1×
“LEE The estimate V̂ a n is also produced by common estimators that presuppose sampling from an infinite superpopulation, including heteroskedasticityrobust variance estimators [12, 16] and the standard variance estimate for mean differences between independent groups [13].”
BackgroundSelf-citationRandomization Inference and Bias of Standard Errors
Gadbury, G. L. (2001) · The American Statistician · doi:10.1198/000313001753272268 · Cited by 39 · cited 1×
“Furthermore, V̂ a n is known to be unbiased for Vn when effects are constant, as would hold when there exist no treatment effects whatsoever [5].”
Background
Research works printed but not linked: 3
- [2] Copas, J. B. (1973). Randomization models for the matched and unmatched $2\times 2$ tables. Biometrika 60 467–476. · DOI · Paper page
- [18] van der Vaart, A. W. and Wellner, J. A. (1996). Weak Convergence and Empirical Processes: With Applications to Statistics. Springer, New York. · DOI · Paper page
- [1] Cochran, W. G. (1977). Sampling Techniques, 3rd ed. Wiley, New York.
Cited by
Design-based analysis in Difference-In-Differences settings with staggered adoption
Athey, S., & Imbens, G. W. (2022) · Journal of Econometrics · doi:10.1016/j.jeconom.2020.10.012 · Cited by 917
Sampling‐Based versus Design‐Based Uncertainty in Regression Analysis
Abadie, A., Athey, S., Imbens, G. W., & Wooldridge, J. M. (2020) · Econometrica · doi:10.3982/ecta12675 · Cited by 285
“For the case of a randomized experiment with a binary treatment, Aronow, Green, and Lee (2014) provided a lower bound for S 2 θ based on the Fréchet–Hoeffding inequality.”
General Forms of Finite Population Central Limit Theorems with Applications to Causal Inference
Li, X., & Ding, P. (2017) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1295865 · Cited by 167
“The finite population asymptotic scheme embeds ΠN into a hypothetical infinite sequence of finite populations with increasing sizes, and the asymptotic distribution of any sample quantity is its limiting distribution along this hypothetical infinite sequence (cf. Lehmann 1999, 1975; Ding 2016; Aronow et al. 2014; Midd…”
BackgroundA Paradox from Randomization-Based Causal Inference
Ding, P. (2017) · Statistical Science · doi:10.1214/16-sts571 · Cited by 87
“Recently, for general outcomes Aronow et al. (2014) derived the sharp bound of S2τ based on the marginal distributions of the treatment and control potential outcomes using the Frechét–Hoeffding bounds (Nelsen, 2007); for binary outcomes Robins (1988) and Ding and Dasgupta (2016) gave simple forms.”
MethodRerandomization and Regression Adjustment
Li, X., & Ding, P. (2019) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/rssb.12353 · Cited by 141
“In general, these confidence intervals can be conservative, and can be improved (Aronow et al. 2014; Fogarty 2018; Ding et al. 2019).”
Metadata
- Authors
- Aronow, P. M., Green, D. P., & Lee, D. K. K.
- Venue
- The Annals of Statistics
- Publisher
- Institute of Mathematical Statistics
- Published
- 2014-06-01
- Volume
- 42
- Issue
- 3
- Pages
- 850-871
- ISSN
- 0090-5364 (ISSN-L)
- 2168-8966
- OpenAlex
- W2037108984
- Cited by
- 49
- References
- 13
- Citations by year
- 2026: 5 · 2025: 4 · 2024: 2 · 2023: 3 · 2022: 3 · 2021: 3 · 2020: 5 · 2019: 4 · 2018: 8 · 2017: 8 · 2016: 1 · 2015: 2 · 2014: 1
- FWCI
- 4.22
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- The Annals of Statistics (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Project Euclid (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
- Keywords
- difference-in-means estimator, consistent estimators, identification problem, randomized controlled trials, clinical trials, causal inference
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Sharp bounds on the variance in randomized experiments. https://app.cochat.ai/papers/10.1214/13-aos1200
- The paper
- Aronow, P. M., Green, D. P., & Lee, D. K. K. (2014). Sharp bounds on the variance in randomized experiments. The Annals of Statistics. https://doi.org/10.1214/13-aos1200
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.