The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
When Should You Adjust Standard Errors for Clustering?
Abstract
In empirical work in economics it is common to report standard errors that account for clustering of units.Typically, the motivation given for the clustering adjustments is that unobserved components in outcomes for units within clusters are correlated.However, because correlation may occur across more than one dimension, this motivation makes it difficult to justify why researchers use clustering in some dimensions, such as geographic, but not others, such as age cohorts or gender.This motivation also makes it difficult to explain why one should not cluster with data from a randomized experiment.In this paper, we argue that clustering is in essence a design problem, either a sampling design or an experimental design issue.It is a sampling design issue if sampling follows a two stage process where in the first stage, a subset of clusters were sampled randomly from a population of clusters, and in the second stage, units were sampled randomly from the sampled clusters.In this case the clustering adjustment is justified by the fact that there are clusters in the population that we do not see in the sample.Clustering is an experimental design issue if the assignment is correlated within the clusters.We take the view that this second perspective best fits the typical setting in economics where clustering adjustments are used.This perspective allows us to shed new light on three questions: (i) when should one adjust the standard errors for clustering, (ii) when is the conventional adjustment for clustering appropriate, and (iii) when does the conventional adjustment of the standard errors matter.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2001) · RePEc: Research Papers in Economics · Cited by 27,577
Longitudinal data analysis using generalized linear models
LIANG, K.-Y., & ZEGER, S. L. (1986) · Biometrika · doi:10.1093/biomet/73.1.13 · Cited by 18,550
How Much Should We Trust Differences-in-Differences Estimates?
Bertrand, M., Duflo, E., & Mullainathan, S. (2004) · The Quarterly Journal of Economics · doi:10.1162/003355304772839588 · Cited by 10,641
Cressie, N. (1992) · Terra Nova · doi:10.1111/j.1365-3121.1992.tb00605.x · Cited by 8,823
A Practitioner’s Guide to Cluster-Robust Inference
Colin Cameron, A., & Miller, D. L. (2015) · Journal of Human Resources · doi:10.3368/jhr.50.2.317 · Cited by 5,037
(1967) · Project Euclid (Cornell University) · Cited by 4,720
Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction
Imbens, G. W., & Rubin, D. B. (2015) · doi:10.1017/cbo9781139025751 · Cited by 4,210
Self-citationProceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability; Vol. IV
Roy, H. L. L., Lecam, L., & Neyman, J. (1969) · Revue de l'Institut International de Statistique / Review of the International Statistical Institute · doi:10.2307/1402306 · Cited by 2,835
GMM Estimation with Cross Sectional Dependence
Conley, T. G. (1999) · Journal of Econometrics · doi:10.1016/s0304-4076(98)00084-0 · Cited by 2,685
An Illustration of a Pitfall in Estimating the Effects of Aggregate Variables on Micro Units
Moulton, B. R. (1990) · The Review of Economics and Statistics · doi:10.2307/2109724 · Cited by 2,630
Rosenbaum, P. R. (2002) · Springer Series in Statistics · doi:10.1007/978-1-4757-3692-2 · Cited by 2,394
Random group effects and the precision of regression estimates
Moulton, B. R. (1986) · Journal of Econometrics · doi:10.1016/0304-4076(86)90021-7 · Cited by 1,626
Inference with Difference-in-Differences and Other Panel Data
Donald, S. G., & Lang, K. (2007) · Review of Economics and Statistics · doi:10.1162/rest.89.2.221 · Cited by 1,324
Asymptotic Theory for Econometricians.
Robinson, P. M., & White, H. (1988) · Economica · doi:10.2307/2554258 · Cited by 1,305
Design and Analysis of Cluster Randomization Trials in Health Research
DONNER, A. P., & Klar, N. S. (2000) · Cited by 1,236
Analysis of Longitudinal Data.
Have, T. R. T., Diggle, P. J., Liang, K.-Y., & Zeger, S. L. (1995) · Journal of the American Statistical Association · doi:10.2307/2291352 · Cited by 1,171
Design and Analysis of Group-Randomized Trials
Sonnad, S. (1999) · Medicine & Science in Sports & Exercise · doi:10.1097/00005768-199902000-00025 · Cited by 1,125
Design and Analysis of Group-Randomized Trials
Murray, D. M. (2007) · doi:10.1093/oso/9780195120363.001.0001 · Cited by 1,116
Cluster-Sample Methods in Applied Econometrics
Wooldridge, J. M. (2003) · American Economic Review · doi:10.1257/000282803321946930 · Cited by 867
Self-citationde Veaux, R. D., & Cressie, N. A. C. (1993) · Technometrics · doi:10.2307/1269525 · Cited by 700
Heteroskedasticity-robust Standard Errors for Fixed Effects Panel Data Regression
Stock, J. H., & Watson, M. W. (2008) · Econometrica · doi:10.1111/j.0012-9682.2008.00821.x · Cited by 609
The Econometrics of Randomized Experiments
(2017) · Handbook of Economic Field Experiments · doi:10.1016/bs.hefe.2016.10.003 · Cited by 562
Design and Analysis of Cluster Randomization Trials in Health Research.
Flynn, T. N. (2001) · International Journal of Epidemiology · doi:10.1093/ije/30.2.407-a · Cited by 469
Hansen, C. B. (2007) · Journal of Econometrics · doi:10.1016/j.jeconom.2006.07.011 · Cited by 389
Design and analysis of clinical trials with clustering effects due to treatment
Roberts, C., & Roberts, S. A. (2005) · Clinical Trials · doi:10.1191/1740774505cn076oa · Cited by 299
t-Statistic Based Correlation and Heterogeneity Robust Inference
Ibragimov, R., & Müller, U. K. (2010) · Journal of Business & Economic Statistics · doi:10.1198/jbes.2009.08046 · Cited by 299
Limit Theorems for Regressions with Unequal and Dependent Errors
Eicker, F. (1967) · Project Euclid (Cornell University) · Cited by 261
Clustering, Spatial Correlations, and Randomization Inference
Barrios, T., Diamond, R., Imbens, G. W., & Kolesár, M. (2012) · Journal of the American Statistical Association · doi:10.1080/01621459.2012.682524 · Cited by 153
Self-citationAlternative Tests of the Error Components Model
Moulton, B. R., & Randolph, W. C. (1989) · Econometrica · doi:10.2307/1911059 · Cited by 136
Kloek, T. (1981) · Econometrica · doi:10.2307/1911134 · Cited by 124
Inference with few heterogeneous clusters
Ibragimov, R., & Müller, U. K. (2016) · Review of Economics and Statistics · doi:10.1162/rest_a_00545 · Cited by 99
The use of random effects models to allow for clustering in individually randomized trials
Lee, K. J., & Thompson, S. G. (2005) · Clinical Trials · doi:10.1191/1740774505cn082oa · Cited by 90
Sampling-based vs. Design-based Uncertainty in Regression AnalysisPreprint
Abadie, A., Athey, S. C., Imbens, G. W., & Wooldridge, J. M. (2017) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.1706.01778 · Cited by 20
Self-citationWeiss, M. J., Lockwood, J. R., III, & McCaffrey, D. F. (2015) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2015.1086911 · Cited by 18
Cited by
Difference-in-Differences with multiple time periods
Callaway, B., & Sant’Anna, P. H. C. (2021) · Journal of Econometrics · doi:10.1016/j.jeconom.2020.12.001 · Cited by 9,126
Deslauriers, L., McCarty, L. S., Miller, K., Callaghan, K., & Kestin, G. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1821936116 · Cited by 1,371
The economic impact of universities: Evidence from across the globe
Valero, A., & Van Reenen, J. (2019) · Economics of Education Review · doi:10.1016/j.econedurev.2018.09.001 · Cited by 586
Cluster-robust inference: A guide to empirical practice
MacKinnon, J. G., Nielsen, M. Ø., & Webb, M. D. (2023) · Journal of Econometrics · doi:10.1016/j.jeconom.2022.04.001 · Cited by 407
What do Workplace Wellness Programs do? Evidence from the Illinois Workplace Wellness Study*
Jones, D., Molitor, D., & Reif, J. (2019) · The Quarterly Journal of Economics · doi:10.1093/qje/qjz023 · Cited by 403
Metadata
- Authors
- Abadie, A., Athey, S., Imbens, G., & Wooldridge, J.
- Venue
- National Bureau of Economic Research
- Publisher
- National Bureau of Economic Research
- Published
- 2017-11
- OpenAlex
- W2760925952
- Cited by
- 1,360
- References
- 34
- Type
- report
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.