The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
When Should You Adjust Standard Errors for Clustering?
Abstract
In empirical work in economics it is common to report standard errors that account for clustering of units.Typically, the motivation given for the clustering adjustments is that unobserved components in outcomes for units within clusters are correlated.However, because correlation may occur across more than one dimension, this motivation makes it difficult to justify why researchers use clustering in some dimensions, such as geographic, but not others, such as age cohorts or gender.This motivation also makes it difficult to explain why one should not cluster with data from a randomized experiment.In this paper, we argue that clustering is in essence a design problem, either a sampling design or an experimental design issue.It is a sampling design issue if sampling follows a two stage process where in the first stage, a subset of clusters were sampled randomly from a population of clusters, and in the second stage, units were sampled randomly from the sampled clusters.In this case the clustering adjustment is justified by the fact that there are clusters in the population that we do not see in the sample.Clustering is an experimental design issue if the assignment is correlated within the clusters.We take the view that this second perspective best fits the typical setting in economics where clustering adjustments are used.This perspective allows us to shed new light on three questions: (i) when should one adjust the standard errors for clustering, (ii) when is the conventional adjustment for clustering appropriate, and (iii) when does the conventional adjustment of the standard errors matter.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2001) · RePEc: Research Papers in Economics · Cited by 27,577
Longitudinal data analysis using generalized linear models
LIANG, K.-Y., & ZEGER, S. L. (1986) · Biometrika · doi:10.1093/biomet/73.1.13 · Cited by 18,550
How Much Should We Trust Differences-in-Differences Estimates?
Bertrand, M., Duflo, E., & Mullainathan, S. (2004) · The Quarterly Journal of Economics · doi:10.1162/003355304772839588 · Cited by 10,641
Cressie, N. (1992) · Terra Nova · doi:10.1111/j.1365-3121.1992.tb00605.x · Cited by 8,823
A Practitioner’s Guide to Cluster-Robust Inference
Colin Cameron, A., & Miller, D. L. (2015) · Journal of Human Resources · doi:10.3368/jhr.50.2.317 · Cited by 5,037
(1967) · Project Euclid (Cornell University) · Cited by 4,720
Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction
Imbens, G. W., & Rubin, D. B. (2015) · doi:10.1017/cbo9781139025751 · Cited by 4,210
Self-citationProceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability; Vol. IV
Roy, H. L. L., Lecam, L., & Neyman, J. (1969) · Revue de l'Institut International de Statistique / Review of the International Statistical Institute · doi:10.2307/1402306 · Cited by 2,835
GMM Estimation with Cross Sectional Dependence
Conley, T. G. (1999) · Journal of Econometrics · doi:10.1016/s0304-4076(98)00084-0 · Cited by 2,685
An Illustration of a Pitfall in Estimating the Effects of Aggregate Variables on Micro Units
Moulton, B. R. (1990) · The Review of Economics and Statistics · doi:10.2307/2109724 · Cited by 2,630
Cited by
Difference-in-Differences with multiple time periods
Callaway, B., & Sant’Anna, P. H. C. (2021) · Journal of Econometrics · doi:10.1016/j.jeconom.2020.12.001 · Cited by 9,126
Deslauriers, L., McCarty, L. S., Miller, K., Callaghan, K., & Kestin, G. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1821936116 · Cited by 1,371
The economic impact of universities: Evidence from across the globe
Valero, A., & Van Reenen, J. (2019) · Economics of Education Review · doi:10.1016/j.econedurev.2018.09.001 · Cited by 586
Cluster-robust inference: A guide to empirical practice
MacKinnon, J. G., Nielsen, M. Ø., & Webb, M. D. (2023) · Journal of Econometrics · doi:10.1016/j.jeconom.2022.04.001 · Cited by 407
What do Workplace Wellness Programs do? Evidence from the Illinois Workplace Wellness Study*
Jones, D., Molitor, D., & Reif, J. (2019) · The Quarterly Journal of Economics · doi:10.1093/qje/qjz023 · Cited by 403
Sampling‐Based versus Design‐Based Uncertainty in Regression Analysis
Abadie, A., Athey, S., Imbens, G. W., & Wooldridge, J. M. (2020) · Econometrica · doi:10.3982/ecta12675 · Cited by 285
Self-citationDeepfake detection by human crowds, machines, and machine-informed crowds
Groh, M., Epstein, Z., Firestone, C., & Picard, R. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2110013119 · Cited by 248
The Long-Run Impacts of Same-Race Teachers
Gershenson, S., Hart, C. M. D., Hyman, J., Lindsay, C. A., & Papageorge, N. W. (2022) · American Economic Journal: Economic Policy · doi:10.1257/pol.20190573 · Cited by 207
Does Diversity Matter for Health? Experimental Evidence from Oakland
Alsan, M., Garrick, O., & Graziani, G. (2018) · doi:10.3386/w24787 · Cited by 160
Affirmative Action, Mismatch, and Economic Mobility after California’s Proposition 209
Bleemer, Z. (2021) · The Quarterly Journal of Economics · doi:10.1093/qje/qjab027 · Cited by 149
Wagner, Z., Heft-Neal, S., Wise, P. H., Black, R. E., Burke, M., Boerma, T., Bhutta, Z. A., & Bendavid, E. (2019) · The Lancet Global Health · doi:10.1016/s2214-109x(19)30407-3 · Cited by 116
Fitzpatrick, B. R., Berends, M., Ferrare, J. J., & Waddington, R. J. (2020) · Educational Researcher · doi:10.3102/0013189x20909814 · Cited by 77
Human detection of political speech deepfakes across transcripts, audio, and video
Groh, M., Sankaranarayanan, A., Singh, N., Kim, D. Y., Lippman, A., & Picard, R. (2024) · Nature Communications · doi:10.1038/s41467-024-51998-z · Cited by 89
The way we were: How histories of co‐governance alleviate partisan hostility
Horne, W., Adams, J., & Gidron, N. (2023) · Comparative Political Studies · doi:10.1177/00104140221100197 · Cited by 67
Panel Experiments and Dynamic Causal Effects: A Finite Population Perspective
Bojinov, I., Rambachan, A., & Shephard, N. (2021) · Quantitative Economics · doi:10.3982/qe1744 · Cited by 60
“, Abadie et al. (2017), Athey and Imbens (2018), Athey et al. (2018), Imai and Kim (2019), Arkhangelsky and Imbens (2019), Imai and Kim (2020), de Chaisemartin and D’Haultfoeuille (2020)).”
BackgroundInfluentialHot spots policing in a high-crime environment: an experimental evaluation in Medellín
Collazos, D., García, E., Mejía, D., Ortega, D., & Tobón, S. (2021) · Journal of Experimental Criminology · doi:10.1007/s11292-019-09390-1 · Cited by 54
The Impacts of GM Foods: Results from a Randomized Controlled Trial of Bt Eggplant in Bangladesh
Ahmed, A. U., Hoddinott, J., Abedin, N., & Hossain, N. (2021) · American Journal of Agricultural Economics · doi:10.1111/ajae.12162 · Cited by 42
Algorithmic Risk Assessment in the Hands of Humans
Stevenson, M., & Doleac, J. L. (2020) · doi:10.2139/ssrn.3513695 · Cited by 42
Miratrix, L. W., Weiss, M. J., & Henderson, B. (2021) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2020.1831115 · Cited by 41
Fischer, C., Baker, R., Li, Q., Orona, G. A., & Warschauer, M. (2022) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737211055768 · Cited by 32
Brown, R. A., Minami, H., Hecht, J., Kahler, C. W., Price, L. H., Kjome, K. L., Bloom, E. L., Levy, D. E., Carpenter, K. M., Smith, A., et al. (2021) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2021.0707 · Cited by 26
Beggar-thy-neighbor: Carbon leakage within China's pilot emissions trading schemes
Zhao, Z., Li, Y., & Su, X. (2024) · Sustainable Production and Consumption · doi:10.1016/j.spc.2024.04.004 · Cited by 21
Environmental change and migration aspirations: Evidence from Bangladesh
Rudolph, L., Koubi, V., & Freihardt, J. (2025) · Global Environmental Change · doi:10.1016/j.gloenvcha.2025.102966 · Cited by 18
Adding Error Bars to Evals: A Statistical Approach to Language Model Evaluations
Miller, E. (2024) · arXiv · doi:10.48550/arxiv.2411.00640 · Cited by 9
“Here we show how to use clustered standard errors[1], a technique developed in the social sciences, to account for the dependence and correlation structure present in question clusters.”
MethodDell'Acqua, F., Kogut, B., & Perkowski, P. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3746564 · Cited by 5
The positive effect of moral self-concept on fraudulent behavior and the need for moral cleansing
Keller, T., & Szakál, P. (2025) · Scientific Reports · doi:10.1038/s41598-025-16403-9 · Cited by 2
Metadata
- Authors
- Abadie, A., Athey, S., Imbens, G., & Wooldridge, J.
- Venue
- National Bureau of Economic Research
- Publisher
- National Bureau of Economic Research
- Published
- 2017-11
- OpenAlex
- W2760925952
- Cited by
- 1,360
- References
- 34
- Type
- report
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.