The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
The Essential Role of Pair Matching in Cluster-Randomized Experiments, with Application to the Mexican Universal Health Insurance Evaluation
Open accessAbstract
A basic feature of many field experiments is that investigators are only able to randomize clusters of individuals—such as households, communities, firms, medical practices, schools or classrooms—even when the individual is the unit of interest. To recoup the resulting efficiency loss, some studies pair similar clusters and randomize treatment within pairs. However, many other studies avoid pairing, in part because of claims in the literature, echoed by clinical trials standards organizations, that this matched-pair, cluster-randomization design has serious problems. We argue that all such claims are unfounded. We also prove that the estimator recommended for this design in the literature is unbiased only in situations when matching is unnecessary; its standard error is also invalid. To overcome this problem without modeling assumptions, we develop a simple design-based estimator with much improved statistical properties. We also propose a model-based approach that includes some of the benefits of our design-based estimator as well as the estimator in the literature. Our methods also address individual-level noncompliance, which is common in applications but not allowed for in most existing methods. We show that from the perspective of bias, efficiency, power, robustness or research costs, and in large or small samples, pairing should be used in cluster-randomized experiments whenever feasible; failing to do so is equivalent to discarding a considerable fraction of one’s data. We develop these techniques in the context of a randomized evaluation we are conducting of the Mexican Universal Health Insurance Program.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
McLachlan, G., & Peel, D. (2000) · Wiley Series in Probability and Statistics · doi:10.1002/0471721182 · Cited by 10,991
Addelman, S. (1979) · Technometrics · doi:10.1080/00401706.1979.10489788 · Cited by 6,750
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293
Fisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980
Identification of Causal Effects Using Instrumental Variables
Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476902 · Cited by 4,230
Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference
Ho, D. E., Imai, K., King, G., & Stuart, E. A. (2007) · Political Analysis · doi:10.1093/pan/mpl013 · Cited by 4,205
Self-citationConsort 2010 statement: extension to cluster randomised trials
Campbell, M. K., Piaggio, G., Elbourne, D. R., Altman, D. G., & for the CONSORT Group (2012) · BMJ · doi:10.1136/bmj.e5661 · Cited by 3,510
Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review
Imbens, G. W. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023651 · Cited by 2,994
CONSORT statement: extension to cluster randomised trials
Campbell, M. K., Elbourne, D. R., & Altman, D. G. (2004) · BMJ · doi:10.1136/bmj.328.7441.702 · Cited by 2,557
On the Application of Probability Theory to Agricultural Experiments. Essay on Principles. Section 9
Splawa-Neyman, J., Dabrowska, D. M., & Speed, T. P. (1990) · Statistical Science · doi:10.1214/ss/1177012031 · Cited by 1,627
Research works printed but not linked: 6
- Higgins, J. and Green, S., eds. (2006). Cochrane Handbook for Systematic Review of Interventions 4.2.5 [Updated September 2006]. Wiley, Chichester, UK.
- Hill, J. L., Rubin, D. B. and Thomas, N. (1999). The design of the New York school choice scholarship program evaluation. In Research Designs: Inspired by the Work of Donald Campbell (L. Bickman, ed.) 155–180. Sage, Thousand Oaks.
- Murray, D. M. (1998). Design and Analysis of Community Trials. Oxford Univ. Press, Oxford.
- Snedecor, G. W. and Cochran, W. G. (1989). Statistical Methods, 8th ed. Iowa State Univ. Press, Ames, IA.
- Klar, N. and Donner, A. (1998). Author’s reply. Statist. Med. 17 2151–2152. · doi:10.1002/(sici)1097-0258(19980930)17:18<2151::aid-sim967>3.0.co;2-j
- Wei, L. J. (1982). Interval estimation of location difference with incomplete data. Biometrika 69 249–251. · doi:10.1093/biomet/69.1.249
Cited by
Causal Inference without Balance Checking: Coarsened Exact Matching
Iacus, S. M., King, G., & Porro, G. (2012) · Political Analysis · doi:10.1093/pan/mpr013 · Cited by 3,563
Self-citationWhy Propensity Scores Should Not Be Used for Matching
King, G., & Nielsen, R. (2019) · Political Analysis · doi:10.1017/pan.2019.11 · Cited by 1,706
Self-citationCem: Coarsened Exact Matching in Stata
Blackwell, M., Iacus, S., King, G., & Porro, G. (2009) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0900900402 · Cited by 1,689
Self-citationMultivariate Matching Methods That Are Monotonic Imbalance Bounding
Iacus, S. M., King, G., & Porro, G. (2011) · Journal of the American Statistical Association · doi:10.1198/jasa.2011.tm09599 · Cited by 967
Self-citationIn Pursuit of Balance: Randomization in Practice in Development Field Experiments
Bruhn, M., & McKenzie, D. (2009) · American Economic Journal: Applied Economics · doi:10.1257/app.1.4.200 · Cited by 788
Carnes, M., Devine, P. G., Baier Manwell, L., Byars-Winston, A., Fine, E., Ford, C. E., Forscher, P., Isaac, C., Kaatz, A., Magua, W., et al. (2015) · Academic Medicine · doi:10.1097/acm.0000000000000552 · Cited by 499
Causal effect of intergroup contact on exclusionary attitudes
Enos, R. D. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1317670111 · Cited by 391
Diabetes Control With Reciprocal Peer Support Versus Nurse Care Management: A Randomized Trial
Heisler, M., Vijan, S., Makki, F., & Piette, J. D. (2010) · Annals of Internal Medicine · doi:10.7326/0003-4819-153-8-201010190-00007 · Cited by 366
Rerandomization to improve covariate balance in experiments
Morgan, K. L., & Rubin, D. B. (2012) · The Annals of Statistics · doi:10.1214/12-aos1008 · Cited by 353
In Pursuit Of Balance: Randomization In Practice In Development Field Experiments
McKenzie, D., & Bruhn, M. (2008) · World Bank, Washington, DC eBooks · doi:10.1596/1813-9450-4752 · Cited by 335
How the news media activate public expression and influence national agendas
King, G., Schneer, B., & White, A. (2017) · Science · doi:10.1126/science.aao1100 · Cited by 333
Self-citationKing, G., Gakidou, E., Imai, K., Lakin, J., Moore, R. T., Nall, C., Ravishankar, N., Vargas, M., Téllez-Rojo, M. M., Ávila, J. E. H., et al. (2009) · The Lancet · doi:10.1016/s0140-6736(09)60239-7 · Cited by 324
Self-citationFryer, R. G. (2014) · The Quarterly Journal of Economics · doi:10.1093/qje/qju011 · Cited by 295
DUNNING, T., & NILEKANI, J. (2013) · American Political Science Review · doi:10.1017/s0003055412000573 · Cited by 264
What Do I Need to Vote? Bureaucratic Discretion and Discrimination by Local Election Officials
WHITE, A. R., NATHAN, N. L., & FALLER, J. K. (2015) · American Political Science Review · doi:10.1017/s0003055414000562 · Cited by 254
A Major Environmental Cause of Death
Martin, W. J., Glass, R. I., Balbus, J. M., & Collins, F. S. (2011) · Science · doi:10.1126/science.1213088 · Cited by 200
Review of recent methodological developments in group-randomized trials: part 2—analysis
Turner, E. L., Prague, M., Gallis, J. A., Li, F., & Murray, D. M. (2017) · American Journal of Public Health · doi:10.2105/ajph.2017.303707 · Cited by 195
Hinton, C., de la Rosa Fernández-Pacheco, P. A., Caro Samada, C., Okuzono, S. S., Hill, B., de Gregorio Vicente, O., & Moller, F. (2025) · Journal of Moral Education · doi:10.1080/03057240.2025.2509821 · Cited by 1
Metadata
- Authors
- Imai, K., King, G., & Nall, C.
- Venue
- Statistical Science
- Publisher
- Institute of Mathematical Statistics
- Published
- 2009-02-01
- Volume
- 24
- Issue
- 1
- Pages
- 29-53
- ISSN
- 0883-4237 (ISSN-L)
- OpenAlex
- W2150319295
- Cited by
- 291
- References
- 56
- FWCI
- 9.57
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.