Causal inference methods to study nonrandomized, preexisting development interventions
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Empirical measurement of interventions to address significant global health and development problems is necessary to ensure that resources are applied appropriately. Such intervention programs are often deployed at the group or community level. The gold standard design to measure the effectiveness of community-level interventions is the community-randomized trial, but the conditions of these trials often make it difficult to assess their external validity and sustainability. The sheer number of community interventions, relative to randomized studies, speaks to a need for rigorous observational methods to measure their impact. In this article, we use the potential outcomes model for causal inference to motivate a matched cohort design to study the impact and sustainability of nonrandomized, preexisting interventions. We illustrate the method using a sanitation mobilization, water supply, and hygiene intervention in rural India. In a matched sample of 25 villages, we enrolled 1,284 children <5 y old and measured outcomes over 12 mo. Although we found a 33 percentage point difference in new toilet construction [95% confidence interval (CI) = 28%, 39%], we found no impacts on height-for-age Z scores (adjusted difference = 0.01, 95% CI = −0.15, 0.19) or diarrhea (adjusted longitudinal prevalence difference = 0.003, 95% CI = −0.001, 0.008) among children <5 y old. This study demonstrates that matched cohort designs can estimate impacts from nonrandomized, preexisting interventions that are used widely in development efforts. Interpreting the impacts as causal, however, requires stronger assumptions than prospective, randomized studies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436
Maternal and child undernutrition: global and regional exposures and health consequences
Black, R. E., Allen, L. H., Bhutta, Z. A., Caulfield, L. E., de Onis, M., Ezzati, M., Mathers, C., & Rivera, J. (2008) · The Lancet · doi:10.1016/s0140-6736(07)61690-0 · Cited by 6,443
Recent Developments in the Econometrics of Program Evaluation
Imbens, G. W., & Wooldridge, J. M. (2009) · Journal of Economic Literature · doi:10.1257/jel.47.1.5 · Cited by 4,926
A structural approach to selection bias
Hernán, M. A., Hernández-Díaz, S., & Robins, J. M. (2004) · Epidemiology · doi:10.1097/01.ede.0000135174.63482.43 · Cited by 2,844 · cited 1×
“If censoring is a common effect of both the intervention treatment and the outcome, then it is informative and will cause bias (26).”
BackgroundWood, L., Egger, M., Gluud, L. L., Schulz, K. F., Jüni, P., Altman, D. G., Gluud, C., Martin, R. M., Wood, A. J. G., & Sterne, J. A. C. (2008) · BMJ · doi:10.1136/bmj.39465.451748.ad · Cited by 2,538 · cited 1×
“Bias from other sources can result from frequent measurement (3) or lack of blinding treatment (blinding is rarely possible for community interventions) (4, 5).”
BackgroundCounterfactuals and Causal Inference: Methods and Principles for Social Research
Morgan, S. L., & Winship, C. (2007) · doi:10.1017/cbo9780511804564 · Cited by 1,146
Health metrics and evaluation: strengthening the science
Murray, C. J., & Frenk, J. (2008) · The Lancet · doi:10.1016/s0140-6736(08)60526-7 · Cited by 849
Design and analysis of group-randomized trials: a review of recent methodological developments
Murray, D. M., Varnell, S. P., & Blitstein, J. L. (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.423 · Cited by 677
Eisenberg, J. N. S., Scott, J. C., & Porco, T. (2007) · American Journal of Public Health · doi:10.2105/ajph.2006.086207 · Cited by 136 · cited 1×
“They provide evidence that in some populations it is not necessary to combine improvements in water supply, sanitation, and hygiene conditions to achieve very low levels of child diarrhea (35, 36).”
BackgroundIntervention studies and the definition of dominant transmission routes
BRISCOE, J. (1984) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a113909 · Cited by 86 · cited 1×
“They provide evidence that in some populations it is not necessary to combine improvements in water supply, sanitation, and hygiene conditions to achieve very low levels of child diarrhea (35, 36).”
Background
Cited by
Clasen, T., Boisson, S., Routray, P., Torondel, B., Bell, M., Cumming, O., Ensink, J., Freeman, M., Jenkins, M., Odagiri, M., et al. (2014) · The Lancet Global Health · doi:10.1016/s2214-109x(14)70307-9 · Cited by 537
Patil, S. R., Arnold, B. F., Salvatore, A. L., Briceno, B., Ganguly, S., Colford, J. M., & Gertler, P. J. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001709 · Cited by 487
Self-citationPickering, A. J., Djebbari, H., Lopez, C., Coulibaly, M., & Alzua, M. L. (2015) · The Lancet Global Health · doi:10.1016/s2214-109x(15)00144-8 · Cited by 391
Freeman, M. C., Garn, J. V., Sclar, G. D., Boisson, S., Medlicott, K., Alexander, K. T., Penakalapati, G., Anderson, D., Mahtani, A. G., Grimes, J. E. T., et al. (2017) · International Journal of Hygiene and Environmental Health · doi:10.1016/j.ijheh.2017.05.007 · Cited by 358
Lin, A., Arnold, B. F., Afreen, S., Goto, R., Huda, T. M. N., Haque, R., Raqib, R., Unicomb, L., Ahmed, T., Colford, J. M., et al. (2013) · The American Society of Tropical Medicine and Hygiene · doi:10.4269/ajtmh.12-0629 · Cited by 347
Self-citation
Metadata
- Authors
- Arnold, B. F., Khush, R. S., Ramaswamy, P., London, A. G., Rajkumar, P., Ramaprabha, P., Durairaj, N., Hubbard, A. E., Balakrishnan, K., & Colford, J. M.
- Venue
- Proceedings of the National Academy of Sciences
- Published
- 2010-12-13
- Volume
- 107
- Issue
- 52
- Pages
- 22605-22610
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- OpenAlex
- W2146073843
- Cited by
- 96
- References
- 10
- FWCI
- 4.31
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Causal inference methods to study nonrandomized, preexisting development interventions. https://app.cochat.ai/papers/10.1073/pnas.1008944107
- The paper
- Arnold, B. F., Khush, R. S., Ramaswamy, P., London, A. G., Rajkumar, P., Ramaprabha, P., Durairaj, N., Hubbard, A. E., Balakrishnan, K., & Colford, J. M. (2010). Causal inference methods to study nonrandomized, preexisting development interventions. Proceedings of the National Academy of Sciences. https://doi.org/10.1073/pnas.1008944107
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.