Re-analysis of health and educational impacts of a school-based deworming programme in western Kenya: a statistical replication of a cluster quasi-randomized stepped-wedge trial
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
INTRODUCTION: Helminth (worm) infections cause morbidity among poor communities worldwide. An influential study conducted in Kenya in 1998-99 reported that a school-based drug-and-educational intervention had benefits for worm infections and school attendance. METHODS: In this statistical replication, we re-analysed data from this cluster quasi-randomized stepped-wedge trial, specifying two co-primary outcomes: school attendance and examination performance. We estimated intention-to-treat effects using year-stratified cluster-summary analysis and observation-level random-effects regression, and combined both years with a random-effects model accounting for year. The participants were not blinded to allocation status, and other interventions were concurrently conducted in a sub-set of schools. A protocol guiding outcome data collection was not available. RESULTS: Quasi-randomization resulted in three similar groups of 25 schools. There was a substantial amount of missing data. In year-stratified cluster-summary analysis, there was no clear evidence for improvement in either school attendance or examination performance. In year-stratified regression models, there was some evidence of improvement in school attendance [adjusted odds ratios (aOR): year 1: 1.48, 95% confidence interval (CI) 0.88-2.52, P = 0.147; year 2: 1.23, 95% CI 1.01-1.51, P = 0.044], but not examination performance (adjusted differences: year 1: -0.135, 95% CI -0.323-0.054, P = 0.161; year 2: -0.017, 95% CI -0.201-0.166, P = 0.854). When both years were combined, there was strong evidence of an effect on attendance (aOR 1.82, 95% CI 1.74-1.91, P < 0.001), but not examination performance (adjusted difference -0.121, 95% CI -0.293-0.052, P = 0.169). CONCLUSIONS: The evidence supporting an improvement in school attendance differed by analysis method. This, and various other important limitations of the data, caution against over-interpretation of the results. We find that the study provides some evidence, but with high risk of bias, that a school-based drug-treatment and health-education intervention improved school attendance and no evidence of effect on examination performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Studies that integrated health facility-based interventions with community outreach often used mixed-setting clusters (33–36, 38, 48, 54, 61, 67, 72, 76, 78, 80, 92, 99, 103, 106–108).”
From Applications and implementation considerations for stepped-wedge designs in sub-Saharan Africa: a systematic review (2026) · cites this paper as [35]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Schools served as effective clusters for interventions focused on health education, disease prevention, and other child-focused outcomes (35, 110).”
From Applications and implementation considerations for stepped-wedge designs in sub-Saharan Africa: a systematic review (2026) · cites this paper as [35]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Clusters based on social networks allowed for the examination of interventions within the natural groupings of individuals (28, 29, 35, 48, 51, 72, 76, 78, 81, 82, 90, 97, 103, 106, 108, 110).”
From Applications and implementation considerations for stepped-wedge designs in sub-Saharan Africa: a systematic review (2026) · cites this paper as [35]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Some studies utilized systematic or quasi-randomized approaches when true randomization was not feasible, often due to logistical constraints or the need to align with existing organizational structure (35, 83, 106).”
From Applications and implementation considerations for stepped-wedge designs in sub-Saharan Africa: a systematic review (2026) · cites this paper as [35]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Studies such as those by Calum Davey (35) and Badara Cisse (34) illustrate the value of accounting for temporal trends to reduce bias, aligning with guidance on SWD's analytical strengths (117).”
From Applications and implementation considerations for stepped-wedge designs in sub-Saharan Africa: a systematic review (2026) · cites this paper as [35]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Improving the Quality of Reporting of Randomized Controlled Trials: The CONSORT Statement
Begg, C. (1996) · JAMA · doi:10.1001/jama.1996.03540080059030 · Cited by 3,127
Soil-transmitted helminth infections: ascariasis, trichuriasis, and hookworm
Bethony, J., Brooker, S., Albonico, M., Geiger, S. M., Loukas, A., Diemert, D., & Hotez, P. J. (2006) · The Lancet · doi:10.1016/s0140-6736(06)68653-4 · Cited by 2,478
Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities
Miguel, E., & Kremer, M. (2004) · Econometrica · doi:10.1111/j.1468-0262.2004.00481.x · Cited by 2,268
Steinmann, P., Keiser, J., Bos, R., Tanner, M., & Utzinger, J. (2006) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(06)70521-7 · Cited by 2,156
Design and analysis of stepped wedge cluster randomized trials
Hussey, M. A., & Hughes, J. P. (2007) · Contemporary Clinical Trials · doi:10.1016/j.cct.2006.05.007 · Cited by 1,393 · cited 1×
“This comparison can usefully increase the precision of the effect estimate if secular trends are adequately controlled.(9) We suggest that a simple diagnostic that should lead to caution in the analysis of stepped-wedge trials because of inadequate control for secular trends might apply when—as we have found in this s…”
BackgroundCha, M., Eastwaad, S., Hartan, R., Maher, D., Olkin, I., Pitkin, R., Rennie, D., Schulz, K. F., Simel, D. L., & Straup, D. F. (1996) · Cited by 737
Helminth Control in School-age Children: A Guide for Managers of Control Programmes
Montresor, A., Crompton, D. W. T., Gyorkos, T. W., & Savioli, L. (2002) · Medical Entomology and Zoology · Cited by 589
Worms: Education and health externalities in kenyaPreprint
Kremer, M. R., & Miguel, E. A. (n.d.) · RePEc: Research Papers in Economics · Cited by 581
Mdege, N. D., Man, M.-S., Taylor (nee Brown), C. A., & Torgerson, D. J. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.12.003 · Cited by 425 · cited 1×
“A limitation of this research is that, to our knowledge, there is no accepted method for combining the randomized comparisons in each year to estimate an overall effect and confidence interval with binary data from a stepped-wedge trial without evoking a non-randomized before-after comparison in clusters that change t…”
MethodTaylor-Robinson, D. C., Maayan, N., Soares-Weiser, K., Donegan, S., & Garner, P. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000371.pub6 · Cited by 392
Aiken, A. M., Davey, C., Hargreaves, J. R., & Hayes, R. J. (2015) · International Journal of Epidemiology · doi:10.1093/ije/dyv127 · Cited by 139
Self-citationAwasthi, S., Peto, R., Read, S., Richards, S. M., Pande, V., Bundy, D., & the DEVTA (Deworming and Enhanced Vitamin A) team (2013) · The Lancet · doi:10.1016/s0140-6736(12)62126-6 · Cited by 115 · cited 1×
“Burden may also affect the magnitude of effects: low burden may explain why a large trial in India evaluating the effect of deworming and vitamin A supplementation on pre-school mortality found no effect.(11) Without clear articulation of a causal pathway, it is unclear what other factors would need to be similar in o…”
ResultTaylor-Robinson, D. C., Maayan, N., Soares-Weiser, K., Donegan, S., & Garner, P. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000371.pub4 · Cited by 81
Taylor-Robinson, D. C., Maayan, N., Soares-Weiser, K., Donegan, S., & Garner, P. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000371.pub5 · Cited by 80
Development, T. P. F. C. (1999) · Acta Tropica · doi:10.1016/s0001-706x(99)00028-5 · Cited by 61
Cited by
Taylor-Robinson, D. C., Maayan, N., Soares-Weiser, K., Donegan, S., & Garner, P. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000371.pub6 · Cited by 392
Worms at Work: Long-run Impacts of a Child Health Investment*
Baird, S., Hicks, J. H., Kremer, M., & Miguel, E. (2016) · The Quarterly Journal of Economics · doi:10.1093/qje/qjw022 · Cited by 269
“Clemens and Sandefur (2015) carry out an independent analysis that confirms the robustness of the cross-school externality effects out to 4 km. Note that the critiques raised in Aiken et al. (2015) and Davey et al. (2015) do not apply to the data used in the current study.”
THE MEANING OF FAILED REPLICATIONS: A REVIEW AND PROPOSAL
Clemens, M. A. (2017) · Journal of Economic Surveys · doi:10.1111/joes.12139 · Cited by 213
Pabalan, N., Singian, E., Tabangay, L., Jarjanazi, H., Boivin, M. J., & Ezeamama, A. E. (2018) · PLoS neglected tropical diseases · doi:10.1371/journal.pntd.0005523 · Cited by 176
All that Glitters is not Gold. The Political Economy of Randomized Evaluations in Development
Bédécarrats, F., Guérin, I., & Roubaud, F. (2017) · Development and Change · doi:10.1111/dech.12378 · Cited by 174
Metadata
- Authors
- Davey, C., Aiken, A. M., Hayes, R. J., & Hargreaves, J. R.
- Affiliations
- London School of Hygiene & Tropical Medicine (GB)
- Corresponding author
- Aiken, Alexander M
- Venue
- International Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2015-07-22
- Volume
- 44
- Issue
- 5
- Pages
- 1581-1592
- ISSN
- 0300-5771 (ISSN-L)
- 1464-3685
- PMC
- PMC4681108
- OpenAlex
- W2137276990
- Cited by
- 100
- References
- 15
- Citations by year
- 2026: 3 · 2024: 1 · 2023: 5 · 2022: 3 · 2021: 4 · 2020: 25 · 2019: 3 · 2018: 12 · 2017: 12 · 2016: 16 · 2015: 16
- FWCI
- 14.75
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by-nc-nd
- Locations
- International Journal of Epidemiology (publishedVersion, cc-by-nc-nd)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- LSHTM Research Online (London School of Hygiene and Tropical Medicine) (acceptedVersion)
- Funders
- London School of Hygiene and Tropical Medicine
- National Institute for Health and Care Research (CL-2012-18-002)
- Medical Research Council (MR/K012126/1)
- Topics
- Life Sciences › Immunology and Microbiology › Parasitology › Parasites and Host Interactions
- Health Sciences › Nursing › Nutrition and Dietetics › Child Nutrition and Water Access
- Social Sciences › Development › Poverty, Education, and Child Welfare
- Keywords
- school-based deworming, helminthiasis, school attendance, exam performance, educational outcomes, stepped-wedge cluster randomized trial, missing data, intention-to-treat effect, Western Kenya, data quality limitations, random effects regression
- MeSH terms
- Anthelmintics, Biometry, Child, Child Development, Female, Health Education, Helminthiasis, Humans, Kenya, Male, Schools, Cluster Analysis, Logistic Models, Treatment Outcome
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.