CoChat

Re-analysis of health and educational impacts of a school-based deworming programme in western Kenya: a statistical replication of a cluster quasi-randomized stepped-wedge trial

Open access
Davey, Calum, Aiken, Alexander M, Hayes, Richard J, Hargreaves, James R · 2015 · International Journal of Epidemiology

The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.

Abstract

INTRODUCTION: Helminth (worm) infections cause morbidity among poor communities worldwide. An influential study conducted in Kenya in 1998-99 reported that a school-based drug-and-educational intervention had benefits for worm infections and school attendance. METHODS: In this statistical replication, we re-analysed data from this cluster quasi-randomized stepped-wedge trial, specifying two co-primary outcomes: school attendance and examination performance. We estimated intention-to-treat effects using year-stratified cluster-summary analysis and observation-level random-effects regression, and combined both years with a random-effects model accounting for year. The participants were not blinded to allocation status, and other interventions were concurrently conducted in a sub-set of schools. A protocol guiding outcome data collection was not available. RESULTS: Quasi-randomization resulted in three similar groups of 25 schools. There was a substantial amount of missing data. In year-stratified cluster-summary analysis, there was no clear evidence for improvement in either school attendance or examination performance. In year-stratified regression models, there was some evidence of improvement in school attendance [adjusted odds ratios (aOR): year 1: 1.48, 95% confidence interval (CI) 0.88-2.52, P = 0.147; year 2: 1.23, 95% CI 1.01-1.51, P = 0.044], but not examination performance (adjusted differences: year 1: -0.135, 95% CI -0.323-0.054, P = 0.161; year 2: -0.017, 95% CI -0.201-0.166, P = 0.854). When both years were combined, there was strong evidence of an effect on attendance (aOR 1.82, 95% CI 1.74-1.91, P < 0.001), but not examination performance (adjusted difference -0.121, 95% CI -0.293-0.052, P = 0.169). CONCLUSIONS: The evidence supporting an improvement in school attendance differed by analysis method. This, and various other important limitations of the data, caution against over-interpretation of the results. We find that the study provides some evidence, but with high risk of bias, that a school-based drug-treatment and health-education intervention improved school attendance and no evidence of effect on examination performance.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/ije/dyv128

Cites

15 of 15 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1. CONSORT diagram. Study participants were enumerated at the start of the study if they were registered at school in grades 1–8 at the start of 1998. Follow-up is shown for primary outcome data. ‘Pupil-observations’ refers to the number of times that any pupils were observed in the group, excluding observations after transferring schools. The levels of missingness for pupil-observations is calculated for visits that took place, and therefore does not incorporate missingness due to schools not being visited. Missingness for examination data is based on the number of pupils in standards 3–8 who had not moved school. Socioecon., socioeconomic status; NGO, non-governmental organization.
Figure 1. CONSORT diagram. Study participants were enumerated at the start of the study if they were registered at school in grades 1–8 at the start of 1998. Follow-up is shown for primary outcome data. ‘Pupil-observations’ refers to the number of times that any pupils were observed in the group, excluding observations after transferring schools. The levels of missingness for pupil-observations is calculated for visits that took place, and therefore does not incorporate missingness due to schools not being visited. Missingness for examination data is based on the number of pupils in standards 3–8 who had not moved school. Socioecon., socioeconomic status; NGO, non-governmental organization.CC BY-NC-ND · PubMed Central
Figure 2. Stepped-wedge design. Stepped-wedge design shown in schematic form. The intervention was rolled out in ‘steps’, with Group 1 receiving the intervention in year 1, Group 2 in year 2 and Group 3 in the year after the study.
Figure 2. Stepped-wedge design. Stepped-wedge design shown in schematic form. The intervention was rolled out in ‘steps’, with Group 1 receiving the intervention in year 1, Group 2 in year 2 and Group 3 in the year after the study.CC BY-NC-ND · PubMed Central
Figure 3. Scatter-plot of proportion present against number of observations, by year and group. Scatter plots of proportion present against the number of observations in each school by year and by allocation group. The dotted line indicates 95% attendance. Two schools in Group 2 have been excluded from the charts to preserve the scale: one in year 2 (1999) where no pupils are recorded present, and one in year 1 (1998) with a disproportionately large number of observations (approximately 6000).
Figure 3. Scatter-plot of proportion present against number of observations, by year and group. Scatter plots of proportion present against the number of observations in each school by year and by allocation group. The dotted line indicates 95% attendance. Two schools in Group 2 have been excluded from the charts to preserve the scale: one in year 2 (1999) where no pupils are recorded present, and one in year 1 (1998) with a disproportionately large number of observations (approximately 6000).CC BY-NC-ND · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 15 references

Cited by

Metadata

Authors
Davey, C., Aiken, A. M., Hayes, R. J., & Hargreaves, J. R.
Affiliations
London School of Hygiene & Tropical Medicine (GB)
Corresponding author
Aiken, Alexander M
Venue
International Journal of Epidemiology
Published
2015-07-22
Volume
44
Issue
5
Pages
1581-1592
ISSN
  • 0300-5771 (ISSN-L)
  • 1464-3685
OpenAlex
W2137276990
Cited by
100
References
15
Citations by year
2026: 3 · 2024: 1 · 2023: 5 · 2022: 3 · 2021: 4 · 2020: 25 · 2019: 3 · 2018: 12 · 2017: 12 · 2016: 16 · 2015: 16
FWCI
14.75
Type
journal article
Language
en
Open access
Licence
cc-by-nc-nd
Locations
  • International Journal of Epidemiology (publishedVersion, cc-by-nc-nd)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by-nc-nd)
  • PubMed Central (publishedVersion, cc-by-nc-nd)
  • PubMed (publishedVersion)
  • LSHTM Research Online (London School of Hygiene and Tropical Medicine) (acceptedVersion)
Funders
  • London School of Hygiene and Tropical Medicine
  • National Institute for Health and Care Research (CL-2012-18-002)
  • Medical Research Council (MR/K012126/1)
Topics
  • Life Sciences › Immunology and Microbiology › Parasitology › Parasites and Host Interactions
  • Health Sciences › Nursing › Nutrition and Dietetics › Child Nutrition and Water Access
  • Social Sciences › Development › Poverty, Education, and Child Welfare
Keywords
school-based deworming, helminthiasis, school attendance, exam performance, educational outcomes, stepped-wedge cluster randomized trial, missing data, intention-to-treat effect, Western Kenya, data quality limitations, random effects regression
MeSH terms
Anthelmintics, Biometry, Child, Child Development, Female, Health Education, Helminthiasis, Humans, Kenya, Male, Schools, Cluster Analysis, Logistic Models, Treatment Outcome

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.