CoChat

Implementation and effects of a school-wide data-based decision making intervention

Open access
Keuning&Geel, T.&M. · 2016
Cited by 7

The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.

Abstract

Background.Despite growing international interest in the use of data to improve education, few studies examining the effects on student achievement are yet available.Purpose.In the present study, the effects of a two-year data-based decision making intervention on student achievement growth were investigated.Method.Fifty-three primary schools participated in the project, and student achievement data were collected over the two years before and two years during the intervention.Linear mixed models were used to analyze the differential effect of data use on student achievement. Findings.A positive mean intervention effect was estimated, with an average effect of approximately one extra month of schooling.Furthermore, the results suggest that the intervention especially significantly improved the performances of students in low-SES schools. Interaction EffectsIn Model 5, interaction effects were introduced for school-SES and the intervention, and for student-SES and the intervention.It was hypothesized that the intervention effect would be larger for schools with a large population of students with low-SES (hypothesis 3).The findings of this study support this hypothesis: the interaction effect for school-SES and intervention was positive but not significant for schools with low-SES, and negative but not significant for high-SES schools.Hypothesis 4 concerned the interaction between intervention effect and student-SES.It was stated that the intervention effect would be larger for low-SES students.The interaction effect for intervention and low-SES student was significant and positive (effect of 1.05), but surprisingly the effect found for high-SES students and the intervention was also positive and significant (also an effect of 1.05).Given that the interaction effect for student-SES and intervention is conditional for the interaction effect of school-SES and intervention, it is interesting to compare effects for the combination of student and school-SES even though the latter were not significant.These combinations indicate that the effect of the intervention will only lead to a negative effect on student achievement for medium-SES students in high-SES schools, and is positive and quite large for low-and high-SES students, regardless of their school's average SES.It was assumed that school and student background characteristics would not influence the effect of intervention, and it is interesting to monitor the stability of the estimated intervention effect across models.The estimated positive main intervention effect and the random effect variability over schools is stable across Models 1 to 4. Furthermore, the random intervention effect could not be attributed to differences in background information, or to differential growth in student and school achievement.Therefore, it is concluded that the random intervention effects are identified based on differences in achievement of students in the prior-to-intervention group and during-intervention group.The main intervention effect only decreased after including interaction effects in Model 5.These findings provide partial support for hypothesis 1 (the implementation of DBDM will lead to higher student achievement, there is a positive intervention effect).Although the model fit results are not presented, the multilevel models were investigated with respect to model fit.For each model, a residual analysis was carried out to identify outliers and to investigate distributional assumptions of the residuals.The level-1 residuals showed nine outliers, which most likely stemmed from incorrectly entered observations in the student monitoring system.Some of the scores did not fall within the possible score range of the administered test.Some bias in the fitted values were detected because of observed scores of zero.Since the scores were assumed to be normally distributed and by ignoring this lower-bound, some negative fitted scores were obtained.This lowerbound problem was ignored since the few negative predicted scores did not influence the parameter estimates, which were based on a total of 66,486 observed scores.The student random effects were approximately normally distributed, but the random student effect distribution for grade 6-8 scores was very peaked.The variability in random latent student scores in grade 6-8 was less than expected since the correlation between random effects (grade 3-5 and grade 6-8) was high.The variance in effects across students was relatively low, leading to a more peaked distribution of the random effect distribution of student scores in grade 6-8.However, this random effect was needed to properly represent the scores of students in grade 6 to 8 despite the high correlation with the scores grade 3 to 5. 3The Effects of a Schoolwide Data-Based Decision Making Intervention on Elementary School's Student Achievement Growth for Mathematics and Spelling

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3990/1.9789036541190

Cites

28 of 28 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 28 references

Cited by

See all 7

Metadata

Authors
Keuning&Geel, T. &.
Published
2016-04-07
OpenAlex
W2511106946
Cited by
7
References
28
Type
dissertation
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Implementation and effects of a school-wide data-based decision making intervention. https://app.cochat.ai/papers/10.3990/1.9789036541190
The paper
Keuning&Geel, T. &. (2016). Implementation and effects of a school-wide data-based decision making intervention. https://doi.org/10.3990/1.9789036541190

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.