Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 94 of the 94 references it cites were found in a registry or an index; none of the 30 sources its claims cite is checked for support yet.

Efficacy of an Adaptive Game-Based Math Learning App to Support Personalized Learning and Improve Early Elementary School Students’ Learning

Open access
Bang, Hee Jin, Li, Linlin, Flynn, Kylie · 2023 · Early Childhood Education Journal

Abstract

Study of My Math Academy with kindergarten and first grade students (N = 505 treatment, 481 control).

Overview

CoChat Summary

## TL;DR

This cluster-randomized study found that kindergarten and first-grade students using My Math Academy made small but statistically significant gains in math relative to controls, with stronger effects for kindergarteners and for more advanced skills. Teachers also reported that the app was easy to use and helpful for engagement, motivation, and personalization.

## Key findings

  • In the main student outcome analysis, treatment students outperformed controls on the post-test: adjusted means 20.97 vs. 20.08, difference = 0.89, p = 0.026, effect size = 0.11, with an unweighted student sample size of 922.
  • Kindergarten subgroup results were significant: 20.14 vs. 19.23, p = 0.01, effect size = 0.16; first grade differences were not significant: 21.37 vs. 20.80, p = 0.36, effect size = 0.09.
  • Skills mastered in My Math Academy were strongly related to post-test performance: the correlation between post-test score and cumulative number of skills mastered was 0.73, while the correlation with average weekly use was 0.18.
  • Among assessment items, treatment students performed better on several harder skills, including subtracting without regrouping (34% vs. 22%, χ² = 17.49, p < 0.001), adding three-digit numbers with regrouping in ones and tens (31% vs. 23%, χ² = 6.73, p < 0.01), and representing three-digit numbers with base-ten blocks (29% vs. 21%, χ² = 6.37, p < 0.05).

## Methods

  • Blocked cluster randomized design conducted between February and June 2019 across 41 classrooms in 11 high-needs elementary schools in two Southern California districts; teachers were randomized within school and grade to treatment (21 classrooms) or business-as-usual control (20 classrooms).
  • Sample included 988 students total (507 treatment, 481 control); analytic sample was 886 students in kindergarten and first grade who completed both pre- and post-assessments.
  • Main impact analysis used a two-level hierarchical linear model in Stata 16, regression-adjusted for baseline score and demographics; qualitative teacher surveys, interviews, and classroom observations were also analyzed using thematic coding in NVivo.

## Limitations

  • The paper states that treatment teachers used other interventions despite instructions not to, and some control teachers also used digital math programs similar to the intervention; the authors say this may have diluted the treatment contrast.
  • The paper states that the outcome assessment was not a standardized test but a researcher-developed measure, which may limit how well it captured student learning from My Math Academy.
  • The paper states that much of the sample was Latinx and language data were incomplete; several assessment items required reading short sentences, so post-test scores may partly reflect English proficiency rather than math knowledge.
  • Evident from the text: the study ran for only about 12 weeks due to a strike, which likely limited exposure and may have reduced observed effects.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1007/s10643-022-01332-3

Cites

94 of 94 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Fig. 1 Personalized masterybased learning model of My Math Academy
Fig. 1 Personalized masterybased learning model of My Math AcademyFrom the PDF
Image 2
From the PDF
Fig. 2 Effect of My Math Academy on the most advanced skills assessed
Fig. 2 Effect of My Math Academy on the most advanced skills assessedFrom the PDF
Fig. 3 Relationship between number of skills mastered in My Math Academy and posttest performance
Fig. 3 Relationship between number of skills mastered in My Math Academy and posttest performanceFrom the PDF
Fig. 4 Teachers' perception of educational technology on their students' math skills
Fig. 4 Teachers' perception of educational technology on their students' math skillsFrom the PDF
Fig. 5 Treatment teachers' experiences of using My Math Academy in their classrooms
Fig. 5 Treatment teachers' experiences of using My Math Academy in their classroomsFrom the PDF

Verification

Claims the paper makes

0 Valid · 1 Not valid · 18 Not checked · 86 Own results and interpretations

45 more claims

Create a free account to see all 105 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 28
  • It may state two separate claims as one. 35

Create a free account to see these claims.

Citations

Cites

Show all 83 references

Research works printed but not linked: 4

  1. Dietze, B., & Kashin, D., (2011). Playing and Learning in Early Childhood. Pearson Education Canada.
  2. Friedman, S., Masterson, M., & Wright, B. L. (2022). Context matters: Reframing teaching in early childhood education. In NAEYC (2022). Developmentally appropriate practice in early childhood programs serving children from birth through age 8. 4th ed, (pp. 48–51). Washington. DC: NAEYC.
  3. Higgins, P. S., Xiao, Z., & Katsipataki, M. (2012). The Impact of Digital Technology on Learning: A Summary for the Education Endowment Foundation (p. 52). Education Endowment Foundation.
  4. Levine, M.H. (April, 2018). What does the research say about tech and kids’ learning? Part 1 & 2. New York: NY: The Joan Ganz Cooney Center at Sesame Street Workshop. https://urldefense.com/v3/joanganzcooneycenter.org/blog/F8LM3WSaiTgsDg!2DF0X64sZ9X6ZanNq4mOM2_7xsCq3YXimyxC156ZfcV6k6jigOICk3lS6lOL191r$ .

Cited by

See all 91

Metadata

Authors
Bang, H. J., Li, L., & Flynn, K.
Affiliations
Wested (US)
Corresponding author
Bang, Hee Jin
Venue
Early Childhood Education Journal
Published
2022-04-01
Volume
51
Issue
4
Pages
717-732
ISSN
  • 1082-3301 (ISSN-L)
  • 1573-1707
OpenAlex
W4221067548
Cited by
91
References
83
Citations by year
2026: 37 · 2025: 24 · 2024: 18 · 2023: 11 · 2022: 1
FWCI
4.44
Type
journal article
Language
en
Open access
Licence
Locations
Early Childhood Education Journal (publishedVersion, cc-by)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
  • Social Sciences › Psychology › Developmental and Educational Psychology › Educational Games and Gamification
  • Social Sciences › Education › Mathematics Education and Teaching Techniques
Keywords
adaptive learning, game-based learning, personalized learning, early elementary mathematics, kindergarten children, first grade students, embedded assessment, student engagement, student motivation, student self-confidence in mathematics

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Efficacy of an Adaptive Game-Based Math Learning App to Support Personalized Learning and Improve Early Elementary School Students’ Learning. https://app.cochat.ai/papers/10.1007/s10643-022-01332-3
The paper
Bang, H. J., Li, L., & Flynn, K. (2023). Efficacy of an Adaptive Game-Based Math Learning App to Support Personalized Learning and Improve Early Elementary School Students’ Learning. Early Childhood Education Journal. https://doi.org/10.1007/s10643-022-01332-3

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.