The DOI matches its Crossref record; 92 of the 93 references it cites were found in a registry or an index.
Measures Matter: A Meta-Analysis of the Effects of Educational Apps on Preschool to Grade 3 Children’s Literacy and Math Skills
Open accessAbstract
Thousands of educational apps are available to students, teachers, and parents, yet research on their effectiveness is limited. This meta-analysis synthesized findings from 36 intervention studies and 285 effect sizes evaluating the effectiveness of educational apps for preschool to Grade 3 children and the moderating role of methodological, participant, and intervention characteristics. Using random effects meta-regression with robust variance estimation, we summarized the overall impact of educational apps and examined potential moderator effects. First, results from rigorous experimental and quasi-experimental studies yielded a mean weighted effect size of +0.31 standard deviations on overall achievement and comparable effects in both math and literacy. Second, the positive overall effect masks substantial variability in app effectiveness, as meta-regression analyses revealed three significant moderators of treatment effects. Treatment effects were larger for studies involving preschool rather than K–3 students, for studies using researcher-developed rather than standardized outcomes, and for studies measuring constrained rather than unconstrained skills.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, in a more nuanced meta-analysis of experimental and quasi-experimental studies, there was a beneficial impact on children’s math and literacy skills when using educational apps.89”
From Digital Ecosystems, Children, and Adolescents: Technical Report (2026) · cites this paper as [89]
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099 · cited 3×
“We used the trim and fill method to assess the potential impact of missing, unpub-lished studies on mean effects (Duval & Tweedie, 2000).”
Method(2002) · Cited by 13,211
Durlak, J. A., Weissberg, R. P., Dymnicki, A. B., Taylor, R. D., & Schellinger, K. B. (2011) · Child Development · doi:10.1111/j.1467-8624.2010.01564.x · Cited by 10,854 · cited 1×
“The codebook was based on previous meta-analytic reviews of literacy intervention studies and prior research indicating the factors that would influence student outcomes (Durlak et al., 2011; Guo et al., 2020; J. S. Kim & Quinn, 2013; Lipsey et al., 2012; Marulis & Neuman, 2013).”
MethodThe Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553 · cited 2×
“…therefore tested for publication bias and file drawer effects by (a) testing a moderator effect of a dichotomous published peer-reviewed article indicator, (b) using a trim and fill analysis (Duval & Tweedie, 2000), and (c) plotting a cumulative meta-analysis forest plot (Borenstein et al., 2009).”
BackgroundMethodThe gamification of learning: a meta-analysis
Sailer, M., & Homner, L. (2020) · Educational Psychology Review · doi:10.1007/s10648-019-09498-w · Cited by 2,594 · cited 2×
“Furthermore, the mean effects from our meta-analysis are consistent with recent meta-analyses of digital games and gamified learning interventions (Clark et al., 2016; Sailer & Homner, 2020; Wouters et al., 2013).”
BackgroundResultContemporary Issues in Technology and Teacher Education
(2025) · Contemporary issues in technology and teacher education · doi:10.70725/833004pqfpbd · Cited by 2,368
When and where do we apply what we learn?: A taxonomy for far transfer
Barnett, S. M., & Ceci, S. J. (2002) · Psychological Bulletin · doi:10.1037/0033-2909.128.4.612 · Cited by 2,076 · cited 1×
“In many ways, improvement on a standardized outcome measure provides an index of far transfer (Barnett & Ceci, 2002; National Academies of Sciences, Engineering, and Medicine, 2018), highlighting whether students have mastered a broad domain of transferable knowledge that is not overly aligned with…”
Background
Research works printed but not linked: 12
- Baker S., 2018, The 2018 Technology & Learning Insights Report: Towards understanding app effectiveness and cost
- *Cary M., 2019, KinderTEK iPad Math Program: Results from Cohort 1
- *Cary M., 2014, Evaluating the KinderTEK iPad App’s individualized and adaptive math instruction
- *Fletcher N. (2015). Development and evaluation of a computer program to teach symmetry to young children [Doctoral dissertation, Columbia University]. https://academiccommons.columbia.edu/doi/10.7916/D8RF5T4Z · doi:10.7916/d8rf5t4z
- Guernsey L., 2012, Pioneering literacy in the digital wild west: Empowering parents and educators
- Head T. S., 2016, Supporting literacy with iPads: A pilot study in second-grade classrooms
- *Kosko K., 2016, Journal of Computers in Mathematics and Science Teaching, 35, 61
- Richards J., 2014, 2014 U.S. education technology industry market: PreK-12
- Rideout V., 2017, The Common Sense census: Media use by kids age zero to eight
- Rideout V., 2020, The Common Sense census: Media use by kids age zero to eight, 2020
- Shapiro J., 2018, The new childhood: Raising kids to thrive in a digitally connected world
- 10.4159/9780674970250 · doi:10.4159/9780674970250
Cited by
Department of Preschool Education, F. O. E., Papadakis, S., Kalogiannakis, M., Faculty of Education & Department of Preschool Education, T. U. O. C., Zaranis, N., & Faculty of Education & Department of Preschool Education, T. U. O. C. (2021) · Advances in Mobile Learning Educational Research · doi:10.25082/amler.2021.01.002 · Cited by 171
Sanders, T., Noetel, M., Parker, P., Del Pozo Cruz, B., Biddle, S., Ronto, R., Hulteen, R., Parker, R., Thomas, G., De Cocker, K., et al. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01712-8 · Cited by 148
Effectiveness of conceptual change strategies in science education: A meta‐analysis
Paçacı, Ç., Üstün, U., & Özdemir, Ö. F. (2023) · Journal of Research in Science Teaching · doi:10.1002/tea.21887 · Cited by 123
Educational robotics and STEAM in early childhood education
Chaldi, D., Mantzanidou, G., & Kindergarten of Drepano, K. T. (2021) · Advances in Mobile Learning Educational Research · doi:10.25082/amler.2021.02.003 · Cited by 78
Patel, P., Torppa, M., Aro, M. T., Richardson, U., & Lyytinen, H. (2021) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12592 · Cited by 48
Metadata
- Authors
- Kim, J., Gilbert, J., Yu, Q., & Gale, C.
- Affiliations
- Harvard University (US)
- Boston College (US)
- Corresponding author
- Kim, James
- Venue
- AERA Open
- Publisher
- SAGE Publications
- Published
- 2021-01
- Volume
- 7
- ISSN
- 2332-8584 (ISSN-L)
- OpenAlex
- W3142656127
- Cited by
- 102
- References
- 93
- Citations by year
- 2026: 25 · 2025: 15 · 2024: 23 · 2023: 25 · 2022: 9 · 2021: 5
- FWCI
- 3.84
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- AERA Open (publishedVersion, cc-by-nc)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Education › Child Development and Digital Technology
- Physical Sciences › Computer Science › Information Systems › Mobile Learning in Education
- Social Sciences › Education › Early Childhood Education and Development
- Keywords
- educational apps, digital learning interventions, early childhood education, preschool children, K-3 students, literacy skills, mathematical skills, academic performance, application effectiveness, treatment moderators
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Measures Matter: A Meta-Analysis of the Effects of Educational Apps on Preschool to Grade 3 Children’s Literacy and Math Skills. https://app.cochat.ai/papers/10.1177/23328584211004183
- The paper
- Kim, J., Gilbert, J., Yu, Q., & Gale, C. (2021). Measures Matter: A Meta-Analysis of the Effects of Educational Apps on Preschool to Grade 3 Children’s Literacy and Math Skills. AERA Open. https://doi.org/10.1177/23328584211004183
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.