The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
The effects of educational robotics in STEM education: a multilevel meta-analysis
Open accessAbstract
Educational robotics, as emerging technologies, have been widely applied in the field of STEM education to enhance the instructional and learning quality. Although previous research has highlighted potentials of applying educational robotics in STEM education, there is a lack of empirical evidence to investigate and understand the overall effects of using educational robotics in STEM education as well as the critical factors that influence the effects. To fill this gap, this research conducted a multilevel meta-analysis to examine the overall effect size of using educational robotics in STEM education under K-16 education based on 30 effect sizes from 21 studies published between 2010 and 2022. Furthermore, we examined the possible moderator variables of robot-assisted STEM education, including discipline, educational level, instructor support, instructional strategy, interactive type, intervention duration, robotic type, and control group condition. Results showed that educational robotics had the moderate-sized effects on students’ STEM learning compared to the non-robotics condition. Specifically, educational robotics had moderate-sized effects on students’ learning performances and learning attitudes, and insignificant effects on the improvement of computational thinking. Furthermore, we examined the influence of moderator variables in robot-assisted STEM education. Results indicated that the moderator variable of discipline was significantly associated with the effects of educational robotics on STEM learning. Based on the findings, educational and technological implications were provided to guide future research and practice in the application of educational robotics in STEM education.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bowden, J., Davey Smith, G., & Burgess, S. (2015) · International Journal of Epidemiology · doi:10.1093/ije/dyv080 · Cited by 9,816 · cited 2×
“Second, the Egger’s test is a statistical method used to plot the effect size estimates against their standard errors (Bowden et al., 2015).”
MethodDistribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695
Wohlin, C. (2014) · Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering · doi:10.1145/2601248.2601268 · Cited by 4,234 · cited 1×
“Additionally, snowball-ing approach, was also utilized (Wohlin, 2014) to find the articles that were not extracted in database search through citation checking.”
MethodHox, J., Moerbeek, M., & van de Schoot, R. (2010) · doi:10.4324/9780203852279 · Cited by 3,469
A Fail-Safe N for Effect Size in Meta-Analysis
Orwin, R. G. (1983) · Journal of Educational Statistics · doi:10.2307/1164923 · Cited by 2,064 · cited 1×
“Funnel plot, Egger’s test (Bowden et al., 2015) and Rosenthal’s Fail-safe N test (Orwin, 1983) were used together to detect publication bias.”
MethodSocial robots for education: a review.
Belpaeme, T., Kennedy, J., Ramachandran, A., Scassellati, B., & Tanaka, F. (2018) · Science Robotics · doi:10.1126/scirobotics.aat5954 · Cited by 1,558
Publication bias in the social sciences: Unlocking the file drawer
Franco, A., Malhotra, N., & Simonovits, G. (2014) · Science · doi:10.1126/science.1255484 · Cited by 1,542 · cited 1×
“Since studies with positive findings were more likely to be published, we checked if there was any publication bias in this meta-analysis (Franco et al., 2014; Thornton & Lee, 2000).”
BackgroundCheung, M. W.-L. (2014) · Psychological Methods · doi:10.1037/a0032968 · Cited by 1,342
Fitting three-level meta-analytic models in R: A step-by-step tutorial
Assink, M., & Wibbelink, C. J. M. (2016) · The Quantitative Methods for Psychology · doi:10.20982/tqmp.12.3.p154 · Cited by 1,330
Publication bias in meta-analysis its causes and consequences
Thornton, A. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00161-4 · Cited by 1,291 · cited 1×
“Since studies with positive findings were more likely to be published, we checked if there was any publication bias in this meta-analysis (Franco et al., 2014; Thornton & Lee, 2000).”
Background
Cited by
Villegas-Ch, W., Buenano-Fernandez, D., Navarro, A. M., & Mera-Navarrete, A. (2025) · Smart Learning Environments · doi:10.1186/s40561-025-00389-y · Cited by 80
“The architecture of the intelligent tutoring system for teaching STEM skills is designed to provide an adaptive and personalized learning experience based on a modular infrastructure that enables seamless interaction between various AI components (Ouyang and Xu, 2024).”
Metadata
- Authors
- Ouyang, F., & Xu, W.
- Venue
- International Journal of STEM Education
- Published
- 2024-02-01
- Volume
- 11
- Issue
- 1
- ISSN
- 2196-7822 (ISSN-L)
- OpenAlex
- W4391437137
- Cited by
- 171
- References
- 28
- FWCI
- 25.45
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The effects of educational robotics in STEM education: a multilevel meta-analysis. https://app.cochat.ai/papers/10.1186/s40594-024-00469-4
- The paper
- Ouyang, F., & Xu, W. (2024). The effects of educational robotics in STEM education: a multilevel meta-analysis. International Journal of STEM Education. https://doi.org/10.1186/s40594-024-00469-4
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.