Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 57 of the 60 references it cites were found in a registry or an index; 5 of the 32 sources its claims cite were checked for support.

A meta-analysis of effects of blended learning on performance, attitude, achievement, and engagement across different countries

Open access
Cao, Wenwen · 2023 · Frontiers in Psychology

Abstract

While this special pandemic period has been seeing an increasing use of blended learning, few studies have meta-analytically reviewed the effectiveness of blended learning in different countries. This meta-analysis summarizes previous studies on blended learning effectiveness in different countries in terms of students' performance, students' attitudes toward blended learning, learning achievement, and student engagement in different countries. Through the meta-analysis via Stata/MP 14.0, it is concluded that blended learning can improve performance, attitude, and achievement in most countries. However, in both China and the USA, blended learning cannot significantly improve student engagement in academic activities. No significant differences were revealed in student performance in the USA between blended and non-blended learning. Future research can extend the research into blended learning to more countries and areas across the world.

Overview

CoChat Summary

TL;DR

This PRISMA meta-analysis of 29 included results found that blended learning generally improved student performance, attitude, and achievement across multiple countries, but did not significantly improve student engagement in China or the USA. It also found no significant performance difference between blended and non-blended learning in the USA.

Key findings

  • Blended learning significantly improved overall student performance (d = 0.50, 95% CI = 0.27–0.74, p < 0.01), with significant effects in China (d = 0.77, 95% CI = 0.44–1.10, p < 0.01) and Vietnam (d = 0.66, 95% CI = 0.06–1.27, p = 0.032), but not in the USA (d = −0.02, 95% CI = −0.27–0.23, p = 0.853).
  • Blended learning significantly improved overall student attitude (d = 0.59, 95% CI = 0.37–0.80, p < 0.01), with significant positive effects in the United Arab Emirates (d = 1.43), China (d = 0.48), Singapore (d = 0.32), Vietnam (d = 0.43), the UK (d = 0.63), and the USA (d = 0.98).
  • Blended learning significantly improved overall learning achievement (d = 0.30, 95% CI = 0.21–0.40, p < 0.01), with significant effects in Canada (d = 0.53), China (d = 0.27), Germany (d = 0.15), Spain (d = 0.47), the United Arab Emirates (d = 1.99), the UK (d = 0.47), Vietnam (d = 0.65), and the USA (d = 0.31).
  • Blended learning did not significantly improve student engagement overall (d = 0.23, 95% CI = −0.09–0.55, p = 0.156), in China (d = 0.14, 95% CI = −0.06–0.34, p = 0.169), or in the USA (d = 0.51, 95% CI = −0.35–1.38, p = 0.245).

Methods

  • The meta-analysis followed PRISMA and searched Elsevier ScienceDirect, Taylor and Francis Group, EBSCOhost, and Springer from inception until February 26, 2023, yielding 12,098 results; after screening, 29 results were included.
  • Two researchers extracted means, standard deviations, and participant numbers for control and experimental groups, classified findings into performance, attitude, achievement, and engagement by country, and used Stata/MP 14.0 to calculate standardized mean differences (Cohen d) with 95% confidence intervals.
  • Random-effect models were used because of high heterogeneity; Begg’s and Egger’s tests assessed publication bias, and a sensitivity analysis using “metan-based influence analysis” tested stability of effect sizes.

Limitations

  • The paper states that the meta-analysis could not include all publications and non-published works due to limited library sources, that both Begg’s and Egger’s tests indicated publication bias, and that some identified research could not be completely retrieved.
  • Evident from the text: heterogeneity was high across outcomes (e.g., I2 = 92.9% for performance, 76.9% for attitude, 87.4% for achievement, 89.5% for engagement), and several country-level results relied on single effect sizes, limiting generalizability.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.3389/fpsyg.2023.1212056

Cites

57 of 57 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 A flowchart of literature inclusion.
Figure 1 A flowchart of literature inclusion.CC BY · PubMed Central
Figure 2 A funnel plot of tests for publication bias.
Figure 2 A funnel plot of tests for publication bias.CC BY · PubMed Central
Figure 3 A plot of results of the sensitivity analysis.
Figure 3 A plot of results of the sensitivity analysis.CC BY · PubMed Central
Figure 4 A forest plot of student performance in different countries.
Figure 4 A forest plot of student performance in different countries.CC BY · PubMed Central
Figure 5 A forest plot of student attitude in different countries.
Figure 5 A forest plot of student attitude in different countries.CC BY · PubMed Central
Figure 6 A forest plot of students' achievements in different countries.
Figure 6 A forest plot of students' achievements in different countries.CC BY · PubMed Central
Figure 7 A forest plot of students' engagement in different countries.
Figure 7 A forest plot of students' engagement in different countries.CC BY · PubMed Central

Verification

Claims the paper makes

5 Valid · 0 Not valid · 15 Not checked · 55 Own results and interpretations

48 more claims

Create a free account to see all 75 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 15
  • It may state two separate claims as one. 13

Create a free account to see these claims.

Statistics recomputed

Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.

  • Consistentz = 2.66reported p = .008 · recomputed p = .008

    “z = 2.66, p = .008”

  • Consistentz = 8.88reported p < .01 · recomputed p < .001

    “z = 8.88, p < .01”

  • Consistentz = 4.59reported p < .01 · recomputed p < .001

    “z = 4.59, p < .01”

  • Consistentz = 2.14reported p = .032 · recomputed p = .032

    “z = 2.14, p = .032”

  • Consistentz = 0.19reported p = .853 · recomputed p = .849

    “z = 0.19, p = .853”

5 of 25 · the rest aren’t loaded

20 more recomputed tests

Create a free account to see every test the Stats check recomputed.

See all tests — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

2 of 2

Citations

Cites

Show all 60 references

Research works printed but not linked: 3

  1. Bonk, 2006, Handbook of Blended Learning: Global Perspectives, Local Designs, 8
  2. Cohen, 1988, Statistical Power Analysis for the Behavioral Sciences, 2nd Edn.
  3. Min, A Systematic Review of Critical Success Factors in Blended Learning, 10.3390/educsci13050469 · DOI

Cited by

See all 94

Metadata

Authors
Cao, W.
Affiliations
Qufu Normal University (CN)
Corresponding author
Cao, Wenwen
Venue
Frontiers in Psychology
Published
2023-07-12
Volume
14
Pages
1212056-1212056
ISSN
1664-1078 (ISSN-L)
OpenAlex
W4384025286
Cited by
94
References
60
Citations by year
2026: 31 · 2025: 33 · 2024: 26 · 2023: 4
FWCI
5.81
Type
journal article
Language
en
Open access
Locations
  • Frontiers in Psychology (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Social Sciences › Education › Online and Blended Learning
  • Social Sciences › Education › English Language Learning and Teaching
  • Physical Sciences › Computer Science › Information Systems › Educational Technology and E-Learning
Keywords
blended learning, student performance, student attitudes, academic performance, student engagement, cross-national comparison, COVID-19 pandemic, China

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-09-30, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-09-30 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A meta-analysis of effects of blended learning on performance, attitude, achievement, and engagement across different countries. https://app.cochat.ai/papers/10.3389/fpsyg.2023.1212056
The paper
Cao, W. (2023). A meta-analysis of effects of blended learning on performance, attitude, achievement, and engagement across different countries. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2023.1212056

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.