A meta-analysis of effects of blended learning on performance, attitude, achievement, and engagement across different countries
Open accessThe DOI matches its Crossref record; 57 of the 60 references it cites were found in a registry or an index; 5 of the 32 sources its claims cite were checked for support.
Abstract
While this special pandemic period has been seeing an increasing use of blended learning, few studies have meta-analytically reviewed the effectiveness of blended learning in different countries. This meta-analysis summarizes previous studies on blended learning effectiveness in different countries in terms of students' performance, students' attitudes toward blended learning, learning achievement, and student engagement in different countries. Through the meta-analysis via Stata/MP 14.0, it is concluded that blended learning can improve performance, attitude, and achievement in most countries. However, in both China and the USA, blended learning cannot significantly improve student engagement in academic activities. No significant differences were revealed in student performance in the USA between blended and non-blended learning. Future research can extend the research into blended learning to more countries and areas across the world.
Overview
CoChat Summary
TL;DR
This PRISMA meta-analysis of 29 included results found that blended learning generally improved student performance, attitude, and achievement across multiple countries, but did not significantly improve student engagement in China or the USA. It also found no significant performance difference between blended and non-blended learning in the USA.
Key findings
- Blended learning significantly improved overall student performance (d = 0.50, 95% CI = 0.27–0.74, p < 0.01), with significant effects in China (d = 0.77, 95% CI = 0.44–1.10, p < 0.01) and Vietnam (d = 0.66, 95% CI = 0.06–1.27, p = 0.032), but not in the USA (d = −0.02, 95% CI = −0.27–0.23, p = 0.853).
- Blended learning significantly improved overall student attitude (d = 0.59, 95% CI = 0.37–0.80, p < 0.01), with significant positive effects in the United Arab Emirates (d = 1.43), China (d = 0.48), Singapore (d = 0.32), Vietnam (d = 0.43), the UK (d = 0.63), and the USA (d = 0.98).
- Blended learning significantly improved overall learning achievement (d = 0.30, 95% CI = 0.21–0.40, p < 0.01), with significant effects in Canada (d = 0.53), China (d = 0.27), Germany (d = 0.15), Spain (d = 0.47), the United Arab Emirates (d = 1.99), the UK (d = 0.47), Vietnam (d = 0.65), and the USA (d = 0.31).
- Blended learning did not significantly improve student engagement overall (d = 0.23, 95% CI = −0.09–0.55, p = 0.156), in China (d = 0.14, 95% CI = −0.06–0.34, p = 0.169), or in the USA (d = 0.51, 95% CI = −0.35–1.38, p = 0.245).
Methods
- The meta-analysis followed PRISMA and searched Elsevier ScienceDirect, Taylor and Francis Group, EBSCOhost, and Springer from inception until February 26, 2023, yielding 12,098 results; after screening, 29 results were included.
- Two researchers extracted means, standard deviations, and participant numbers for control and experimental groups, classified findings into performance, attitude, achievement, and engagement by country, and used Stata/MP 14.0 to calculate standardized mean differences (Cohen d) with 95% confidence intervals.
- Random-effect models were used because of high heterogeneity; Begg’s and Egger’s tests assessed publication bias, and a sensitivity analysis using “metan-based influence analysis” tested stability of effect sizes.
Limitations
- The paper states that the meta-analysis could not include all publications and non-published works due to limited library sources, that both Begg’s and Egger’s tests indicated publication bias, and that some identified research could not be completely retrieved.
- Evident from the text: heterogeneity was high across outcomes (e.g., I2 = 92.9% for performance, 76.9% for attitude, 87.4% for achievement, 89.5% for engagement), and several country-level results relied on single effect sizes, limiting generalizability.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures







Verification
Claims the paper makes
5 Valid · 0 Not valid · 15 Not checked · 55 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Most studies positively reported blended learning performances.”
§ A meta-analysis of effects of blended learning on performance, attitude, achievement, and engagement across different countries > 1. Introduction > 1.2. Performance
What the sources say
- Partly supportedcites McCutcheon et al., 2018 matched to “Online learning versus blended learning of clinical supervisee skills with pre-registration nursing students: a randomised controlled trial” (2018) sourceExperimental — accuracy not yet measured
The Results and Conclusion report positive outcomes for blended learning compared with online-only learning in this nursing-student trial, although knowledge scores remained low. This single trial does not establish that most studies reported positive blended-learning performance; the Introduction notes a lack of evidence from systematic reviews. (LLM, conf=0.85)
- Not checked — no full text of the sourcecites Mueller et al., 2020 matched to “Do we always need a difference? Testing equivalence in a blended learning setting” (2020) source
- Not checked — no full text of the sourcecites Hill et al., 2017 matched to “Playing 'catch up' with blended learning: performance impacts of augmenting classroom instruction with online learning” (2016) source
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The majority of learners positively assess the blended learning effectiveness.”
§ A meta-analysis of effects of blended learning on performance, attitude, achievement, and engagement across different countries > 1. Introduction > 1.3. Attitude
What the sources say
- Not checked — no full text of the sourcecites Jia et al., 2012 matched to “Effects of a vocabulary acquisition and assessment system on students' performance in a blended learning class for English subject” (2012) source
- Partly supportedcites Chang et al., 2014 matched to “Is blended e-learning as measured by an achievement test and self-assessment better than traditional classroom learning for vocational high school students?” (2014) sourceExperimental — accuracy not yet measured
The Discussion (p. 226) says students in the blended e-learning group had more positive perceptions of their cognition and skills than students in traditional learning. The Results also report higher overall self-assessment scores for the blended group. Neither passage establishes that a majority of learners positively assessed blended learning’s effectiveness. (LLM, conf=0.84)
- Not checked — no full text of the sourcecites Shorey et al., 2018 matched to “Blended learning pedagogy designed for communication module among undergraduate nursing students: a quasi-experimental study” (2018) source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Although blended learning is a popular teaching method, there have been conflicting findings regarding its impact on academic achievement in different countries.”
§ A meta-analysis of effects of blended learning on performance, attitude, achievement, and engagement across different countries > 1. Introduction > 1.6. Contradictory findings
What the sources say
- Partly supportedcites Chang et al., 2014 matched to “Is blended e-learning as measured by an achievement test and self-assessment better than traditional classroom learning for vocational high school students?” (2014) sourceExperimental — accuracy not yet measured
The Introduction reports earlier studies finding improved learning performance, while this paper’s Results found no significant difference in achievement-test scores. That supports the general point that findings differ, but the paper does not establish that the differences concern academic achievement across countries. (LLM, conf=0.84)
- Not checked — no full text of the sourcecites Yick et al., 2019 matched to “Effectiveness of blended learning in the first year of fashion education” (2019) source
- Not checked — no full text of the sourcecites Olitsky and Cosgrove, 2014 matched to “The effect of blended courses on student learning: evidence from introductory economics courses” (2014) source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“This conclusion is supported by the results of previous studies which mostly demonstrate the positive effects of blended learning on these outcomes (Yen and Lee, 2011; Chang et al., 2014).”
§ A meta-analysis of effects of blended learning on performance, attitude, achievement, and engagement across different countries > 4. Discussion
What the sources say
- Not checked — no full text of the sourcecites Yen and Lee, 2011 matched to “Exploring problem-solving patterns and their impact on learning achievement in a blended learning environment” (2011) source
- Partly supportedcites Chang et al., 2014 matched to “Is blended e-learning as measured by an achievement test and self-assessment better than traditional classroom learning for vocational high school students?” (2014) sourceExperimental — accuracy not yet measured
The Introduction reports that some previous studies found improved learning performance and positive effects of blended e-learning, including on attitudes; it does not establish that most studies found positive effects across all the named outcomes. In the Results and Discussion (page not specified), Chang et al. found higher self-assessment scores, but no significant improvement over traditional learning in achievement-test scores or attitude. (LLM, conf=0.87)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Through the meta-analysis via Stata/MP 14.0, it is concluded that blended learning can improve performance, attitude, and achievement in most countries.”
§ A meta-analysis of effects of blended learning on performance, attitude, achievement, and engagement across different countries > Abstract
plainstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
48 more claims
Create a free account to see all 75 claims and every source verdict.
- Probably not a substantial claim. 15
- It may state two separate claims as one. 13
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Consistentz = 2.66reported p = .008 · recomputed p = .008
“z = 2.66, p = .008”
- Consistentz = 8.88reported p < .01 · recomputed p < .001
“z = 8.88, p < .01”
- Consistentz = 4.59reported p < .01 · recomputed p < .001
“z = 4.59, p < .01”
- Consistentz = 2.14reported p = .032 · recomputed p = .032
“z = 2.14, p = .032”
- Consistentz = 0.19reported p = .853 · recomputed p = .849
“z = 0.19, p = .853”
20 more recomputed tests
Create a free account to see every test the Stats check recomputed.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ A meta-analysis of effects of blended learning on performance, attitude, achievement, and engagement across different countries > 1. Introduction > 1.5. Engagement
“Undergraduates at Point Loma Nazarene University in the USA spent significantly more time learning in a blended instruction model than in the traditional instruction model (Botts et al., 2018).”
§ A meta-analysis of effects of blended learning on performance, attitude, achievement, and engagement across different countries > 1. Introduction > 1.6. Contradictory findings
“However, research conducted at Point Loma Nazarene University in the USA showed no significant differences between blended and traditional instruction for an upper-division quantitative literacy course, and students also spent less time learning in blended courses (Botts et al., 2018).”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ A meta-analysis of effects of blended learning on performance, attitude, achievement, and engagement across different countries > 3. Results > 3.6. Can blended learning positively influence student engagement in different countries?
“We thus conclude that there are significant differences in student engagement between blended and non-blended learning in both China (d = 0.14, 95% CI = −0.06~0.34, z = 1.38, p = 0.169), the USA (d = 0.51, 95% CI = −0.35~1.38, z = 1.16, p = 0.245), and the overall results (d = 0.23, 95% CI = −0.09~0.55, z = 1.42, p = 0.156).”
§ A meta-analysis of effects of blended learning on performance, attitude, achievement, and engagement across different countries > Abstract
“However, in both China and the USA, blended learning cannot significantly improve student engagement in academic activities.”
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042 · cited 7×
“PRISMA aims to improve the reporting quality and transparency of systematic reviews and meta-analyses by providing a standardized framework that facilitates the critical appraisal and synthesis of research evidence.”
InfluentialMeasuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139 · cited 1×
“The formula to calculate I2 is: I2 = [(Q-df)/Q] × 100%, where Q indicates the Chi-squared statistics and df means the degree of freedom (Higgins and Thompson, 2002; Higgins et al., 2003).”
BackgroundBias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763 · cited 1×
“The formula to calculate I2 is: I2 = [(Q-df)/Q] × 100%, where Q indicates the Chi-squared statistics and df means the degree of freedom (Higgins and Thompson, 2002; Higgins et al., 2003).”
BackgroundWang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
Operating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225 · cited 2×
“It is thus a must to identify whether there is any estimate located beyond the scope of 95% confidence intervals (Borenstein et al., 2009).”
BackgroundNew Effect Size Rules of Thumb
Sawilowsky, S. S. (2009) · Journal of Modern Applied Statistical Methods · doi:10.22237/jmasm/1257035100 · Cited by 3,254 · cited 1×
“The effect size will be deemed very small if d approximates 0.1, small if d approximates 0.2,medium if d approximates 0.5, large if d approximates 0.8, very large if d approximates 1.2, huge if d approximates 2.0 (Sawilowsky, 2009).”
InfluentialThe Handbook of Blended Learning: Global Perspectives, Local Designs
Bonk, C. J., Graham, C. R., Cross, J., & Moore, M. G. (2005) · Cited by 2,905
Bernard, R. M., Borokhovski, E., Schmid, R. F., Tamim, R. M., & Abrami, P. C. (2014) · Journal of Computing in Higher Education · doi:10.1007/s12528-013-9077-3 · Cited by 870 · cited 1×
“Educational institutions must recognize this and provide training programs to improve students’ online technology skills (Bernard et al., 2014).”
BackgroundSun, J. C., & Rueda, R. (2012) · British Journal of Educational Technology · doi:10.1111/j.1467-8535.2010.01157.x · Cited by 785
It's not about seat time: Blending, flipping, and efficiency in active learning classrooms
Baepler, P., Walker, J. D., & Driessen, M. (2014) · Computers & Education · doi:10.1016/j.compedu.2014.06.006 · Cited by 778 · cited 1×
“A blended and flipped pedagogical approach could improve learning achievements and learning environment and raise the efficiency of space use in the USA (Baepler et al., 2014).”
Background(2007) · International journal on e-learning · Cited by 615
Thai, N. T. T., De Wever, B., & Valcke, M. (2017) · Computers & Education · doi:10.1016/j.compedu.2017.01.003 · Cited by 523 · cited 15×
“(3) Can blended learning positively influence learning achievement in different countries such as Canada, China, Germany, Spain, The United Arab Emirates, UK, USA, Vietnam, and Singapore?”
BackgroundInfluential"Hybrid" Teaching Seeks To End the Divide between Traditional and Online Instruction.
Young, J. R. (2002) · The chronicle of higher education · Cited by 482
The Student-Centered Activities for Large Enrollment Undergraduate Programs (SCALE-UP) project
Beichner, R. J., Saul, J. M., Abbott, D. S., Morse, J. J., Deardorff, D. L., Allain, R. J., Bonham, S. W., Dancy, M. H., & Risley, J. S. (2007) · Reviews in Physics Education Research · doi:10.1119/revperv1.1.4 · Cited by 430
Self‐determined blended learning: a case study of blended learning design
George‐Walker, L. D., & Keeffe, M. (2010) · Higher Education Research & Development · doi:10.1080/07294360903277380 · Cited by 238 · cited 1×
“Engagement in blended learning can be defined as the degree to which students are actively involved and invested in the learning process, both online and in-person (George-Walker et al., 2010).”
BackgroundThe promised land of blended learning: Quizzes as a moderator
Spanjers, I. A. E., Könings, K. D., Leppink, J., Verstegen, D. M. L., de Jong, N., Czabanowska, K., & van Merriënboer, J. J. G. (2015) · Educational Research Review · doi:10.1016/j.edurev.2015.05.001 · Cited by 208 · cited 1×
“Performance in blended learning can be defined as the measurable outcomes of a student’s achievement in both online and offline learning environments (Spanjers et al., 2015).”
BackgroundMcCutcheon, K., O’Halloran, P., & Lohan, M. (2018) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2018.02.005 · Cited by 190 · cited 1×
“Blended learning, outperforming full online learning in the aspects of motivation, attitudes, and satisfaction, can improve nurses’ clinical knowledge compared with the traditional learning approach in the UK (McCutcheon et al., 2018).”
ResultBerga, K.-A., Vadnais, E., Nelson, J., Johnston, S., Buro, K., Hu, R., & Olaiya, B. (2021) · Nurse Education Today · doi:10.1016/j.nedt.2020.104622 · Cited by 168 · cited 1×
“university in Alberta, Canada had no significant differences in self-efficacy and knowledge scores compared to those using nonblended instruction, despite positively perceiving blended learning (Berga et al., 2021).”
BackgroundYen, J.-C., & Lee, C.-Y. (2011) · Computers & Education · doi:10.1016/j.compedu.2010.08.012 · Cited by 167 · cited 3×
“The interaction was considered an important factor influencing blended learning effectiveness among Chinese freshmen (Yen and Lee, 2011).”
BackgroundResultYang, Y.-T. C., Chuang, Y.-C., Li, L.-Y., & Tseng, S.-S. (2013) · Computers & Education · doi:10.1016/j.compedu.2012.12.012 · Cited by 147 · cited 2×
“analysis, inference, evaluation, induction, and deduction in China (Yang et al., 2013).”
MethodJia, J., Chen, Y., Ding, Z., & Ruan, M. (2012) · Computers & Education · doi:10.1016/j.compedu.2011.08.002 · Cited by 142 · cited 1×
“Blended learning, conducive to students’ positive attitude and satisfaction, could improve English listening skills and enhance vocabulary acquisition among junior middle school students in China (Jia et al., 2012).”
BackgroundStudent satisfaction, learning outcomes, and cognitive loads with a mobile learning platform
Yu, Z., Zhu, Y. N., Yang, Z., & Wentao, C. (2018) · Computer Assisted Language Learning · doi:10.1080/09588221.2018.1517093 · Cited by 142
Feitosa de Moura, V., Alexandre de Souza, C., & Noronha Viana, A. B. (2021) · Computers & Education · doi:10.1016/j.compedu.2020.104077 · Cited by 135
Shorey, S., Kowitlawakul, Y., Devi, M. K., Chen, H.-C., Soong, S. K. A., & Ang, E. (2018) · Nurse Education Today · doi:10.1016/j.nedt.2017.11.011 · Cited by 112 · cited 10×
“(3) Can blended learning positively influence learning achievement in different countries such as Canada, China, Germany, Spain, The United Arab Emirates, UK, USA, Vietnam, and Singapore?”
BackgroundInfluential(2016) · Educational Technology & Society · Cited by 109
Blending a class video blog to optimize student learning outcomes in higher education
Liu, M.-H. (2016) · The Internet and Higher Education · doi:10.1016/j.iheduc.2016.03.001 · Cited by 95 · cited 2×
“…Lee Gordon et al. (2005) EBSCOhost Achievement USA 8 Hill et al. (2017) EBSCOhost Achievement USA 9 Jia et al. (2012) Elsevier Achievement China 10 Liu (2016) Elsevier Achievement and performance China 11 López-Pérez et al. (2013) Springer Achievement Spain 12 Macaruso et al. (2020) Springer…”
BackgroundBlended learning for college students with English reading difficulties
Yang, Y. (2011) · Computer Assisted Language Learning · doi:10.1080/09588221.2011.597767 · Cited by 93 · cited 2×
“Blended learning could enable Chinese college students to extensively practice with flexible time and space, greatly improving their English reading skills (Yang, 2012).”
BackgroundBlended Learning Over Two Decades
Yu, Z. (2015) · International Journal of Information and Communication Technology Education · doi:10.4018/ijicte.2015070101 · Cited by 75 · cited 2×
“There are three most popular definitions of blended learning (Bonk and Graham, 2012), blending instructional modalities (Yu, 2015; Thomson, 2020; Min and Yu, 2023a), instructional methods (Li and Yu, 2023), and online learning with face-to-face instructional approaches (Young, 2002; Ward and LaBranche, 2003).”
BackgroundAn investigation of blended learning to support reading instruction in elementary schools
Macaruso, P., Wilkes, S., & Prescott, J. E. (2020) · Educational Technology Research and Development · doi:10.1007/s11423-020-09785-2 · Cited by 69 · cited 1×
“Blended learning could greatly improve the reading abilities of children in a kindergarten in the USA (Macaruso et al., 2020).”
BackgroundA Systematic Review of Critical Success Factors in Blended Learning
Min, W., & Yu, Z. (2023) · Education Sciences · doi:10.3390/educsci13050469 · Cited by 69 · cited 2×
“…learning activities could improve students’ academic achievements among undergraduate students in University of Granada in Spain, where influencing factors included attendance rate and students’ backgrounds rather than the time they spent on learning (López-Pérez et al., 2013; Min and Yu, 2023b).”
BackgroundThe influence of the use of technology on student outcomes in a blended learning context
López-Pérez, M. V., Pérez-López, M. C., Rodríguez-Ariza, L., & Argente-Linares, E. (2013) · Educational Technology Research and Development · doi:10.1007/s11423-013-9303-8 · Cited by 68 · cited 1×
“Online learning activities could improve students’ academic achievements among undergraduate students in University of Granada in Spain, where influencing factors included attendance rate and students’ backgrounds rather than the time they spent on learning (López-Pérez et al., 2013; Min and Yu, 2023b).”
BackgroundBlended learning and traditional learning: a comparative study of college mechanics courses
Bazelais, P., & Doleck, T. (2018) · Education and Information Technologies · doi:10.1007/s10639-018-9748-9 · Cited by 68 · cited 10×
“(3) Can blended learning positively influence learning achievement in different countries such as Canada, China, Germany, Spain, The United Arab Emirates, UK, USA, Vietnam, and Singapore?”
BackgroundInfluentialLee Gordon, D., Issenberg, S. B., Gordon, M. S., LaCombe, D., McGaghie, W. C., & Petrusa, E. R. (2005) · Medical Teacher · doi:10.1080/01421590400029756 · Cited by 67
The effect of blended courses on student learning: evidence from introductory economics courses
Olitsky, N. H., & Cosgrove, S. B. (2014) · International Review of Economics Education · doi:10.1016/j.iree.2013.10.009 · Cited by 62 · cited 1×
“Additionally, research conducted in an American university showed no demonstrable benefits of blended learning in terms of learning outcomes for economics courses (Olitsky and Cosgrove, 2014).”
BackgroundMeta-analyses: standardised mean differences
Sedgwick, P., & Marston, L. (2013) · BMJ · doi:10.1136/bmj.f7257 · Cited by 61
Meta-analyses of differences in blended and traditional learning outcomes and students' attitudes
Yu, Z., XU, W., & Sukjairungwattana, P. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.926947 · Cited by 58
Huang, H., Hwang, G.-J., & Jong, M. S.-Y. (2022) · Computers & Education · doi:10.1016/j.compedu.2022.104593 · Cited by 57 · cited 1×
“By being asked to answer questions and focus on the course material, students are able to improve their performance (Huang et al., 2022).”
BackgroundStrengths-based blended personalized learning: An impact study using virtual comparison group
McCarthy, E. M., Liu, Y., & Schauer, K. L. (2020) · Journal of Research on Technology in Education · doi:10.1080/15391523.2020.1716202 · Cited by 54
Al-Qatawneh, S. S., Eltahir, M. E., & Alsalhi, N. R. (2019) · Education and Information Technologies · doi:10.1007/s10639-019-10046-w · Cited by 52 · cited 1×
“For instance, a study conducted in the United Arab Emirates found no significant differences in attitudes toward blended or traditional approaches, which could be due to either internal or external factors (Al-Qatawneh et al., 2020).”
BackgroundChallenges for collaborative blended learning in undergraduate students
Monteiro, E., & Morrison, K. (2014) · Educational Research and Evaluation · doi:10.1080/13803611.2014.997126 · Cited by 45 · cited 3×
“This instruction can help students understand the benefits and challenges associated with each approach, ultimately leading to improved learning outcomes (Monteiro and Morrison, 2014).”
BackgroundInfluentialChang, C.-C., Shu, K.-M., Liang, C., Tseng, J.-S., & Hsu, Y.-S. (2014) · The International Review of Research in Open and Distributed Learning · doi:10.19173/irrodl.v15i2.1708 · Cited by 44 · cited 5×
“For instance, a study conducted in China found that while students believed that blended learning had a positive impact on their achievement, empirical evidence showed no significant improvement (Chang et al., 2014).”
BackgroundResultInfluentialEffectiveness of blended learning in the first year of fashion education
Yick, K.-L., Yip, J., Au, S.-C., Lai, Y.-Y., & Yu, A. (2019) · International Journal of Fashion Design, Technology and Education · doi:10.1080/17543266.2018.1546910 · Cited by 40 · cited 1×
“Similarly, research conducted in Hong Kong China indicated no significant differences in Fashion learning achievements between blended and traditional approaches (Yick et al., 2019).”
BackgroundClerical Medical feeds back on blended learning
Williams, S. (2003) · Industrial and Commercial Training · doi:10.1108/00197850310458207 · Cited by 39
Blended learning applied to the study of mechanical couplings in engineering
Cortizo, J. L., Rodríguez, E., Vijande, R., Sierra, J. M., & Noriega, A. (2010) · Computers & Education · doi:10.1016/j.compedu.2009.10.006 · Cited by 35 · cited 11×
“Blended learning via information and communication technologies could significantly improve learning achievements of mechanical couplings in engineering in Spain (Cortizo et al., 2010).”
BackgroundInfluentialInal, M., & Korkmaz, Ö. (2019) · Education and Information Technologies · doi:10.1007/s10639-019-09890-7 · Cited by 33 · cited 2×
“Achievement in blended learning can be defined as the level of success or accomplishment that students attain when participating and completing a blend of online and traditional face-to-face learning activities (Inal and Korkmaz, 2019).”
BackgroundAcceptance and effectiveness of Rain Classroom in linguistics classes
Yu, Z., & Yi, H. (2020) · International Journal of Mobile and Blended Learning · doi:10.4018/ijmbl.2020040105 · Cited by 33 · cited 1×
“Furthermore, they are able to learn at their own pace and in a location of their choosing, which reduces the burden of travel time and carrying heavy books (Yu and Yi, 2020).”
BackgroundZhou, C. (2018) · Educational Sciences Theory & Practice · doi:10.12738/estp.2018.5.009 · Cited by 27 · cited 2×
“…Lee (2011) Elsevier Performance China 24 Yen and Lee (2011) Elsevier Achievement China 25 Yick et al. (2019) Taylor and Francis Achievement China 26 Zhou (2018) EBSCOhost Achievement China 27 Huang et al. (2022) Elsevier Performance China 28 Rattanasak (2023) MERT BASTAS PUBLISHING CO Performance…”
BackgroundYeşilbağ, S., & Korkmaz, Ö. (2020) · Education and Information Technologies · doi:10.1007/s10639-020-10264-7 · Cited by 24
A case study on the use of blended learning to encourage computer science students to study
Pérez-Marín, D., & Pascual-Nieto, I. (2012) · Journal of Science Education and Technology · doi:10.1007/s10956-011-9283-6 · Cited by 21
Hill, T., Chidambaram, L., & Summers, J. D. (2016) · Behaviour & Information Technology · doi:10.1080/0144929x.2016.1189964 · Cited by 20 · cited 1×
“It was revealed that both classroom and online learning could enhance American students’ learning performance, but the blended learning brought about the largest gain in performance in the USA (Hill et al., 2017).”
BackgroundUsing the blended learning approach in a quantitative literacy course
Botts, R. T., Carter, L., & Crockett, C. (2018) · PRIMUS · doi:10.1080/10511970.2017.1371264 · Cited by 16
Web-based music learning environment
Zhou, Y. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2023.2185640 · Cited by 14 · cited 1×
“…Francis Achievement China 26 Zhou (2018) EBSCOhost Achievement China 27 Huang et al. (2022) Elsevier Performance China 28 Rattanasak (2023) MERT BASTAS PUBLISHING CO Performance Thailand 29 Zhou (2023) Routledge Achievement China > 0.05), we will use a fixed-effect model to run the meta-analysis.”
MethodInfluentialRattanasak, S. (2023) · Online Journal of Communication and Media Technologies · doi:10.30935/ojcmt/13050 · Cited by 12 · cited 1×
“…et al. (2019) Taylor and Francis Achievement China 26 Zhou (2018) EBSCOhost Achievement China 27 Huang et al. (2022) Elsevier Performance China 28 Rattanasak (2023) MERT BASTAS PUBLISHING CO Performance Thailand 29 Zhou (2023) Routledge Achievement China > 0.05), we will use a fixed-effect model…”
MethodInfluentialDo we always need a difference? Testing equivalence in a blended learning setting
Mueller, C., Mildenberger, T., & Lübcke, M. (2020) · International Journal of Research & Method in Education · doi:10.1080/1743727x.2019.1680621 · Cited by 9 · cited 9×
“(3) Can blended learning positively influence learning achievement in different countries such as Canada, China, Germany, Spain, The United Arab Emirates, UK, USA, Vietnam, and Singapore?”
BackgroundInfluential
Research works printed but not linked: 3
- Bonk, 2006, Handbook of Blended Learning: Global Perspectives, Local Designs, 8
- Cohen, 1988, Statistical Power Analysis for the Behavioral Sciences, 2nd Edn.
- Min, A Systematic Review of Critical Success Factors in Blended Learning, 10.3390/educsci13050469 · DOI
Cited by
E-learning platforms in higher education: A comparative review of the USA and Africa
Adeniyi, I. S., Hamad, N. M. A., Adewusi, O. E., Unachukwu, C. C., Osawaru, B., Chilson, O. U., Omolawal, S. A., Aliu, A. O., & David, I. O. (2024) · International Journal of Science and Research Archive · doi:10.30574/ijsra.2024.11.1.0283 · Cited by 90
“In the USA, blended learning combines in-person instruction with online resources, offering flexibility, catering to different learning styles, and enhancing student engagement and collaboration (Cao, 2023).”
BackgroundHybrid teaching after COVID-19: advantages, challenges and optimization strategies
Wang, X., Liu, J., Jia, S., Hou, C., Jiao, R., Yan, Y., Ma, T., Zhang, Y., Liu, Y., Wen, H., et al. (2024) · BMC Medical Education · doi:10.1186/s12909-024-05745-z · Cited by 47
“Moreover, researchers have found that hybrid teaching cannot significantly improve student engagement in academic activities in China and USA [7].”
BackgroundYu, Y., Tak, K. B. C., Bailey, R. P., Samsudin, N., & Ren, C. (2025) · Sustainability · doi:10.3390/su17020378 · Cited by 35
Bosch, C. (2024) · Journal of Education and e-Learning Research · doi:10.20448/jeelr.v11i2.5468 · Cited by 19
“Students who are intrinsically motivated in a blended learning environment are more likely to experience a heightened sense of well-being, which in turn contributes to their academic performance and overall success (Alsalhi, Al-Qatawneh, Eltahir, & Aqel, 2021; Cao, 2023) .”
BackgroundYu, Q., Yu, K., & Wang, J. (2025) · Behavioral Sciences · doi:10.3390/bs15091263 · Cited by 21
“Moreover, a meta-analysis also compares the effectiveness of BL across different countries (Cao, 2023).”
Metadata
- Authors
- Cao, W.
- Affiliations
- Qufu Normal University (CN)
- Corresponding author
- Cao, Wenwen
- ORCID
- Cao, Wenwen
- Venue
- Frontiers in Psychology
- Publisher
- Frontiers Media SA
- Published
- 2023-07-12
- Volume
- 14
- Pages
- 1212056-1212056
- ISSN
- 1664-1078 (ISSN-L)
- PMC
- PMC10369798
- OpenAlex
- W4384025286
- Semantic Scholar
- a5c5e22b4256155905a97be14da37319607d9828
- Cited by
- 94
- References
- 60
- Citations by year
- 2026: 31 · 2025: 33 · 2024: 26 · 2023: 4
- FWCI
- 5.81
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Psychology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Education › Online and Blended Learning
- Social Sciences › Education › English Language Learning and Teaching
- Physical Sciences › Computer Science › Information Systems › Educational Technology and E-Learning
- Keywords
- blended learning, student performance, student attitudes, academic performance, student engagement, cross-national comparison, COVID-19 pandemic, China
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-30, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-30 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.