To Flip or Not to Flip? A Meta-Analysis of the Efficacy of Flipped Learning in Higher Education
The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
Although flipped classroom pedagogies have been widely touted for their ability to foster diverse 21st-century learning objectives, previous syntheses of flipped learning have focused almost exclusively on outcomes related to academic achievement. Using data from 317 studies, our research addresses this deficit by providing a comprehensive meta-analysis of the effects of flipped versus lecture-based learning on academic, intra-/interpersonal, and satisfaction-related outcomes in higher education. Overall, flipped classroom interventions produced positive gains across all three learning domains, and we found significant advantages of flipped over lecture-based instruction for seven out of eight outcomes (gs = 0.20–0.53). At the same time, there was substantial heterogeneity in flipped learning effects, and we identified several variables that influenced the relative efficacy of flipped versus traditional courses. Of the three types of moderators examined (contextual, design-based, and methodological), educational context (e.g., discipline, location) accounted for the most variability in flipped learning outcomes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Active learning increases student performance in science, engineering, and mathematics
Freeman, S., Eddy, S. L., McDonough, M., Smith, M. K., Okoroafor, N., Jordt, H., & Wenderoth, M. P. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1319030111 · Cited by 9,787 · cited 1×
“A meta-analysis of 225 studies in STEM (science, technology, engineering, and mathematics) found that, compared with lecture-based learning, students who engaged in active learning performed better on exams and were less likely to fail the course (Freeman et al., 2014).”
Does Active Learning Work? A Review of the Research
Prince, M. (2004) · Journal of Engineering Education · doi:10.1002/j.2168-9830.2004.tb00809.x · Cited by 7,334 · cited 4×
“Other research has touted the benefits of active learning for developing a broad range of higher-order learning outcomes (critical thinking, interpersonal skills, etc.) and improving student satisfaction (Prince, 2004).”
BackgroundInfluentialDistribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695 · cited 2×
“Because differential sample size across studies can bias effect sizes obtained from unadjusted standardized mean differences (i.e., Cohen’s d), we used Hedges’s g to adjust effect sizes to correct bias arising from small samples (Hedges, 1981; Hedges & Olkin, 1985).”
MethodThe Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
Fixed-and random-effects models in meta-analysis.
Hedges, L. V., & Vevea, J. L. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.486 · Cited by 2,977
Outlier and influence diagnostics for meta-analysis
Viechtbauer, W., & Cheung, M. W.-L. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.11 · Cited by 2,949 · cited 1×
“Last, to examine the extent to which our results are robust to outliers, we identified observations with standardized residuals of greater than 3 in absolute magnitude (Viechtbauer & Cheung, 2010).”
BackgroundCognitive Load Theory and Complex Learning: Recent Developments and Future Directions
van Merriënboer, J. J. G., & Sweller, J. (2005) · Educational Psychology Review · doi:10.1007/s10648-005-3951-0 · Cited by 2,206
Hattie, J. (2012) · doi:10.4324/9780203181522 · Cited by 2,155
The use of flipped classrooms in higher education: A scoping review
O'Flaherty, J., & Phillips, C. (2015) · The Internet and Higher Education · doi:10.1016/j.iheduc.2015.02.002 · Cited by 2,152 · cited 2×
“Overall, these reviews tend to conclude that flipped learning is associated with increased student achievement, motivation, and engagement (O’Flaherty & Phillips, 2015; Zainuddin & Halili, 2016).”
BackgroundA Fail-Safe N for Effect Size in Meta-Analysis
Orwin, R. G. (1983) · Journal of Educational Statistics · doi:10.2307/1164923 · Cited by 2,064
Research Synthesis and Meta-Analysis: A Step-by-Step Approach
Cooper, H. (2017) · doi:10.4135/9781071878644 · Cited by 1,716
Meta-analysis of experiments with matched groups or repeated measures designs
Dunlap, W. P., Cortina, J. M., Vaslow, J. B., & Burke, M. J. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.170 · Cited by 1,693 · cited 2×
“Although none of the studies reported pre-post correlations (which can influence effect sizes for pretestposttest designs; Dunlap et al., 1996), we were able to obtain these data from five authors and calculate an average pre-post correlation (r = .53) to use in studies where these data were…”
BackgroundMethodTheobald, E. J., Hill, M. J., Tran, E., Agrawal, S., Arroyo, E. N., Behling, S., Chambwe, N., Cintrón, D. L., Cooper, J. D., Dunster, G., et al. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1916903117 · Cited by 1,387
Morrison, A., Polisena, J., Husereau, D., Moulton, K., Clark, M., Fiander, M., Mierzwinski-Urban, M., Clifford, T., Hutton, B., & Rabb, D. (2012) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462312000086 · Cited by 1,257 · cited 2×
“Although excluding non-English articles is unlikely to have substantially altered our overall meta-analytic conclusions (Morrison et al., 2012; Nussbaumer-Streit et al., 2020), the impact of potential language bias on regional effect estimates may be greater—particularly in regions where few eligible studies were avai…”
BackgroundExperimental and Quasi-Experimental Studies of Inquiry-Based Science Teaching: A Meta-Analysis
Furtak, E. M., Seidel, T., Iverson, H., & Briggs, D. C. (2012) · Review of Educational Research · doi:10.3102/0034654312457206 · Cited by 1,021
Estimation of a Single Effect Size: Parametric and Nonparametric Methods
Hedges, L. V., & Olkin, I. (1985) · Statistical Methods for Meta-Analysis · doi:10.1016/b978-0-08-057065-5.50010-5 · Cited by 983
Meta-Analysis of Inquiry-Based Learning: Effects of Guidance
Lazonder, A. W., & Harmsen, R. (2016) · Review of Educational Research · doi:10.3102/0034654315627366 · Cited by 967 · cited 1×
“Unlike homework, these flipped classroom exercises can be guided by the instructor, which tends to lead to greater learning than when conducted independently (Furtak et al., 2012; Lazonder & Harmsen, 2016).”
BackgroundCognitive load theory and educational technology
Sweller, J. (2020) · Educational Technology Research and Development · doi:10.1007/s11423-019-09701-3 · Cited by 911
Fu, R., Gartlehner, G., Grant, M., Shamliyan, T., Sedrakyan, A., Wilt, T. J., Griffith, L., Oremus, M., Raina, P., Ismaila, A., et al. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.08.010 · Cited by 730
Uttl, B., White, C. A., & Gonzalez, D. W. (2017) · Studies in Educational Evaluation · doi:10.1016/j.stueduc.2016.08.007 · Cited by 615 · cited 1×
“Despite being smaller than the observed academic and intra-/interpersonal gains (cf. Uttl et al., 2017), these results can provide some reassurance to instructors that converting to a flipped classroom is unlikely to hurt their individual evaluations and could slightly improve their course ratings.”
ResultCultural clusters: methodology and findings
Gupta, V., Hanges, P. J., & Dorfman, P. (2002) · Journal of World Business · doi:10.1016/s1090-9516(01)00070-0 · Cited by 583 · cited 7×
“Effect sizes from Middle Eastern countries also were higher than those from Europe, whereas effects in North America/Australia and Latin America did not differ.”
BackgroundInfluentialA systematic review of research on the flipped learning method in engineering education
Karabulut‐Ilgu, A., Jaramillo Cherrez, N., & Jahren, C. T. (2018) · British Journal of Educational Technology · doi:10.1111/bjet.12548 · Cited by 581 · cited 4×
“…discipline, for instance, has been forwarded as potentially relevant to the success of flipped models, with some arguing that applied STEM fields such as engineering or health professions may be particularly well-suited to flipped learning (F. Chen et al., 2017; Karabulut-Ilgu et al., 2018).”
BackgroundInfluentialGetting Under the Hood: How and for Whom Does Increasing Course Structure Work?
Eddy, S. L., & Hogan, K. A. (2014) · CBE—Life Sciences Education · doi:10.1187/cbe.14-03-0050 · Cited by 553 · cited 2×
“Compared with their “majority” classmates, racially minoritized and first-generation students reap greater academic gains from active learning interventions, narrowing the achievement gap between these groups (Eddy & Hogan, 2014; Theobald et al., 2020).”
BackgroundHow Methodological Features Affect Effect Sizes in Education
Cheung, A. C. K., & Slavin, R. E. (2016) · Educational Researcher · doi:10.3102/0013189x16656615 · Cited by 529 · cited 2×
“…consistent with Låg and Sæle’s (2019) discovery that randomized studies produced larger effects than those with unequal or unknown equivalence, and suggests that the noise introduced into poorly controlled studies may attenuate estimates of flipped learning effects (cf. Cheung & Slavin, 2016).”
BackgroundCheng, L., Ritzhaupt, A. D., & Antonenko, P. (2019) · Educational Technology Research and Development · doi:10.1007/s11423-018-9633-7 · Cited by 494
Nussbaumer-Streit, B., Klerings, I., Dobrescu, A. I., Persad, E., Stevens, A., Garritty, C., Kamel, C., Affengruber, L., King, V. J., & Gartlehner, G. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.10.011 · Cited by 440
Estimating the Difference Between Published and Unpublished Effect Sizes: A Meta-Review
Polanin, J. R., Tanner-Smith, E. E., & Hennessy, E. A. (2016) · Review of Educational Research · doi:10.3102/0034654315582067 · Cited by 234 · cited 1×
“To examine potential publication bias, we first conducted moderation analyses comparing the magnitude of the effect sizes produced by published (peer-reviewed articles, book chapters) versus unpublished (conference papers, dissertations) studies for each domain (Polanin et al., 2016).”
MethodRisk of bias: a simulation study of power to detect study-level moderator effects in meta-analysis
Hempel, S., Miles, J. N., Booth, M. J., Wang, Z., Morton, S. C., & Shekelle, P. G. (2013) · Systematic Reviews · doi:10.1186/2046-4053-2-107 · Cited by 137 · cited 1×
“Third, given the notorious difficulty of detecting small moderation effects in highly heterogeneous meta-analytic samples (Hempel et al., 2013), the relative dearth of moderation effects for intra-/interpersonal skills and satisfaction should be interpreted with caution.”
BackgroundThe use of meta-analytic statistical significance testing
Polanin, J. R., & Pigott, T. D. (2015) · Research Synthesis Methods · doi:10.1002/jrsm.1124 · Cited by 78 · cited 1×
“conducted (and thus minimizing the risk of type I error; Polanin & Pigott, 2015), meta-regression addresses the tendency for study characteristics to correlate (e.g., studies from certain disciplines being more common in certain countries), which can potentially confound univariate relationships…”
Background
Cited by
Schmid, R. F., Borokhovski, E., Bernard, R. M., Pickup, D. I., & Abrami, P. C. (2023) · Computers and Education Open · doi:10.1016/j.caeo.2023.100142 · Cited by 70
Exploring the Effectiveness of Flipped Classroom on STEM Student Achievement: A Meta-analysis
Gong, J., Cai, S., & Cheng, M. (2024) · Technology, Knowledge and Learning · doi:10.1007/s10758-023-09700-7 · Cited by 42
Nie, X., Tian, Y., Liu, M., Wu, D., & Guo, Y. (2025) · Education and Information Technologies · doi:10.1007/s10639-025-13735-x · Cited by 20
“The context of study encompasses factors such as educational level (i.e., higher education, K-12), subject (i.e., social science, science, or irrelevant with subject), and study location (i.e., geographical regions) (Bredow et al., 2021; Gupta et al., 2002).”
Metadata
- Authors
- Bredow, C. A., Roehling, P. V., Knorp, A. J., & Sweet, A. M.
- Venue
- Review of Educational Research
- Published
- 2021-06-28
- Volume
- 91
- Issue
- 6
- Pages
- 878-918
- ISSN
- 0034-6543 (ISSN-L)
- 1935-1046
- OpenAlex
- W3173953468
- Cited by
- 162
- References
- 29
- FWCI
- 8.04
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.