The DOI matches its Crossref record; 82 of the 82 references it cites were found in a registry or an index.
Does the Flipped Classroom Improve Student Learning and Satisfaction? A Systematic Review and Meta-Analysis
Open accessAbstract
We searched and meta-analyzed studies comparing flipped classroom teaching with traditional, lecture-based teaching to evaluate the evidence for the flipped classroom’s influence on continuous-learning measures, pass/fail rates, and student evaluations of teaching. Eight electronic reference databases were searched to retrieve relevant studies. Our results indicate a small effect in favor of the flipped classroom on learning (Hedges’ g = 0.35, 95% confidence interval [CI] [0.31, 0.40], k = 272). However, analyses restricted to studies with sufficient power resulted in an estimate of 0.24 (95% CI [0.18, 0.31], k = 90). Effects on pass rates (odds ratio = 1.55, 95% CI [1.34, 1.78], k = 45) and student satisfaction (Hedges’ g = 0.16, 95% CI [0.06, 0.26], k = 69) were small and also likely influenced by publication bias. There is some support for the notion that the positive impact on learning may increase slightly if testing student preparation is part of the implementation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Operating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
Active learning increases student performance in science, engineering, and mathematics
Freeman, S., Eddy, S. L., McDonough, M., Smith, M. K., Okoroafor, N., Jordt, H., & Wenderoth, M. P. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1319030111 · Cited by 9,787
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group (2010) · BMJ · doi:10.1136/bmj.c332 · Cited by 9,329
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068 · cited 2×
“Although we have taken steps to avoid a biased selection of studies by searching several databases indexing conference papers, doctoral dissertations, master’s theses, as well as a wide selection of institutional archives through BASE, we should nevertheless check for bias as statistically significant findings are mor…”
ResultPower failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641 · cited 2×
“Furthermore, there is a risk that small, underpowered studies overestimate any effects reported, partly because statistical tests in such studies will reach significance only if the sample mean difference happens to be very large (Button et al., 2013; Ioannidis, 2008; Sterne, Gavaghan, & Egger, 2000).”
BackgroundDoes Active Learning Work? A Review of the Research
Prince, M. (2004) · Journal of Engineering Education · doi:10.1002/j.2168-9830.2004.tb00809.x · Cited by 7,334 · cited 6×
“…be sound logic behind the idea of making time for more learning activity, because evidence is accumulating that teaching for active learning leads to better student performance and lower failure rates than lecture-based teaching (Freeman, Eddy, McDonough, et al., 2014; Michael, 2006; Prince, 2004).”
BackgroundInfluential(2008) · Cited by 6,939
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
Flip Your Classroom: Reach Every Student in Every Class Every Day
Sams, A., & Bergmann, J. (2012) · Medical Entomology and Zoology · Cited by 3,810
Fleiss, J. L., & Cohen, J. (1973) · Educational and Psychological Measurement · doi:10.1177/001316447303300309 · Cited by 3,354
Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013) · Psychological Science in the Public Interest · doi:10.1177/1529100612453266 · Cited by 3,138
Fixed-and random-effects models in meta-analysis.
Hedges, L. V., & Vevea, J. L. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.486 · Cited by 2,977
A Nonparametric “Trim and Fill” Method of Accounting for Publication Bias in Meta-Analysis
Duval, S., & Tweedie, R. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10473905 · Cited by 2,955
From Teaching to Learning —A New Paradigm For Undergraduate Education
Barr, R. B., & Tagg, J. (1995) · Change: The Magazine of Higher Learning · doi:10.1080/00091383.1995.10544672 · Cited by 2,887
Learning Together and Alone: Cooperative, Competitive, and Individualistic Learning
Johnson, D. W., & Johnson, R. T. (1998) · Cited by 2,586
Publication and related bias in meta-analysis
Sterne, J. A. C., Gavaghan, D., & Egger, M. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00242-0 · Cited by 2,282
The use of flipped classrooms in higher education: A scoping review
O'Flaherty, J., & Phillips, C. (2015) · The Internet and Higher Education · doi:10.1016/j.iheduc.2015.02.002 · Cited by 2,152
Handbook of Self-Regulation of Learning and Performance
Schunk, D. H. (2011) · Routledge eBooks · doi:10.4324/9780203839010 · Cited by 2,122
Abeysekera, L., & Dawson, P. (2015) · Higher Education Research & Development · doi:10.1080/07294360.2014.934336 · Cited by 1,847
Where's the evidence that active learning works?
Michael, J. (2006) · Advances in Physiology Education · doi:10.1152/advan.00053.2006 · Cited by 1,648
Why Most Discovered True Associations Are Inflated
Ioannidis, J. P. A. (2008) · Epidemiology · doi:10.1097/ede.0b013e31818131e7 · Cited by 1,495 · cited 2×
“Furthermore, there is a risk that small, underpowered studies overestimate any effects reported, partly because statistical tests in such studies will reach significance only if the sample mean difference happens to be very large (Button et al., 2013; Ioannidis, 2008; Sterne, Gavaghan, & Egger, 2000).”
BackgroundAppelbaum, M., Cooper, H., Kline, R. B., Mayo-Wilson, E., Nezu, A. M., & Rao, S. M. (2018) · American Psychologist · doi:10.1037/amp0000191 · Cited by 1,449 · cited 1×
“This is recommended in various reporting standards (American Educational Research Association, 2006; Appelbaum et al., 2018; Schulz, Altman, & Moher, 2010) but is not generally followed.”
BackgroundSumming Up: The Science of Reviewing Research
Light, R. J., & Pillemer, D. B. (1984) · Harvard University Press eBooks · doi:10.4159/9780674040243 · Cited by 1,427
The flipped classroom: A review of its advantages and challenges
Akçayır, G., & Akçayır, M. (2018) · Computers & Education · doi:10.1016/j.compedu.2018.07.021 · Cited by 1,343
Flipped classroom improves student learning in health professions education: a meta-analysis
HEW, K. F., & LO, C. K. (2018) · BMC Medical Education · doi:10.1186/s12909-018-1144-z · Cited by 1,207
Becoming a self-regulated learner: Which are the key subprocesses?
Zimmerman, B. J. (1986) · Contemporary Educational Psychology · doi:10.1016/0361-476x(86)90027-5 · Cited by 1,188
Consequences of prejudice against the null hypothesis.
Greenwald, A. G. (1975) · Psychological Bulletin · doi:10.1037/h0076157 · Cited by 1,022 · cited 1×
“…as well as a wide selection of institutional archives through BASE, we should nevertheless check for bias as statistically significant findings are more likely to be reported than null results (Dickersin, 2005; Greenwald, 1975; Pigott, Valentine, Polanin, Williams, & Canada, 2013; Rosenthal, 1979).”
Estimation of a Single Effect Size: Parametric and Nonparametric Methods
Hedges, L. V., & Olkin, I. (1985) · Statistical Methods for Meta-Analysis · doi:10.1016/b978-0-08-057065-5.50010-5 · Cited by 983
Hunter, J. E., & Schmidt, F. L. (2000) · International Journal of Selection and Assessment · doi:10.1111/1468-2389.00156 · Cited by 833 · cited 1×
“This model arguably provides a better fit with real-world data and tends to reduce the probability of Type I errors in significance tests (Field, 2005; Hunter & Schmidt, 2000).”
MethodFlipping the classroom for English language learners to foster active learning
Hung, H.-T. (2015) · Computer Assisted Language Learning · doi:10.1080/09588221.2014.967701 · Cited by 790
A systematic review of the effectiveness of flipped classrooms in medical education
Chen, F., Lui, A. M., & Martinelli, S. M. (2017) · Medical Education · doi:10.1111/medu.13272 · Cited by 749
Field, A. P. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.2.161 · Cited by 725
Peters, J. L., Sutton, A. J., Jones, D. R., Abrams, K. R., & Rushton, L. (2007) · Statistics in Medicine · doi:10.1002/sim.2889 · Cited by 716
Flipping the Classroom to Improve Student Performance and Satisfaction
Missildine, K., Fountain, R., Summers, L., & Gosselin, K. (2013) · Journal of Nursing Education · doi:10.3928/01484834-20130919-03 · Cited by 696
Cooperative Learning: Improving University Instruction by Basing Practice on Validated Theory.
Johnson, D. W., Johnson, R. T., & Smith, K. A. (2014) · Journal on excellence in college teaching · Cited by 695
On the Validity of Student Evaluation of Teaching: The State of the Art
Spooren, P., Brockx, B., & Mortelmans, D. (2013) · Review of Educational Research · doi:10.3102/0034654313496870 · Cited by 665
Educational Leadership: Together Creating Ethical Learning Environments
Duignan, P. (2012) · Cambridge University Press eBooks · doi:10.1017/cbo9781139197045 · Cited by 664
The applicability of Visible Learning to higher education
Hattie, J. (2015) · Scholarship of Teaching and Learning in Psychology · doi:10.1037/stl0000021 · Cited by 656 · cited 1×
“In his massive synthesis of meta-analyses on teaching and learning strategies, Hattie (2009, 2011, 2015) found that promotion of metacognitive and self-regulatory strategies stimulating active learning is an important factor for academic performance.”
BackgroundUttl, B., White, C. A., & Gonzalez, D. W. (2017) · Studies in Educational Evaluation · doi:10.1016/j.stueduc.2016.08.007 · Cited by 615
The evidence for ‘flipping out’: A systematic review of the flipped classroom in nursing education
Betihavas, V., Bridgman, H., Kornhaber, R., & Cross, M. (2016) · Nurse Education Today · doi:10.1016/j.nedt.2015.12.010 · Cited by 597
A systematic review of research on the flipped learning method in engineering education
Karabulut‐Ilgu, A., Jaramillo Cherrez, N., & Jahren, C. T. (2018) · British Journal of Educational Technology · doi:10.1111/bjet.12548 · Cited by 581 · cited 1×
“Some have found that studies of the flipped classroom tend to report increased satisfaction and improvement in examination results or course grades (Akçayır & Akçayır, 2018; Brewer & Movahedazarhouligh, 2018; Karabulut-Ilgu et al., 2018), but the evidence is at least partly anecdotal (Bishop & Verleger, 2013) and ofte…”
Background(2006) · Educational Researcher · doi:10.3102/0013189x035006033 · Cited by 543
Cheng, L., Ritzhaupt, A. D., & Antonenko, P. (2019) · Educational Technology Research and Development · doi:10.1007/s11423-018-9633-7 · Cited by 494
Student evaluations of teaching (mostly) do not measure teaching effectiveness
Boring, A., Ottoboni, K., & Stark, P. B. (2016) · ScienceOpen Research · doi:10.14293/s2199-1006.1.sor-edu.aetbzc.v1 · Cited by 470
Psychology and the real world: Essays illustrating fundamental contributions to society.
Gernsbacher, M. A., Pew, R. W., Hough, L. M., & Pomerantz, J. R. (2011) · Cited by 460
Student learning and perceptions in a flipped linear algebra course
Love, B., Hodge, A., Grandgenett, N., & Swift, A. W. (2014) · International Journal of Mathematical Education in Science and Technology · doi:10.1080/0020739x.2013.822582 · Cited by 458
Test-enhanced learning in the classroom: Long-term improvements from quizzing.
Roediger, H. L., Agarwal, P. K., McDaniel, M. A., & McDermott, K. B. (2011) · Journal of Experimental Psychology: Applied · doi:10.1037/a0026252 · Cited by 386
Chen (2018) · doi:10.1111/medu.13616 · Cited by 348
Is the Meta-Analysis of Correlation Coefficients Accurate When Population Correlations Vary?
Field, A. P. (2005) · Psychological Methods · doi:10.1037/1082-989x.10.4.444 · Cited by 328
Retrieval-Based Learning: An Episodic Context Account
Karpicke, J. D., Lehman, M. S., & Aue, W. R. (2012) · Current Directions in Psychological Science · Cited by 314
The flipped classroom and cooperative learning: Evidence from a randomised experiment
Foldnes, N. (2016) · Active Learning in Higher Education · doi:10.1177/1469787415616726 · Cited by 305
Publication Bias: Recognizing the Problem, Understanding Its Origins and Scope, and Preventing Harm
Dickersin, K. (2005) · Publication Bias in Meta‐Analysis · doi:10.1002/0470870168.ch2 · Cited by 291
Retrieval-Based Learning: Active Retrieval Promotes Meaningful Learning
Karpicke, J. D. (2012) · Current Directions in Psychological Science · doi:10.1177/0963721412443552 · Cited by 277
Team-Based Learning: A Transformative Use of Small Groups
(2002) · Praeger eBooks · doi:10.5040/9798216023364 · Cited by 271
Will Teachers Receive Higher Student Evaluations by Giving Higher Grades and Less Course Work?
Centra, J. A. (2003) · Research in Higher Education · doi:10.1023/a:1025492407752 · Cited by 266
No pain, no gain? The importance of measuring course workload in student ratings of instruction.
Greenwald, A. G., & Gillmore, G. M. (1997) · Journal of Educational Psychology · doi:10.1037//0022-0663.89.4.743 · Cited by 244
Burgess, A. W., McGregor, D. M., & Mellis, C. M. (2014) · Academic Medicine · doi:10.1097/acm.0000000000000162 · Cited by 244
Retrieval-Based Learning: Active Retrieval Promotes Meaningful Learning
Karpicke, J. D. (2012) · Current Directions in Psychological Science · Cited by 232
Higher education dominance and siloed knowledge: a systematic review of flipped classroom research
Lundin, M., Bergviken Rensfeldt, A., Hillman, T., Lantz-Andersson, A., & Peterson, L. (2018) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-018-0101-6 · Cited by 227
Flipped Learning: A Guide for Higher Education Faculty
Talbert, R. (2017) · Bibliothèque et Archives nationales du Québec (Québec government) · Cited by 220
Brewer, R., & Movahedazarhouligh, S. (2018) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12250 · Cited by 193
Stroebe, W. (2016) · Perspectives on Psychological Science · doi:10.1177/1745691616650284 · Cited by 173
Effectiveness of flipped classrooms in nursing education: Systematic review and meta-analysis
Tan, C., Yue, W., & Fu, Y. (2017) · Chinese Nursing Research · doi:10.1016/j.cnre.2017.10.006 · Cited by 162
Flipping the Classroom With Team-Based Learning in Undergraduate Nursing Education
Ratta, C. D. (2014) · Nurse Educator · doi:10.1097/nne.0000000000000112 · Cited by 141
Effects of Small-Group Learning on Transfer: a Meta-Analysis
Pai, H.-H., Sears, D. A., & Maeda, Y. (2015) · Educational Psychology Review · doi:10.1007/s10648-014-9260-8 · Cited by 140 · cited 1×
“Reviews of studies investigating the effects of such approaches on student achievement and other outcomes seem to indicate they do, indeed, contribute positively (e.g., Burgess et al., 2014; Johnson et al., 2014; Liu & Beaujean, 2017; Pai et al., 2015).”
BackgroundAmerican Journal of Pharmaceutical Education
(1965) · American Journal of Pharmaceutical Education · doi:10.1016/s0002-9459(24)10301-4 · Cited by 140
Distinguishing Between Good (Useful) and Bad Workloads on Students’ Evaluations of Teaching
Marsh, H. W. (2001) · American Educational Research Journal · doi:10.3102/00028312038001183 · Cited by 131
Outcome-Reporting Bias in Education Research
Pigott, T. D., Valentine, J. C., Polanin, J. R., Williams, R. T., & Canada, D. D. (2013) · Educational Researcher · doi:10.3102/0013189x13507104 · Cited by 127
Hu, R., Gao, H., Ye, Y., Ni, Z., Jiang, N., & Jiang, X. (2017) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2017.11.012 · Cited by 127
Wiggins, B. L., Eddy, S. L., Grunspan, D. Z., & Crowe, A. J. (2017) · AERA Open · doi:10.1177/2332858417708567 · Cited by 103
Dunlosky, J., & Rawson, K. A. (2015) · Scholarship of Teaching and Learning in Psychology · doi:10.1037/stl0000024 · Cited by 95
Meta-Analysis of Group Learning Activities: Empirically Based Teaching Recommendations
Tomcho, T. J., & Foels, R. (2012) · Teaching of Psychology · doi:10.1177/0098628312450414 · Cited by 80
Goldstein, H., Crawford, K. C., & Schneider, N. (2014) · Exceptional Children · doi:10.1177/0014402914522423 · Cited by 71
How ASCD Supports the Common Core.
Mercado, E., & Britt, S. (2013) · Educational leadership · Cited by 60
Robinson, C. D., Scott, W., & Gottfried, M. A. (2019) · AERA Open · doi:10.1177/2332858419839707 · Cited by 47
Which Strategies Best Enhance Teaching and Learning in Higher Education?
Hattie, J. (2011) · Empirical Research in Teaching and Learning · doi:10.1002/9781444395341.ch8 · Cited by 37
Meaning Making and “The Learning Paradigm”: A Provocative Idea in Practice
Fear, F. A., Doberneck, D. M., Robinson, C. F., Fear, K. L., Barr, R. B., Berg, H. V. D., Smith, J. K., & Petrulis, R. (2003) · Innovative Higher Education · doi:10.1023/a:1022351126015 · Cited by 33
Ten Challenges and Recommendations for Advancing Research on the Effects of College on Students
Seifert, T. A., Bowman, N. A., Wolniak, G. C., Rockenbach, A. N., & Mayhew, M. J. (2017) · AERA Open · doi:10.1177/2332858417701683 · Cited by 20
Cited by
Gamification of in‐class activities in flipped classroom lectures
Sailer, M., & Sailer, M. (2021) · British Journal of Educational Technology · doi:10.1111/bjet.12948 · Cited by 234
Tutal, Ö., & Yazar, T. (2021) · Asia Pacific Education Review · doi:10.1007/s12564-021-09706-9 · Cited by 57
Exploring the Effectiveness of Flipped Classroom on STEM Student Achievement: A Meta-analysis
Gong, J., Cai, S., & Cheng, M. (2024) · Technology, Knowledge and Learning · doi:10.1007/s10758-023-09700-7 · Cited by 42
Metadata
- Authors
- Låg, T., & Sæle, R. G.
- Venue
- AERA Open
- Publisher
- SAGE Publications
- Published
- 2019-07
- Volume
- 5
- Issue
- 3
- ISSN
- 2332-8584 (ISSN-L)
- OpenAlex
- W2969755620
- Cited by
- 265
- References
- 82
- FWCI
- 9.57
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.