Flipped classroom improves student learning in health professions education: a meta-analysis
Open accessAbstract
BACKGROUND: The use of flipped classroom approach has become increasingly popular in health professions education. However, no meta-analysis has been published that specifically examines the effect of flipped classroom versus traditional classroom on student learning. This study examined the findings of comparative articles through a meta-analysis in order to summarize the overall effects of teaching with the flipped classroom approach. We focused specifically on a set of flipped classroom studies in which pre-recorded videos were provided before face-to-face class meetings. These comparative articles focused on health care professionals including medical students, residents, doctors, nurses, or learners in other health care professions and disciplines (e.g., dental, pharmacy, environmental or occupational health). METHOD: Using predefined study eligibility criteria, seven electronic databases were searched in mid-April 2017 for relevant articles. Methodological quality was graded using the Medical Education Research Study Quality Instrument (MERSQI). Effect sizes, heterogeneity estimates, analysis of possible moderators, and publication bias were computed using the COMPREHENSIVE META-ANALYSIS software. RESULTS: A meta-analysis of 28 eligible comparative studies (between-subject design) showed an overall significant effect in favor of flipped classrooms over traditional classrooms for health professions education (standardized mean difference, SMD = 0.33, 95% confidence interval, CI = 0.21-0.46, p < 0.001), with no evidence of publication bias. In addition, the flipped classroom approach was more effective when instructors used quizzes at the start of each in-class session. More respondents reported they preferred flipped to traditional classrooms. CONCLUSIONS: Current evidence suggests that the flipped classroom approach in health professions education yields a significant improvement in student learning compared with traditional teaching methods.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
This finding is in line with previous meta-analyses showing that formative assessments between pre-class and in-class activities can greatly enhance learning.
“This finding is in line with previous meta-analyses (Hew & Lo, 2018b;Låg & Sæle, 2019;Lo & Hew, 2019;van Alten et al., 2019) showing that formative assessments (e.g., quizzes or reviews) used between pre-class activities and in-class activities can greatly enhance students' learning.”
From Exploring the Effectiveness of Flipped Classroom on STEM Student Achievement: A Meta-analysis (2024) · cites this paper as Hew & Lo, 2018b
The Discussion and Conclusions report that quizzes assessing pre-class material at the start of an in-class session made flipped classrooms more effective in health professions education. They do not establish the same result for formative assessments such as reviews generally, or quantify the added benefit as a great enhancement. (LLM, conf=0.84)
Experimental — accuracy not yet measuredOnly peer-reviewed journal studies were included, as their results are believed to be of sufficient quality.
“Only peer-reviewed journal studies were included, as their results are believed to be of sufficient quality (Cheng et al., 2019a;Hew & Lo, 2018a;Korpershoek et al., 2016;Lo et al., 2017).”
From Exploring the Effectiveness of Flipped Classroom on STEM Student Achievement: A Meta-analysis (2024) · cites this paper as Hew & Lo, 2018a
Previous reviews found small effect sizes under a random effects model across engineering, mathematics, and health profession education.
“According to some previous reviews (Chen et al., 2018;Hew & Lo, 2018a;Lo et al., 2017), the effect sizes were small under a random effect sizes model across three disciplines (engineering, mathematics, and health profession education).”
From Exploring the Effectiveness of Flipped Classroom on STEM Student Achievement: A Meta-analysis (2024) · cites this paper as Hew & Lo, 2018a
Hew & Lo (2018a) found that using quizzes at the start of face-to-face courses can help students recall knowledge, identify misconceptions, and improve learning outcomes.
“(Hew & Lo, 2018a) found in their meta-analysis that using quizzes at the start of face-to-face courses can help students recall knowledge and identify possible misconceptions and so improve learning outcomes.”
From Exploring the Effectiveness of Flipped Classroom on STEM Student Achievement: A Meta-analysis (2024) · cites this paper as Hew & Lo, 2018a
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554 · see citing works
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225 · see citing works
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799 · see citing works
The use of flipped classrooms in higher education: A scoping review
O'Flaherty, J., & Phillips, C. (2015) · The Internet and Higher Education · doi:10.1016/j.iheduc.2015.02.002 · Cited by 2,152 · see citing works
First principles of instruction
Merrill, M. D. (2002) · Educational Technology Research and Development · doi:10.1007/bf02505024 · Cited by 2,092 · see citing works
How video production affects student engagement: an empirical study of MOOC videos
Guo, P. J., Kim, J., & Rubin, R. (2014) · Proceedings of the first ACM conference on Learning @ scale conference · doi:10.1145/2556325.2566239 · Cited by 1,850 · see citing works
Korpershoek, H., Harms, T., de Boer, H., van Kuijk, M., & Doolaard, S. (2016) · Review of Educational Research · doi:10.3102/0034654315626799 · Cited by 633 · see citing works
A systematic review of research on the flipped learning method in engineering education
Karabulut‐Ilgu, A., Jaramillo Cherrez, N., & Jahren, C. T. (2018) · British Journal of Educational Technology · doi:10.1111/bjet.12548 · Cited by 581 · see citing works
Flagged first, then by citations
Research works printed but not linked: 51
- [2]Giannakos MN Krogstie J Chrisochoides N Reviewing the flipped classroom research: reflections for computer science education Proceedings of the computer science education research conference 2014 23 29
- [6]Pierce R Fox J Vodcasts and active-learning exercises in a “flipped classroom” model of a renal pharmacotherapy module Am J Pharm Educ 2012 76 10 196 10.5688/ajpe7610196 23275661 PMC3530058 · DOI
- [7]Mehta NB Hull AL Young JB Stoller JK Just imagine: new paradigms for medical education Acad Med 2013 88 10 1418 1423 10.1097/ACM.0b013e3182a36a07 23969368 · DOI
- [8]Ramnanan CJ Pound LD Advances in medical education and practice: student perceptions of the flipped classroom Adv Med Educ Pract 2017 8 63 73 10.2147/AMEP.S109037 28144171 PMC5245805 · DOI
- [9]Ilic D Nordin RB Glasziou P Tilson JK Villanueva EA Randomised controlled trial of a blended learning evaluation intervention for teaching evidence-based medicine BMC Med Educ 2015 15 39 10.1186/s12909-015-0321-6 25884717 PMC4358913 · DOI
- [10]Betihavas V Bridgman H Kornhaber R Cross M (2016). The evidence for ‘flipping out’: a systematic review of the flipped classroom in nursing education Nurse Educ Today 2016 38 15 21 10.1016/j.nedt.2015.12.010 26804940 · DOI
- [11]Presti CR The flipped learning approach in nursing education: a literature review J Nurs Educ 2016 55 5 252 257 10.3928/01484834-20160414-03 27115451 · DOI
- [12]Chen F Lui AM Martinelli SM A systematic review of the effectiveness of flipped classrooms in medical education Med Educ 2017 51 6 585 597 10.1111/medu.13272 28488303 · DOI
- [13]Cotta KI Shah S Almgren MM Macías-Moriarity LZ Mody V Effectiveness of flipped classroom instructional model in teaching pharmaceutical calculations Curr Pharm Teach Learn 2016 8 5 646 653 10.1016/j.cptl.2016.06.011 · DOI
- [14]Lin Y Zhu Y Chen C Wang W Chen T Li T Li Y Liu B Lian Y Lu L Zou Y Liu Y Facing the challenges in ophthalmology clerkship teaching: is flipped classroom the answer? PLoS One 2017 12 4 e0174829 10.1371/journal.pone.0174829 28384167 PMC5383227 · DOI
- [15]O’Connor EE Fried J McNulty N Shah P Hogg JP Lewis P Zeffiro T Agarwal V Reddy S Flipping radiology education right side up Acad Radiol 2016 23 7 810 822 10.1016/j.acra.2016.02.011 27066755 · DOI
- [17]Street SE Gilliland KO McNeil C Royal K The flipped classroom improved medical student performance and satisfaction in a pre-clinical physiology course Med Sci Educ 2015 25 1 35 43 10.1007/s40670-014-0092-4 · DOI
- [18]Bishop JL Verleger MA The flipped classroom: a survey of the research Proceedings of the 120th ASEE National Conference and exposition, Atlanta, GA (paper ID 6219) 2013
- [19]Love B Hodge A Corritore C Ernst DC Inquiry-based learning and the flipped classroom model Primus 2015 25 8 745 762 10.1080/10511970.2015.1046005 · DOI
- [20]Lo CK Hew KFA Critical review of flipped classroom challenges in K-12 education: possible solutions and recommendations for future research Res Pract Technol Enhanc Learn 2017 12 1 4 10.1186/s41039-016-0044-2 PMC6302872 30613253 · DOI
- [21]Muir T Geiger V The affordances of using a flipped classroom approach in the teaching of mathematics: a case study of a grade 10 mathematics class Math Educ Res J 2016 28 1 149 171 10.1007/s13394-015-0165-8 · DOI
- [23]Prober CG Heath C Lecture halls without lectures – a proposal for medical education N Engl J Med 2012 366 18 1657 1659 10.1056/NEJMp1202451 22551125 · DOI
- [24]Abeysekera L Dawson P Motivation and cognitive load in the flipped classroom: definition, rationale and a call for research High Educ Res Dev 2015 34 1 1 14 10.1080/07294360.2014.934336 · DOI
- [25]Williams DE The future of medical education: flipping the classroom and education technology Ochsner J 2016 16 1 14 15 27026786 PMC4795492
- [27]Freeman S Eddy SL McDonough M Smith MK Okoroafor N Jordt H Wenderoth MP Active learning increases student performance in science, engineering, and mathematics Proc Natl Acad Sci U S A 2014 111 23 8410 8415 10.1073/pnas.1319030111 24821756 PMC4060654 · DOI · Paper page
- [29]Altman DG Bland JM Standard deviations and standard errors BMJ 2005 331 7521 903 10.1136/bmj.331.7521.903 16223828 PMC1255808 · DOI
- [32]Bossaer JB Panus P Stewart DW Hagemeier NE George J Student performance in a pharmacotherapy oncology module before and after flipping the classroom Am J Pharm Educ 2016 80 2 31 10.5688/ajpe80231 27073284 PMC4827582 · DOI
- [33]Cheng X, Lee KKH, Chang EY, Yang X. The “flipped classroom” approach: stimulating positive learning attitudes and improving mastery of histology among medical students. Anat Sci Educ. 2016; 10.1002/ase.1664. 28199052 · DOI
- [34]Galway LP Corbett KK Takaro TK Tairyan K Frank EA Novel integration of online and flipped classroom instructional models in public health higher education BMC Med Educ 2014 14 1 181 10.1186/1472-6920-14-181 25169853 PMC4167261 · DOI
- [35]Gillispie V Using the flipped classroom to bridge the gap to generation Y Ochsner J 2016 16 1 32 36 27046401 PMC4795497
- [36]Giuliano CA Moser LR Evaluation of a flipped drug literature evaluation course Am J Pharm Educ 2016 80 4 66 10.5688/ajpe80466 27293233 PMC4891864 · DOI
- [37]Harrington SA Bosch MV Schoofs N Beel-Bates C Anderson K Quantitative outcomes for nursing students in a flipped classroom Nurs Educ Perspect 2015 36 3 179 181 10.5480/13-1255 · DOI
- [38]Hsu SD Chen CJ Chang WK An HYJ Investigation of the outcomes of PGY students’ cognition of and persistent behavior in learning through the intervention of the flipped classroom in Taiwan PLoS One 2016 11 12 e0167598 10.1371/journal.pone.0167598 27911937 PMC5135136 · DOI
- [39]Kiviniemi MT Effects of a blended learning approach on student outcomes in a graduate-level public health course BMC Med Educ 2014 14 181 10.1186/1472-6920-14-47 24612923 PMC3975233 · DOI
- [40]Koo CL Demps EL Farris C Bowman JD Panahi L Boyle P Impact of flipped classroom design on student performance and perceptions in a pharmacotherapy course Am J Pharm Educ 2016 80 2 33 10.5688/ajpe80233 27073286 PMC4827584 · DOI
- [41]Liebert CA Lin DT Mazer LM Bereknyei S Lau JN Effectiveness of the surgery core clerkship flipped classroom: a prospective cohort trial Am J Surg 2016 211 2 451 457 10.1016/j.amjsurg.2015.10.004 26687962 · DOI
- [42]McLaughlin JE Griffin LM Esserman DA Davidson CA Glatt DM Roth MT Gharkholonarehe N Mumper RJ Pharmacy student engagement, performance, and perception in a flipped satellite classroom Am J Pharm Educ 2013 77 9 196 10.5688/ajpe779196 24249858 PMC3831407 · DOI
- [43]McLaughlin JE Roth MT Glatt DM Gharkholonarehe N Davidson CA Griffin LM Esserman DA Mumper RJ The flipped classroom: a course redesign to foster learning and engagement in a health professions school Acad Med 2014 89 2 236 243 10.1097/ACM.0000000000000086 24270916 · DOI
- [44]Morton DA Colbert-Getz JM Measuring the impact of the flipped anatomy classroom: the importance of categorizing an assessment by Bloom’s taxonomy Anat Sci Educ 2016 10 2 170 175 10.1002/ase.1635 27427860 · DOI
- [45]Munson A Pierce R Flipping content to improve student examination performance in a pharmacogenomics course Am J Pharm Educ 2015 79 7 103 10.5688/ajpe797103 27168616 PMC4861175 · DOI
- [46]Porcaro PA Jackson DE McLaughlin PM O’Malley CJ Curriculum design of a flipped classroom to enhance haematology learning J Sci Educ Technol 2016 25 3 345 357 10.1007/s10956-015-9599-8 · DOI
- [47]Prescott Jr WA Woodruff A Prescott GM Albanese N Bernhardi C Doloresco F Introduction and assessment of a blended-learning model to teach patient assessment in a doctor of pharmacy program Am J Pharm Educ 2016 80 10 176 28179725 PMC5289732
- [48]Rui Z Lian-rui X Rong-zheng Y Jing Z Xue-hong W Chuan Z Friend or foe? Flipped classroom for undergraduate electrocardiogram learning: a randomized controlled study BMC Med Educ 2017 17 53 10.1186/s12909-017-0881-8 28270204 PMC5341445 · DOI
- [49]Sajid MR Laheji AF Abothenain F Salam Y AlJayar D Obeidat A Can blended learning and the flipped classroom improve student learning and satisfaction in Saudi Arabia? Int J Med Educ 2016 7 281 285 10.5116/ijme.57a7.83d4 27591930 PMC5018351 · DOI
- [50]Tune JD Sturek M Basile DP Flipped classroom model improves graduate student performance in cardiovascular, respiratory, and renal physiology AJP Adv Physiol Educ 2013 37 4 316 320 10.1152/advan.00091.2013 24292907 · DOI
- [51]Whillier S Lystad RP No differences in grades or level of satisfaction in a flipped classroom for neuroanatomy J Chiropr Educ 2015 29 2 127 133 10.7899/JCE-14-28 25902472 PMC4582610 · DOI
- [52]Wong TH Ip EJ Lopes I Rajagopalan V Pharmacy students’ performance and perceptions in a flipped teaching pilot on cardiac arrhythmias Am J Pharm Educ 2014 78 10 185 10.5688/ajpe7810185 25657372 PMC4315207 · DOI
- [53]Reed DA Cook DA Beckman TJ Levine RB Kern DE Wright SM Association between funding and quality of published medical education research JAMA 2007 298 1002 1009 10.1001/jama.298.9.1002 17785645 · DOI
- [54]Hailikari T Katajavuori N Lindblom-Ylanne S The relevance of prior knowledge in learning and instructional design Am J Pharm Educ 2008 72 5 113 10.5688/aj7205113 19214267 PMC2630138 · DOI · Paper page
- [56]Dirkx KJH Kester L Kirschner PA The testing effect for learning principles and procedures from texts J Educ Res 2014 107 357 364 10.1080/00220671.2013.823370 · DOI
- [57]Murphy J Chang JM Suaray K Student performance and attitudes in a collaborative and flipped linear algebra course Int J Math Educ Sci Technol 2016 47 5 653 673 10.1080/0020739X.2015.1102979 · DOI · Paper page
- [58]McGivney-Burelle J Xue F Flipping calculus Primus 2013 23 5 477 486 10.1080/10511970.2012.757571 · DOI
- [59]Vazquez JJ Chiang EP Flipping out! A case study on how to flip the principles of economics classroom Int Adv Econ Res 2015 21 379 390 10.1007/s11294-015-9549-5 · DOI
- [60]Chen CM Wu CH Effects of different video lecture types on sustained attention, emotion, cognitive load, and learning performance Comput Educ 2015 80 108 121 10.1016/j.compedu.2014.08.015 · DOI
- [61]Chorianopoulos K Giannakos MN Usability design for video lectures Proceedings of the 11th European conference on interactive TV and video 2013 163 164
- [63]Peplow M. Social Sciences suffer from severe publication bias. Nature. Retrieved on August 25, 2017 from http://www.nature.com/news/social-sciences-suffer-from-severe-publication-bias-1.15787.
Cited by
Sorted by citations
Cheng, L., Ritzhaupt, A. D., & Antonenko, P. (2019) · Educational Technology Research and Development · doi:10.1007/s11423-018-9633-7 · Cited by 494 · see citing works
Adaptive learning: Helpful to the flipped classroom in the online environment of COVID?
Clark, R. M., Kaw, A. K., & Braga Gomes, R. (2022) · Computer Applications in Engineering Education · doi:10.1002/cae.22470 · Cited by 63 · see citing works
Shi, Y., Yang, H., MacLeod, J., Zhang, J., & Yang, H. H. (2020) · Journal of Educational Computing Research · doi:10.1177/0735633119881477 · Cited by 62 · see citing works
Tutal, Ö., & Yazar, T. (2021) · Asia Pacific Education Review · doi:10.1007/s12564-021-09706-9 · Cited by 57 · see citing works
Li, Y., Li, X., Liu, Y., & Li, Y. (2024) · Frontiers in Medicine · doi:10.3389/fmed.2024.1319711 · Cited by 51 · see citing works
Beneciuk, J. M., George, S. Z., Greco, C. M., Schneider, M. J., Wegener, S. T., Saper, R. B., & Delitto, A. (2019) · Trials · doi:10.1186/s13063-019-3350-3 · Cited by 43 · see citing works
Exploring the Effectiveness of Flipped Classroom on STEM Student Achievement: A Meta-analysis
Gong, J., Cai, S., & Cheng, M. (2024) · Technology, Knowledge and Learning · doi:10.1007/s10758-023-09700-7 · Cited by 42 · see citing works
Fischer, K., Sullivan, A. M., Cohen, A. P., King, R. W., Cockrill, B. A., & Besche, H. C. (2023) · BMC Medical Education · doi:10.1186/s12909-023-04325-x · Cited by 28 · see citing works
Tomesko, J., Cohen, D., & Bridenbaugh, J. (2022) · Journal of Educational Evaluation for Health Professions · doi:10.3352/jeehp.2022.19.5 · Cited by 24 · see citing works
Khojasteh, L., Hosseini, S. A., & Nasiri, E. (2021) · Research and Practice in Technology Enhanced Learning · doi:10.1186/s41039-021-00165-9 · Cited by 21 · see citing works
- Authors
- HEW, K. F., & LO, C. K.
- Affiliations
- University of Hong Kong (HK)
- Corresponding author
- HEW, Khe Foon
- Venue
- BMC Medical Education
- Published
- 2018-03-15
- Volume
- 18
- Issue
- 1
- Pages
- 38-38
- ISSN
- 1472-6920 (ISSN-L)
- PMC
- PMC5855972
- OpenAlex
- W2795129397
- Cited by
- 1,207
- References
- 8
- Citations by year
- 2026: 104 · 2025: 134 · 2024: 158 · 2023: 210 · 2022: 220 · 2021: 189 · 2020: 118 · 2019: 58 · 2018: 15
- FWCI
- 37.17
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- BMC Medical Education (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Social Sciences › Education › Innovative Teaching Methods
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Innovations in Medical Education
- Life Sciences › Neuroscience › Cognitive Neuroscience › Undergraduate Neuroscience Education and Research
- Keywords
- flipped classroom, health professions education, student learning, traditional classroom comparison, in-class quizzes, medical students, nursing education, dental education, pharmacy education, learner preferences
- MeSH terms
- Health Occupations, Humans, Teaching, Problem-Based Learning, Quality Improvement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review