The DOI matches its Crossref record; 91 of the 91 references it cites were found in a registry or an index.
Toward a set of design principles for mathematics flipped classrooms: A synthesis of research in mathematics education
Open accessAbstract
This paper analyzed the journal publications of mathematics flipped classroom studies in K-12 and higher education contexts. We focused specifically on a set of flipped classroom studies in which pre-class instructional videos were provided prior to face-to-face class meetings. We examined the following four major issues: (a) the types of out-of-class and in-class instructional activities used, (b) the effect of flipped learning on student achievement, (c) the participant perceptions of flipped classroom benefits, and (d) the main challenges of flipped classroom implementations. A meta-analysis of 21 comparison studies showed an overall significant effect in favor of the flipped classroom over the traditional classroom for mathematics education (Hedges' g = 0.298, 95% CI [0.16, 0.44]), with no evidence of publication bias. A broader research synthesis of 61 studies revealed that the flipped classroom approach benefited student learning in three main aspects: increasing in-class time for task/practice, integrating new knowledge with existing beliefs, and real-time feedback. The two most frequently reported flipped classroom challenges were students' unfamiliarity with flipped learning and significant start-up effort on the part of instructors. We hence propose a set of design principles to help foster the transition to the flipped classroom and improve the out-of-class and in-class learning designs. This set of design principles can also provide a more focused agenda for future research to examine the effect of the flipped classroom approach on student learning and motivation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799
Active learning increases student performance in science, engineering, and mathematics
Freeman, S., Eddy, S. L., McDonough, M., Smith, M. K., Okoroafor, N., Jordt, H., & Wenderoth, M. P. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1319030111 · Cited by 9,787
(2000) · Cited by 9,198
Flip Your Classroom: Reach Every Student in Every Class Every Day
Sams, A., & Bergmann, J. (2012) · Medical Entomology and Zoology · Cited by 3,810
Reconsidering Research on Learning from Media
Clark, R. E. (1983) · Review of Educational Research · doi:10.3102/00346543053004445 · Cited by 2,715
Peer Instruction: Ten years of experience and results
Crouch, C. H., & Mazur, E. (2001) · American Journal of Physics · doi:10.1119/1.1374249 · Cited by 2,682 · cited 1×
“The specific model that Jungi c et al. (2015) used in their flipped courses was peer instruction (Crouch & Mazur, 2001).”
BackgroundReprint—Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & and the PRISMA Group (2009) · Physical Therapy · doi:10.1093/ptj/89.9.873 · Cited by 2,486
The Flipped Classroom: A Survey of the Research
Bishop, J., & Verleger, M. (2020) · 2013 ASEE Annual Conference & Exposition Proceedings · doi:10.18260/1-2--22585 · Cited by 2,437
The Cambridge handbook of multimedia learning
(2006) · Choice Reviews Online · doi:10.5860/choice.43-5643 · Cited by 2,313
The use of flipped classrooms in higher education: A scoping review
O'Flaherty, J., & Phillips, C. (2015) · The Internet and Higher Education · doi:10.1016/j.iheduc.2015.02.002 · Cited by 2,152
First principles of instruction
Merrill, M. D. (2002) · Educational Technology Research and Development · doi:10.1007/bf02505024 · Cited by 2,092
How video production affects student engagement: an empirical study of MOOC videos
Guo, P. J., Kim, J., & Rubin, R. (2014) · Proceedings of the first ACM conference on Learning @ scale conference · doi:10.1145/2556325.2566239 · Cited by 1,850 · cited 3×
“Guo et al. (2014) analyzed 6.9 million video-watching sessions across four edX massive open online courses.”
BackgroundMethodInfluentialAbeysekera, L., & Dawson, P. (2015) · Higher Education Research & Development · doi:10.1080/07294360.2014.934336 · Cited by 1,847
(1985) · Cited by 1,625
(2003) · Cited by 1,586
The Cambridge Handbook of Multimedia Learning
(2014) · Cambridge University Press eBooks · doi:10.1017/cbo9781139547369 · Cited by 1,533
(2010) · Paediatric and Perinatal Epidemiology · doi:10.1111/j.1365-3016.2010.01108.x · Cited by 1,443
STATISTICAL ISSUES IN ECOLOGICAL META-ANALYSES
Gurevitch, J., & Hedges, L. V. (1999) · Ecology · doi:10.1890/0012-9658(1999)080[1142:siiema]2.0.co;2 · Cited by 1,081
Thinking, Problem Solving, Cognition
D., C. P., & Mayer, R. E. (1984) · The American Journal of Psychology · doi:10.2307/1422612 · Cited by 992
Kim, M. K., Kim, S. M., Khera, O., & Getman, J. (2014) · The Internet and Higher Education · doi:10.1016/j.iheduc.2014.04.003 · Cited by 932
Standard deviations and standard errors
Altman, D. G., & Bland, J. M. (2005) · BMJ · doi:10.1136/bmj.331.7521.903 · Cited by 878
Lai, C.-L., & Hwang, G.-J. (2016) · Computers & Education · doi:10.1016/j.compedu.2016.05.006 · Cited by 825
Lo, C. K., & Hew, K. F. (2017) · Research and Practice in Technology Enhanced Learning · doi:10.1186/s41039-016-0044-2 · Cited by 644
Self-citationKorpershoek, H., Harms, T., de Boer, H., van Kuijk, M., & Doolaard, S. (2016) · Review of Educational Research · doi:10.3102/0034654315626799 · Cited by 633
The evidence for ‘flipping out’: A systematic review of the flipped classroom in nursing education
Betihavas, V., Bridgman, H., Kornhaber, R., & Cross, M. (2016) · Nurse Education Today · doi:10.1016/j.nedt.2015.12.010 · Cited by 597
A Meta-analysis of the Effects of Computer Technology on School Students’ Mathematics Learning
Li, Q., & Ma, X. (2010) · Educational Psychology Review · doi:10.1007/s10648-010-9125-8 · Cited by 558
Chen, C.-M., & Wu, C.-H. (2015) · Computers & Education · doi:10.1016/j.compedu.2014.08.015 · Cited by 536
Student learning and perceptions in a flipped linear algebra course
Love, B., Hodge, A., Grandgenett, N., & Swift, A. W. (2014) · International Journal of Mathematical Education in Science and Technology · doi:10.1080/0020739x.2013.822582 · Cited by 458
How Video Production Affects Student Engagement:An Empirical Study of MOOC Videos
McVerry, G. (2019) · Cited by 431
Flipped learning in higher education chemistry: emerging trends and potential directions
Seery, M. K. (2015) · Chemistry Education Research and Practice · doi:10.1039/c5rp00136f · Cited by 351
Learning in One-to-One Laptop Environments: A Meta-Analysis and Research Synthesis
Zheng, B., Warschauer, M., Lin, C.-H., & Chang, C. (2016) · Review of Educational Research · doi:10.3102/0034654316628645 · Cited by 312
Clark, K. (2015) · The Journal of Educators Online · doi:10.9743/jeo.2015.1.5 · Cited by 307
(2016) · Educational Technology & Society · Cited by 279
He, W., Holton, A., Farkas, G., & Warschauer, M. (2016) · Learning and Instruction · doi:10.1016/j.learninstruc.2016.07.001 · Cited by 231
ASSESSING STATISTICAL REASONING
GARFIELD, J. B. (2003) · STATISTICS EDUCATION RESEARCH JOURNAL · doi:10.52041/serj.v2i1.557 · Cited by 220
Methods of Instructional Improvement in Algebra: A Systematic Review and Meta-Analysis
Rakes, C. R., Valentine, J. C., McGatha, M. B., & Ronau, R. N. (2010) · Review of Educational Research · doi:10.3102/0034654310374880 · Cited by 215
Flipping a College Calculus Course: A Case Study.
Şahin, A., Cavlazoglu, B., & Zeytuncu, Y. E. (2015) · Cited by 178
Inverting the Linear Algebra Classroom
Talbert, R. (2014) · PRIMUS · doi:10.1080/10511970.2014.883457 · Cited by 171
Reviewing the flipped classroom research: reflections for computer science education
Giannakos, M. N., Krogstie, J., & Chrisochoides, N. (2014) · Proceedings of the Computer Science Education Research Conference · doi:10.1145/2691352.2691354 · Cited by 166
The Flipped Classroom Improves Student Achievement and Course Satisfaction in a Statistics Course
Peterson, D. J. (2015) · Teaching of Psychology · doi:10.1177/0098628315620063 · Cited by 149
McGivney‐Burelle, J., & Xue, F. (2013) · PRIMUS · doi:10.1080/10511970.2012.757571 · Cited by 148
Chen, S., Yang, S. J. H., & Hsiao, C. C. (2015) · British Journal of Educational Technology · doi:10.1111/bjet.12278 · Cited by 140
Touchton, M. (2015) · Journal of Political Science Education · doi:10.1080/15512169.2014.985105 · Cited by 137
The Flipped Learning Approach in Nursing Education: A Literature Review
Presti, C. R. (2016) · Journal of Nursing Education · doi:10.3928/01484834-20160414-03 · Cited by 132
Using a Flipped Classroom Approach to Support Problem-Based Learning
Tawfik, A. A., & Lilly, C. (2015) · Technology Knowledge and Learning · doi:10.1007/s10758-015-9262-8 · Cited by 129
Applying Cognitive Theory to Statistics Instruction
Lovett, M. C., & Greenhouse, J. B. (2000) · The American Statistician · doi:10.1080/00031305.2000.10474545 · Cited by 128
Gundlach, E., Richards, K. A. R., Nelson, D. B., & Levesque‐Bristol, C. (2015) · Journal of Statistics Education · doi:10.1080/10691898.2015.11889723 · Cited by 127
Inquiry-Based Learning and the Flipped Classroom Model
Love, B., Hodge, A., Corritore, C. L., & Ernst, D. C. (2015) · PRIMUS · doi:10.1080/10511970.2015.1046005 · Cited by 126
On flipping the classroom in large first year calculus courses
Jungić, V., Kaur, H., Mulholland, J., & Xin, C. (2014) · International Journal of Mathematical Education in Science and Technology · doi:10.1080/0020739x.2014.990529 · Cited by 121
Students’ perspectives of using cooperative learning in a flipped statistics classroom
Chen, L., Chen, T., & Chen, N. (2015) · Australasian Journal of Educational Technology · doi:10.14742/ajet.1876 · Cited by 121
Muir, T., & Geiger, V. (2015) · Mathematics Education Research Journal · doi:10.1007/s13394-015-0165-8 · Cited by 118
The materiality of mathematics: Presenting mathematics at the blackboard
Greiffenhagen, C. (2014) · British Journal of Sociology · doi:10.1111/1468-4446.12037 · Cited by 116
Proceedings of the first ACM conference on Learning @ scale conference
(2014) · doi:10.1145/2556325 · Cited by 105
Flipping the Statistics Classroom in Nursing Education
Schwartz, T. A. (2014) · Journal of Nursing Education · doi:10.3928/01484834-20140325-02 · Cited by 103
The Flipped Classroom: Fertile Ground for Nursing Education Research
Bernard, J. S. (2015) · International Journal of Nursing Education Scholarship · doi:10.1515/ijnes-2015-0005 · Cited by 101
The Calculus Concept Inventory–Measurement of the Effect of Teaching Methodology in Mathematics
Epstein, J. (2013) · Notices of the American Mathematical Society · doi:10.1090/noti1033 · Cited by 101
An Examination of the Flipped Classroom Approach on College Student Academic Involvement.
McCallum, S., Schultz, J., Sellke, K., & Spartz, J. (2015) · International journal on teaching and learning in higher education · Cited by 99
Yong, D., Levy, R., & Lape, N. K. (2015) · PRIMUS · doi:10.1080/10511970.2015.1031307 · Cited by 95
Flipping the calculus classroom: an evaluative study
Maciejewski, W. (2015) · Teaching Mathematics and its Applications An International Journal of the IMA · doi:10.1093/teamat/hrv019 · Cited by 87
Student performance and attitudes in a collaborative and flipped linear algebra course
Murphy, J., Chang, J.-M., & Suaray, K. (2016) · International Journal of Mathematical Education in Science and Technology · doi:10.1080/0020739x.2015.1102979 · Cited by 81
Discrepancies between Student Perception and Achievement of Learning Outcomes in a Flipped Classroom
Sickle, J. V. (2016) · Journal of the Scholarship of Teaching and Learning · doi:10.14434/josotl.v16i2.19216 · Cited by 80
The Flipped Classroom: Viewpoints in Asian Universities
Chua, J. S. M., & Lateef, F. (2014) · Education in Medicine Journal · doi:10.5959/eimj.v6i4.316 · Cited by 79
Flipping an Algebra Classroom: Analyzing, Modeling, and Solving Systems of Linear Equations
Kirvan, R., Rakes, C. R., & Zamora, R. (2015) · Computers in the Schools · doi:10.1080/07380569.2015.1093902 · Cited by 74
Flipped Calculus: A Study of Student Performance and Perceptions
Ziegelmeier, L., & Topaz, C. M. (2015) · PRIMUS · doi:10.1080/10511970.2015.1031305 · Cited by 69
A comparison between flipped and lecture-based instruction in the calculus classroom
Scott, C. E., Green, L. E., & Etheridge, D. L. (2016) · Journal of Applied Research in Higher Education · doi:10.1108/jarhe-04-2015-0024 · Cited by 63
Usability design for video lectures
Chorianopoulos, K., & Giannakos, M. N. (2013) · European Conference on Interactive TV and Video (EuroITV) · doi:10.1145/2465958.2465982 · Cited by 62
Expectations and implementations of the flipped classroom model in undergraduate mathematics courses
Naccarato, E., & Karakok, G. (2015) · International Journal of Mathematical Education in Science and Technology · doi:10.1080/0020739x.2015.1071440 · Cited by 59
On flipping first-semester calculus: a case study
Petrillo, J. (2015) · International Journal of Mathematical Education in Science and Technology · doi:10.1080/0020739x.2015.1106014 · Cited by 52
Measuring Learning Outcomes and Attitudes in a Flipped Introductory Statistics Course
Cilli-Turner, E. (2015) · PRIMUS · doi:10.1080/10511970.2015.1046004 · Cited by 51
Flipping Undergraduate Finite Mathematics: Findings and Implications
Guerrero, S. M., Beal, M., Lamb, C., Sonderegger, D. L., & Baumgartel, D. (2015) · PRIMUS · doi:10.1080/10511970.2015.1046003 · Cited by 51
Student Performance in an Introductory Business Statistics Course: Does Delivery Mode Matter?
Haughton, J., & Kelly‐Hawke, A. (2014) · Journal of Education for Business · doi:10.1080/08832323.2014.968518 · Cited by 50
Flipping a Math Content Course for Pre-Service Elementary School Teachers
Ford, P. L. (2014) · PRIMUS · doi:10.1080/10511970.2014.981902 · Cited by 44
Inverting the Transition-to-Proof Classroom
Talbert, R. (2015) · PRIMUS · doi:10.1080/10511970.2015.1050616 · Cited by 44
AN INQUIRY INTO FLIPPED LEARNING IN FOURTH GRADE MATH INSTRUCTION
D’addato, T., & Miller, L. R. (2016) · The Canadian Journal of Action Research · doi:10.33524/cjar.v17i2.261 · Cited by 43
Rotating Solids and Flipping Instruction
Grypp, L., & Luebeck, J. L. (2015) · Mathematics Teacher Learning and Teaching PK-12 · doi:10.5951/mathteacher.109.3.0186 · Cited by 42
Inverted Classroom by Topic - A Study in Mathematics for Electrical Engineering Students
Braun, I., Ritter, S., & Vasko, M. (2014) · International Journal of Engineering Pedagogy (iJEP) · doi:10.3991/ijep.v4i3.3299 · Cited by 41
Adult Students' Experiences of a Flipped Mathematics Classroom.
Larsen, J. (2015) · Cited by 33
An Experiment in “Flipped” Teaching in Freshman Calculus
Anderson, L. K., & Brennan, J. P. (2015) · PRIMUS · doi:10.1080/10511970.2015.1059916 · Cited by 32
Flipping a Calculus Class: One Instructor’s Experience
Palmer, K. (2015) · PRIMUS · doi:10.1080/10511970.2015.1050618 · Cited by 31
Kuiper, S., Carver, R. H., Posner, M. A., & Everson, M. G. (2015) · PRIMUS · doi:10.1080/10511970.2015.1045573 · Cited by 29
Inverted Pedagogy in Second Semester Calculus
Kennedy, E., Beaudrie, B., Ernst, D. C., & Laurent, R. T. S. (2015) · PRIMUS · doi:10.1080/10511970.2015.1031301 · Cited by 27
To Flip or Not to Flip? An Exploratory Study Comparing Student Performance in Calculus I
Schroeder, L. B., McGivney‐Burelle, J., & Xue, F. (2015) · PRIMUS · doi:10.1080/10511970.2015.1050617 · Cited by 25
Adventures in Flipping College Algebra
Sickle, J. V. (2015) · PRIMUS · doi:10.1080/10511970.2015.1031299 · Cited by 25
Overmyer, J. (2015) · PRIMUS · doi:10.1080/10511970.2015.1045572 · Cited by 22
Math Bio or Biomath? Flipping the Mathematical Biology Classroom
Eager, E. A., Peirce, J. P., & Barlow, P. J. (2014) · Letters in Biomathematics · doi:10.1080/23737867.2014.11414476 · Cited by 22
Partially Flipped Linear Algebra: A Team–Based Approach
Carney, D., Ormes, N., & Swanson, R. D. (2015) · PRIMUS · doi:10.1080/10511970.2015.1047545 · Cited by 21
Enabling and Integrating Online Formative Assessment in a Flipped Calculus Course
Schroeder, L. B., & Dorn, B. (2016) · PRIMUS · doi:10.1080/10511970.2015.1050619 · Cited by 20
Improved student outcomes in a flipped statistics course
Phillips, L. L., & Phillips, M. (2016) · Administrative Issues Journal Education Practice and Research · doi:10.5929/2016.6.1.5 · Cited by 20
Flipping College Algebra: Effects on Student Engagement and Achievement.
Ichinose, C., & Clinkenbeard, J. (2016) · The learning assistance review · Cited by 17
Proceedings of the Computer Science Education Research Conference
(2014) · doi:10.1145/2691352 · Cited by 14
Developmental Math, Flipped and Self-Paced
Weng, P. (2015) · PRIMUS · doi:10.1080/10511970.2015.1031297 · Cited by 11
Cited by
Effects of flipping the classroom on learning outcomes and satisfaction: A meta-analysis
van Alten, D. C. D., Phielix, C., Janssen, J., & Kester, L. (2019) · Educational Research Review · doi:10.1016/j.edurev.2019.05.003 · Cited by 546
Strelan, P., Osborn, A., & Palmer, E. (2020) · Educational Research Review · doi:10.1016/j.edurev.2020.100314 · Cited by 526
Huang, B., Hew, K. F., & Lo, C. K. (2019) · Interactive Learning Environments · doi:10.1080/10494820.2018.1495653 · Cited by 406
Self-citationFacilitating student engagement through the flipped learning approach in K-12: A systematic review
Bond, M. (2020) · Computers & Education · doi:10.1016/j.compedu.2020.103819 · Cited by 380
Flipped classroom in English language teaching: a systematic review
Turan, Z., & Akdag-Cimen, B. (2020) · Computer Assisted Language Learning · doi:10.1080/09588221.2019.1584117 · Cited by 371
Metadata
- Authors
- Lo, C. K., Hew, K. F., & Chen, G.
- Venue
- Educational Research Review
- Publisher
- Elsevier BV
- Published
- 2017-11
- Volume
- 22
- Pages
- 50-73
- ISSN
- 1747-938X (ISSN-L)
- OpenAlex
- W2748562539
- Cited by
- 335
- References
- 91
- FWCI
- 87.22
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.