Effect of design‐based learning on achievement in K‐12 education: A m eta‐analysis
Abstract
Design‐based learning (DBL) offers opportunities to support students' content understanding. Previous DBL studies reported different effect sizes by using the data from one participant group. The goal of this study was to conduct a meta‐analysis that would give a comprehensive picture of how DBL is connected to student achievement in different disciplines. In addition, we explored the moderators influencing achievement in DBL for K‐12 education. After investigating content‐related gains in our meta‐analysis on 37 individual articles with 52 effect sizes, we found that DBL had a positive and large effect ( = 0.602) on achievement in K‐12 education, and the effect size for science ( = 0.703) was higher than mathematics ( = 0.418) education. When considering the strong emphasis on science education in different DBL related frameworks and STEM (science, engineering, technology, and mathematics) education studies, this cumulative understanding could play an important role in the difference between science and mathematics. Studies that had control groups in the same school ( = 0.703) had statistically significantly higher effect sizes compared to studies that included control groups from different schools ( = 0.447). Studies with random assignment ( = 0.258) had statistically significantly smaller effect sizes compared to studies with non‐random assignment ( = 0.623). In addition, the effect of DBL on achievement showed statistically significant differences among different countries. The remaining moderators (school level, content support, measurement type, and experimental design) did not show statistically significant differences in terms of the effect of DBL on student achievement. Our review presents evidence that participating in DBL activities supports student achievement after the intervention, but how students transfer their content gains in other situations needs convincing evidence. To overcome this challenge, future studies can prioritize how to support achievement in state mandated tests to understand DBL's effect on students' content gains in different learning situations.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Meta-analyses show medium-to large-sized positive effects of learning-by-design on student achievement in K-12 STEM education.
“Meta-analyses show medium-to large-sized positive effects on student achievement in K-12 STEM education (Delen & Sen, 2023).”
From Looking Beyond the Hype: Understanding the Effects of AI on Learning (2025) · cites this paper as Delen & Sen, 2023
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042 · see citing works
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139 · see citing works
Conducting Meta-Analyses in <i>R</i> with the <b>metafor</b> Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464 · see citing works
Operating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955 · see citing works
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225 · see citing works
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099 · see citing works
(2000) · Cited by 9,198 · see citing works
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068 · see citing works
Problem-Based Learning: What and How Do Students Learn?
Hmelo‐Silver, C. E. (2004) · Educational Psychology Review · doi:10.1023/b:edpr.0000034022.16470.f3 · Cited by 5,416 · see citing works
Hattie, J. (2008) · doi:10.4324/9780203887332 · Cited by 3,051 · see citing works
Morris, S. B., & DeShon, R. P. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.105 · Cited by 2,502 · see citing works
(2011) · Cited by 1,303 · see citing works
Controlling the risk of spurious findings from meta-regression
Higgins, J. P. T., & Thompson, S. G. (2004) · Statistics in Medicine · doi:10.1002/sim.1752 · Cited by 1,267 · see citing works
Field, A. P., & Gillett, R. (2010) · British Journal of Mathematical and Statistical Psychology · doi:10.1348/000711010x502733 · Cited by 1,162 · see citing works
STEM education K-12: perspectives on integration
English, L. D. (2016) · International Journal of STEM Education · doi:10.1186/s40594-016-0036-1 · Cited by 1,089 · see citing works
Kolodner, J. L., Camp, P. J., Crismond, D., Fasse, B., Gray, J., Holbrook, J., Puntambekar, S., & Ryan, M. (2003) · Journal of the Learning Sciences · doi:10.1207/s15327809jls1204_2 · Cited by 1,061 · see citing works
Experimental and Quasi-Experimental Studies of Inquiry-Based Science Teaching: A Meta-Analysis
Furtak, E. M., Seidel, T., Iverson, H., & Briggs, D. C. (2012) · Review of Educational Research · doi:10.3102/0034654312457206 · Cited by 1,021 · see citing works
Designing to Learn About Complex Systems
Hmelo, C. E., Holton, D. L., & Kolodner, J. L. (2000) · Journal of the Learning Sciences · doi:10.1207/s15327809jls0903_2 · Cited by 578 · see citing works
The Suitability of Problem-based Learning for Engineering Education: Theory and practice
Perrenet, J. C., Bouhuijs, P. A. J., & Smits, J. G. M. M. (2000) · Teaching in Higher Education · doi:10.1080/713699144 · Cited by 576 · see citing works
A Fail-Safe N for Effect Size in Meta-Analysis
Orwin, R. G. (1983) · Journal of Educational Statistics · doi:10.3102/10769986008002157 · Cited by 562 · see citing works
Design‐based science and student learning
Fortus, D., Dershimer, R. C., Krajcik, J. S., Marx, R. W., & Mamlok‐Naaman, R. (2004) · Journal of Research in Science Teaching · doi:10.1002/tea.20040 · Cited by 474 · see citing works
Pre-post effect sizes should be avoided in meta-analyses
Cuijpers, P., Weitz, E., Cristea, I. A., & Twisk, J. (2017) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796016000809 · Cited by 432 · see citing works
Mehalik, M. M., Doppelt, Y., & Schuun, C. D. (2008) · Journal of Engineering Education · doi:10.1002/j.2168-9830.2008.tb00955.x · Cited by 418 · see citing works
Bringing Engineering Design into High School Science Classrooms: The Heating/Cooling Unit
Apedoe, X. S., Reynolds, B., Ellefson, M., & Schunn, C. D. (2008) · Journal of Science Education and Technology · doi:10.1007/s10956-008-9114-6 · Cited by 297 · see citing works
Design‐based science and real‐world problem‐solving
Fortus, D., Krajcik, J. S., Dershimer, R. C., Marx, R. W., & Mamlok‐Naaman, R. (2005) · International Journal of Science Education · doi:10.1080/09500690500038165 · Cited by 282 · see citing works
Wendell, K. B., & Rogers, C. (2013) · Journal of Engineering Education · doi:10.1002/jee.20026 · Cited by 270 · see citing works
How an integrative STEM curriculum can benefit students in engineering design practices
Fan, S.-C., & Yu, K.-C. (2017) · International Journal of Technology and Design Education · doi:10.1007/s10798-015-9328-x · Cited by 206 · see citing works
(2008) · D-Scholarship@Pitt (University of Pittsburgh) · Cited by 194 · see citing works
Al-Balushi, S. M., & Al-Aamri, S. S. (2014) · International Research in Geographical and Environmental Education · doi:10.1080/10382046.2014.927167 · Cited by 172 · see citing works
The Impact of an Engineering Design Curriculum on Science Reasoning in an Urban Setting
Silk, E., Schunn, C. D., & Cary, M. G. S. (2009) · Journal of Science Education and Technology · doi:10.1007/s10956-009-9144-8 · Cited by 153 · see citing works
Study of mental iteration in different design situations
Jin, Y., & Chusilp, P. (2005) · Design Studies · doi:10.1016/j.destud.2005.06.003 · Cited by 147 · see citing works
A framework to foster problem-solving in STEM and computing education
Priemer, B., Eilerts, K., Filler, A., Niels Pinkwart, C., Rösken-Winter, B., Tiemann, R., & zu Belzen, A. U. (2019) · Research in Science & Technological Education · doi:10.1080/02635143.2019.1600490 · Cited by 138 · see citing works
Schnittka, C. G., & Bell, R. L. (2010) · International Journal of Science Education · doi:10.1080/09500693.2010.529177 · Cited by 132 · see citing works
Lin, L., Shadiev, R., Hwang, W., & Shen, S. (2020) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2020.100646 · Cited by 127 · see citing works
Chen, C.-H., & Chiu, C. (2016) · Computers & Education · doi:10.1016/j.compedu.2016.09.007 · Cited by 117 · see citing works
A meta-analysis on effective strategies for integrated STEM education
Mustafa, N., Ismail, Z., Tasir, Z., & Said, M. (2016) · Advanced Science Letters · doi:10.1166/asl.2016.8111 · Cited by 116 · see citing works
Özkan, G., & Topsakal, Ü. U. (2020) · Research in Science & Technological Education · doi:10.1080/02635143.2020.1769586 · Cited by 97 · see citing works
Tran, N., & Nathan, M. J. (2010) · Journal of Engineering Education · doi:10.1002/j.2168-9830.2010.tb01051.x · Cited by 96 · see citing works
“Scratch”-ing computational thinking with Arduino: A meta-analysis
Fidai, A., Capraro, M. M., & Capraro, R. M. (2020) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2020.100726 · Cited by 87 · see citing works
Code to Learn: Where Does It Belong in the K-12 Curriculum?
Moreno-León, J., Robles, G., & Román-González, . (2016) · Journal of Information Technology Education Research · doi:10.28945/3521 · Cited by 84 · see citing works
Tofel‐Grehl, C., Fields, D. A., Searle, K. A., Maahs-Fladung, C., Feldon, D. F., Gu, G., & Sun, C. (2017) · Journal of Science Education and Technology · doi:10.1007/s10956-017-9688-y · Cited by 82 · see citing works
Design as a catalyst for learning
(1999) · Choice Reviews Online · doi:10.5860/choice.36-3452 · Cited by 81 · see citing works
Soyadı, Y. A. Y., & Tertemiz, N. (2018) · lnternational Electronic Journal of Elementary Education · doi:10.26822/iejee.2018438141 · Cited by 78 · see citing works
Spatial ability learning through educational robotics
Julià, C., & Antolí, J. Ò. (2015) · International Journal of Technology and Design Education · doi:10.1007/s10798-015-9307-2 · Cited by 74 · see citing works
Nidich, S. I., Mjasiri, S., Nidich, R., Rainforth, M. V., Grant, J., Valosek, L., Chang, W. H. S., & Zigler, R. L. (2011) · Cited by 73 · see citing works
Kert, S. B., Erkoç, M. F., & Yeni, S. (2020) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2020.100714 · Cited by 73 · see citing works
Hsiao, H., Lin, Y.-W., Lin, K., Lin, C.-Y., Chen, J.-H., & Chen, J.-C. (2019) · Interactive Learning Environments · doi:10.1080/10494820.2019.1636090 · Cited by 70 · see citing works
Children’s Emotions in Design-Based Learning: A Systematic Review
Zhang, F., Markopoulos, P., & Bekker, T. (2020) · Journal of Science Education and Technology · doi:10.1007/s10956-020-09830-y · Cited by 68 · see citing works
You make it and you try it out: Seeds of design discipline futures
Lloyd, P. A. (2019) · Design Studies · doi:10.1016/j.destud.2019.10.008 · Cited by 67 · see citing works
Li, Y., Huang, Z., Jiang, M., & Chang, T. (2016) · Educational Technology & Society · Cited by 58 · see citing works
Craig, T. T., & Marshall, J. A. (2019) · Journal of Research in Science Teaching · doi:10.1002/tea.21582 · Cited by 58 · see citing works
Understanding science career aspirations: Factors predicting future science task value
Jones, M. G., Chesnutt, K. M., Ennes, M. E., Mulvey, K. L., & Cayton, E. M. (2021) · Journal of Research in Science Teaching · doi:10.1002/tea.21687 · Cited by 55 · see citing works
Doppelt, Y., & Schunn, C. D. (2008) · Learning Environments Research · doi:10.1007/s10984-008-9047-2 · Cited by 54 · see citing works
Integrating engineering in middle and high school classrooms
Cunningham, C. M., Knight, M., Carlsen, W. S., et al. (2007) · International journal of engineering education · Cited by 54 · see citing works
Mikula, B. D., & Heckler, A. F. (2017) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.13.010122 · Cited by 53 · see citing works
Students' construction of external representations in design-based learning situations
de Vries, E. (2006) · Learning and Instruction · doi:10.1016/j.learninstruc.2006.03.006 · Cited by 51 · see citing works
Making a Case for Design-Based Learning
Davis, M. (1998) · Arts Education Policy Review · doi:10.1080/10632919809599450 · Cited by 49 · see citing works
Saraç, H. (2018) · The Turkish Online Journal of Educational Technology · Cited by 49 · see citing works
Collaboration Scripts for Enhancing Metacognitive Self-regulation and Mathematics Literacy
Chen, C.-H., & Chiu, C.-H. (2015) · International Journal of Science and Mathematics Education · doi:10.1007/s10763-015-9681-y · Cited by 47 · see citing works
Effects of Problem-Based Learning on Academic Achievement: A Meta-Analysis Study
Dağyar, M., & Demirel, M. (2015) · TED EĞİTİM VE BİLİM · doi:10.15390/eb.2015.4429 · Cited by 47 · see citing works
Dankenbring, C., & Capobianco, B. (2015) · International Journal of Science and Mathematics Education · doi:10.1007/s10763-015-9626-5 · Cited by 44 · see citing works
Promoting interdisciplinarity in engineering teaching
Harrison, G. P., Macpherson, D. E., & Williams, D. A. (2007) · European Journal of Engineering Education · doi:10.1080/03043790701276775 · Cited by 43 · see citing works
Robinson, A., Adelson, J. L., Kidd, K. A., et al. (2017) · Gifted Child Quarterly · doi:10.1177/0016986217738049 · Cited by 43 · see citing works
Sarican, G., & Akgündüz, D. (2018) · Cypriot Journal of Educational Sciences · doi:10.18844/cjes.v13i1.3372 · Cited by 43 · see citing works
Young children’s learning of water physics by constructing working systems
Levy, S. T. (2012) · International Journal of Technology and Design Education · doi:10.1007/s10798-012-9202-z · Cited by 39 · see citing works
Design‐based learning for biology
Ellefson, M., Brinker, R., Vernacchio, V. J., & Schunn, C. D. (2008) · Biochemistry and Molecular Biology Education · doi:10.1002/bmb.20203 · Cited by 38 · see citing works
Lin, Y., Wang, M.-T., & Wu, C.-C. (2018) · The Asia-Pacific Education Researcher · doi:10.1007/s40299-018-0415-0 · Cited by 33 · see citing works
Burušić, J., Šimunović, M., & Šakić, M. (2019) · Research in Science & Technological Education · doi:10.1080/02635143.2019.1646717 · Cited by 33 · see citing works
Changtong, N., Maneejak, N., & Yasr, P. (2020) · International Journal of Educational Methodology · doi:10.12973/ijem.6.1.185 · Cited by 31 · see citing works
Marulcu, İ., & Barnett, M. (2015) · Research in Science & Technological Education · doi:10.1080/02635143.2015.1077327 · Cited by 28 · see citing works
Student Interest in Engineering Design‐Based Science
Guzey, S., Moore, T., & Morse, G. (2016) · School Science and Mathematics · doi:10.1111/ssm.12198 · Cited by 28 · see citing works
Concept learning by direct current design challenges in secondary education
van Breukelen, D. H. J., de Vries, M. J., & Schure, F. A. (2016) · International Journal of Technology and Design Education · doi:10.1007/s10798-016-9357-0 · Cited by 26 · see citing works
Effects of Toy Crane Design-Based Learning on Simple Machines
Korur, F., Efe, G., Erdogan, F., & Tunç, B. (2015) · International Journal of Science and Mathematics Education · doi:10.1007/s10763-015-9688-4 · Cited by 24 · see citing works
Enhancing Science Achievement Utilising an Integrated STEM Approach
Saat, R. M., Yaki, A. A., Sathasivam, R. V., & Zulnaidi, H. (2019) · Malaysian Journal of Learning and Instruction · doi:10.32890/mjli2019.16.1.8 · Cited by 23 · see citing works
Resolving referential ambiguity across ambiguous situations in young foreign language learners
Hu, C. (2016) · Applied Psycholinguistics · doi:10.1017/s0142716416000357 · Cited by 22 · see citing works
The effects of engineering design processes on spatial abilities of middle school students
Yıldız, S. G., & Özdemir, A. Ş. (2018) · International Journal of Technology and Design Education · doi:10.1007/s10798-018-9491-y · Cited by 22 · see citing works
EFFECT OF A STEM-ORIENTED COURSE ON STUDENTS’ MARINE SCIENCE MOTIVATION, INTEREST, AND ACHIEVEMENTS
Tsai, L.-T., Chang, C.-C., & Cheng, H.-T. (2021) · Journal of Baltic Science Education · doi:10.33225/jbse/21.20.134 · Cited by 22 · see citing works
Negotiating science and engineering: an exploratory case study of a reform-minded science teacher
Guzey, S., & Ring-Whalen, E. A. (2018) · International Journal of Science Education · doi:10.1080/09500693.2018.1445310 · Cited by 21 · see citing works
Capturing Children with Autism’s Engagement in Engineering Practices: A Focus on Problem Scoping
Ehsan, H., & Cardella, M. (2020) · Journal of Pre-College Engineering Education Research (J-PEER) · doi:10.7771/2157-9288.1262 · Cited by 18 · see citing works
Gülen, S., & Yaman, S. (2019) · DSpace@MŞU · doi:10.12973/tused.10276a · Cited by 16 · see citing works
Comparing Two Approaches to Engineering Design in the 7th Grade Science Classroom
Goldstein, M., Omar, S. A., Purzer, Ș., & Adams, R. S. (2018) · International Journal of Education in Mathematics Science and Technology · doi:10.18404/ijemst.440340 · Cited by 15 · see citing works
Professional Development for a Middle School Mathematics-Infused Science Curriculum
McHugh, L., Kelly, A. M., & Burghardt, M. D. (2018) · Journal of Science Teacher Education · doi:10.1080/1046560x.2018.1514825 · Cited by 15 · see citing works
Guzey, S., Harwell, M. R., Moreno, M., Peralta, Y., & Moore, T. (2016) · Journal of Science Education and Technology · doi:10.1007/s10956-016-9673-x · Cited by 10 · see citing works
Chou, P., Chen, W., Wu, C. Y., et al. (2017) · International journal of engineering education · Cited by 9 · see citing works
Gazibeyoğlu, T., & Aydın, A. (2019) · Universal Journal of Educational Research · doi:10.13189/ujer.2019.070513 · Cited by 9 · see citing works
Examining the influence of a STEM certification model on female, minority science outcomes
Wendt, J. L., Rockinson‐Szapkiw, A. J., & Cordes, M. (2017) · The Journal of Educational Research · doi:10.1080/00220671.2017.1396437 · Cited by 8 · see citing works
Assessment of deep learning ability for problem solvers
OEHLERS, D. J., & Walker, D. (2006) · Adelaide Research & Scholarship (AR&S) (University of Adelaide) · Cited by 7 · see citing works
Silver, I. A., & Kelsay, J. D. (2021) · Journal of Experimental Criminology · doi:10.1007/s11292-021-09478-7 · Cited by 6 · see citing works
Understanding design education with a bibliometric approach: a story of 50 years
Delen, İ., Özüdoğru, F., Demir, K., Büber, A., Erdoğmuş, Y. K., Demir, E. B. K., Çoban, G. Ü., & Akpınar, E. (2023) · Research in Engineering Design · doi:10.1007/s00163-023-00425-3 · Cited by 6 · see citing works
Self-citationChabalengula, V. M., Bendjemil, S. A., Mumba, F., et al. (2017) · International journal of engineering education · Cited by 4 · see citing works
Barbero, B. R., Vara, J. P., Maté, E. G., et al. (2007) · Computer Applications in Engineering Education · doi:10.1002/cae.20158 · Cited by 3 · see citing works
A summary of the research on domestic Design Based Learning
Tang, Y., & Sun, X. (2017) · International Conference on Economics, Management Engineering and Education Technology (ICEMEET) · doi:10.2991/icemeet-16.2017.64 · Cited by 2 · see citing works
Flagged first, then by citations
- Authors
- Delen, I., & Sen, S.
- Affiliations
- Department of Educational Sciences Usak University Usak Turkey
- Department of Educational Sciences Harran University Sanliurfa Turkey
- Venue
- Journal of Research in Science Teaching
- Publisher
- Wiley
- Published
- 2022-07-30
- Volume
- 60
- Issue
- 2
- Pages
- 330-356
- ISSN
- 0022-4308 (ISSN-L)
- 1098-2736
- OpenAlex
- W4288855698
- Cited by
- 37
- References
- 92
- Citations by year
- 2026: 10 · 2025: 11 · 2024: 9 · 2023: 7
- FWCI
- 14.56
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Research in Science Teaching (publishedVersion)
- Funders
- European Commission
- Topics
- Social Sciences › Education › Problem and Project Based Learning
- Social Sciences › Education › Science Education and Pedagogy
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Keywords
- design-based learning, academic performance, K-12 education, science education, mathematics education, STEM education, moderators of effect size, random assignment, control group comparison, cross-national differences, content understanding
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review