CoChat

A Meta-analysis of the Worked Examples Effect on Mathematics Performance

Barbieri, Christina Areizaga, Miller-Cotto, Dana, Clerjuste, Sarah N., Chawla, Kamal · 2023 · Educational Psychology Review
Cited by 55

The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s10648-023-09745-1

Cites

13 of 13 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 13 references

Research works printed but not linked: 79

  1. *Adams, D. M., McLaren, B. M., Durkin, K., Mayer, R. E., Rittle-Johnson, B., Isotani, S., & Van Velsen, M. (2014). Using erroneous examples to improve mathematics learning with a web-based tutoring system. Computers in Human Behavior, 36, 401-411. https://doi.org/10.1016/j.chb.2014.03.053 · DOI
  2. Anderson, J. R., Fincham, J. M., & Douglass, S. (1997). The role of examples and rules in the acquisition of a cognitive skill. Journal of Experimental Psychology: Learning, Memory, and Cognition, 23(4), 932–945. https://doi.org/10.1037/0278-7393.23.4.932 · doi:10.1037/0278-7393.23.4.932 · Paper page
  3. Atkinson, R. K., Derry, S. J., Renkl, A., & Wortham, D. (2000). Learning from examples: Instructional principles from the worked examples research. Review of Educational Research, 70(2), 181–214. https://doi.org/10.3102/00346543070002181 · doi:10.3102/00346543070002181 · Paper page
  4. Atkinson, R. K., Renkl, A., & Merrill, M. M. (2003). Transitioning from studying examples to solving problems: Effects of self-explanation prompts and fading worked-out steps. Journal of Educational Psychology, 95(4), 774–783. https://doi.org/10.1037/0022-0663.95.4.774 · DOI · Paper page
  5. *Barbieri, C., & Booth, J. L. (2016). Support for struggling students in algebra: Contributions of incorrect worked examples. Learning and Individual Differences, 48, 36–44. https://doi.org/10.1016/j.lindif.2016.04.001 · DOI
  6. Barbieri, C. A., Miller-Cotto, D., & Booth, J. L. (2019). Lessening the load of misconceptions: Design-based principles for algebra learning. Journal of the Learning Sciences, 28(3), 381–417. https://doi.org/10.1080/10508406.2019.1573428 · DOI
  7. *Barbieri, C. A., & Booth, J. L. (2020). Mistakes on display: Incorrect examples refine equation solving and algebraic feature knowledge. Applied Cognitive Psychology, 34(4), 862–878. https://doi.org/10.1002/acp.3663 · DOI
  8. *Barbieri, C.A., Booth, J.L. & Chawla, K. (2022). Let’s be rational: Worked examples supplemented textbooks improve pre-algebra students’ conceptual and fraction magnitude knowledge. Educational Psychology, 1–21. https://doi.org/10.1080/01443410.2022.2144142 · DOI
  9. *Barbieri, C., Booth, J.L., Begolli, K.N., & McCann, N.F. (2021). The effect of worked examples on student learning and error anticipation in algebra. Instructional Science, 49(4), 419–439. https://doi.org/10.1007/s11251-021-09545-6 · DOI
  10. *Barbieri, C.A., & Devlin, B. (under review). Targeting fraction misconceptions and reducing high confidence errors: Effects of worked example types and problem-solving with corrective feedback.
  11. *Begolli, K. N., Dai, T., McGinn, K. M., & Booth, J. L. (2021). Could probability be out of proportion? Self-explanation and example-based practice help students with lower proportional reasoning skills learn probability. Instructional Science, 49(4), 441–473. https://doi.org/10.1007/s11251-021-09550-9 · DOI
  12. *Bentley, B., & Yates, G. (2017). Facilitating proportional reasoning through worked examples: Two classroom-based experiments. Cogent Education, 4(1), 1-14. https://doi.org/10.1080/2331186X.2017.1297213 · DOI
  13. Berthold, K., Eysink, T. H., & Renkl, A. (2009). Assisting self-explanation prompts are more effective than open prompts when learning with multiple representations. Instructional Science, 37(4), 345–363. https://doi.org/10.1007/s11251-008-9051-z · DOI · Paper page
  14. *Bokosmaty, S., Sweller, J., & Kalyuga, S. (2015). Learning geometry problem solving by studying worked examples: Effects of learner guidance and expertise. American Educational Research Journal, 52(2), 307–333. https://doi.org/10.3102/0002831214549450 · DOI
  15. Booth, J. L., McGinn, K. M., Barbieri, C., Begolli, K. N., Chang, B., Miller-Cotto, D., Young, L. K., & Davenport, J. L. (2017). Evidence for cognitive science principles that impact learning in mathematics. In D. C. Geary, D. B. Berch, R. Ochsendorf, & K. M. Koepke (Eds.), Acquisition of complex arithmetic skills and higher-order mathematics concepts (pp. 297–325). Elsevier Academic Press. https://doi.org/10.1016/B978-0-12-805086-6.00013-8 · DOI
  16. *Booth, J. L., Lange, K. E., Koedinger, K. R., & Newton, K. J. (2013). Using example problems to improve student learning in algebra: Differentiating between correct and incorrect examples. Learning and Instruction, 25, 24–34. https://doi.org/10.1016/j.learninstruc.2012.11.002 · DOI · Paper page
  17. Booth, J. L., McGinn, K. M., Young, L. K., & Barbieri, C. (2015a). Simple practice doesn’t always make perfect: Evidence from the worked example effect. Policy Insights from the Behavioral and Brain Sciences, 2(1), 24–32. https://doi.org/10.1177/2372732215601691 · DOI
  18. *Booth, J. L., Cooper, L., Donovan, M. S., Huyghe, A., Koedinger, K. R., & Paré-Blagoev, E. J. (2015b). Design-based research within the constraints of practice: AlgebraByExample. Journal of Education for Students Placed at Risk, 20(1–2), 79–100. https://doi.org/10.1080/10824669.2014.986674 · DOI · Paper page
  19. *Booth, J. L., Oyer, M. H., Paré-Blagoev, E. J., Elliot, A., Barbieri, C. Augustine, A. A., & Koedinger, K.R. (2015c). Learning algebra by example in real-world classrooms. Journal of Research on Educational Effectiveness, 8(4), 530–551. https://doi.org/10.1080/19345747.2015.1055636 · DOI
  20. Catrambone, R. (1998). The subgoal learning model: Creating better examples so that students can solve novel problems. Journal of Experimental Psychology, 127(4), 355–376. https://doi.org/10.1037/0096-3445.127.4.355 · doi:10.1037/0096-3445.127.4.355 · Paper page
  21. Catrambone, R., & Yuasa, M. (2006). Acquisition of procedures: The effects of example elaborations and active learning exercises. Learning and Instruction, 16(2), 139–153. https://doi.org/10.1016/j.learninstruc.2006.02.002 · DOI
  22. *Chen, O. (2016). The worked example effect, the generation effect, and element interactivity [Unpublished doctoral dissertation]. University of New South Wales.
  23. *Chen, O., Retnowati, E., & Kalyuga, S. (2019). Effects of worked examples on step performance in solving complex problems. Educational Psychology, 39(2), 188–202. https://doi.org/10.1080/01443410.2018.1515891 · DOI
  24. Chi, M. T. (2013). Self-explaining expository texts: The dual processes of generating inferences and repairing mental models. In R. Glaser (Ed.), Advances in Instructional Psychology (pp. 161–238). Routledge.
  25. *Chung, K. K. H., & Tam, Y. H. (2005). Effects of cognitive-based instruction on mathematical problem solving by learners with mild intellectual disabilities. Journal of Intellectual & Developmental Disability, 30(4), 207–216. · DOI
  26. *Cook, M. A. (2017). A Comparison of the effectiveness of worked examples and productive failure in learning procedural and conceptual knowledge related to statistics. [Doctoral Dissertation, The Pennsylvania State University].
  27. *Cozean, K. R. (2010). Enhancing performance in high school algebra: Using guided homework as an instruction strategy [Doctoral Dissertation, Capella University]. ProQuest Dissertations Publishing.
  28. Durkin, K., & Rittle-Johnson, B. (2012). The effectiveness of using incorrect examples to support learning about decimal magnitude. Learning and Instruction, 22(3), 206–214. https://doi.org/10.1016/j.learninstruc.2011.11.001 · DOI · Paper page
  29. *Earnshaw, Y. (2014). Effects of levels of instructional assistance on learning and mental effort in an intelligent tutoring system: Proportional reasoning and middle school students (Publication No. 3637974) [Doctoral Dissertation, Florida State University]. ProQuest Dissertations & Theses A&I.
  30. *Fitzsimmons, C. J., Morehead, K., Thompson, C. A., Buerke, M., & Dunlosky, J. (2021). Can feedback, correct, and incorrect worked examples improve numerical magnitude estimation precision? The Journal of Experimental Education, 91(1), 20–45. https://doi.org/10.1080/00220973.2021.1891009 · DOI
  31. Gartmeier, M., Bauer, J., Gruber, H., & Heid, H. (2008). Negative knowledge: Understanding professional learning and expertise. Vocations and Learning, 1(2), 87–103. https://doi.org/10.1007/s12186-008-9006-1 · DOI · Paper page
  32. Gavaghan DJ, Moore AR, McQuay HJ. (2000). An evaluation of homogeneity tests in meta-analyses in pain using simulations of individual patient data. Pain, 85(3), 415–424. https://doi.org/10.1016/S0304-3959(99)00302-4 · DOI · Paper page
  33. Große, C. S., & Renkl, A. (2007). Finding and fixing errors in worked examples: Can this foster learning outcomes? Learning and Instruction, 17(6), 612–634. · DOI · Paper page
  34. *Hartmann, C., van Gog, T. & Rummel, N. (2021). Preparatory effects of problem solving versus studying examples prior to instruction. Instructional Science, 49(1), 1–21. https://doi.org/10.1007/s11251-020-09528-z · DOI
  35. Higgins, J. P., & Green, S. (2013). Cochrane handbook for systematic reviews of interventions version 5.1. 0. Chapter 8: Assessing risk of bias in included studies. The Cochrane Collaboration, 2011.
  36. Heemsoth, T., & Heinze, A. (2014). The impact of incorrect examples on learning fractions: A field experiment with 6th grade students. Instructional Science, 42(4), 639–657. https://doi.org/10.1007/s11251-014-9313-x · doi:10.1007/s11251-014-9313-x
  37. Higgins, J. P., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003). Measuring Inconsistency in Meta-Analyses. BMJ (clinical Research Ed.), 327(7414), 557–560. https://doi.org/10.1136/bmj.327.7414.557 · DOI · Paper page
  38. Higgins, J. P., & Thompson, S. G. (2002). Quantifying heterogeneity in a meta-analysis. Statistics in Medicine, 21(11), 1539–1558. https://doi.org/10.1002/sim.1186 · DOI · Paper page
  39. *Hilbert, T. S., Renkl, A., Kessler, S., & Reiss, K. (2008). Learning to prove in geometry: Learning from heuristic examples and how it can be supported. Learning and Instruction, 18(1), 54-65. https://doi.org/10.1016/j.learninstruc.2006.10.008 · DOI
  40. *Hsiao, J., Hung, C., Lan, Y., & Jeng, Y. (2013). Integrating worked examples into problem posing in a web-based learning environment. Turkish Online Journal of Educational Technology, 12(2), 166–176
  41. Huang, X., & Reiser, R. A. (2012). The effect of instructional explanations and self-explanation prompts in worked examples on student learning and transfer. International Journal of Instructional Media, 39(4), 331–344.
  42. Kalyuga, S., Rikers, R., & Paas, F. (2012). Educational implications of expertise reversal effects in learning and performance of complex cognitive and sensorimotor skills. Educational Psychology Review, 24(2), 313–337. https://doi.org/10.1007/s10648-012-9195-x · DOI
  43. Kuhn, D., & Katz, J. (2009). Are self-explanations always beneficial?. Journal of Experimental Child Psychology, 103(3), 386–394. · DOI
  44. *Likourezos, V., Kalyuga, S. & Sweller, J. (2019). The variability effect: When instructional variability is advantageous. Educational Psychology Review, 31(2), 479–497. https://doi.org/10.1007/s10648-019-09462-8 · DOI
  45. Matthews, P., & Rittle-Johnson, B. (2009). In pursuit of knowledge: Comparing self-explanations, concepts, and procedures as pedagogical tools. Journal of Experimental Child Psychology, 104(1), 1–21. · DOI
  46. McGinn, K. M., Lange, K. E., & Booth, J. L. (2015). A worked example for creating worked examples. Mathematics Teaching in the Middle School, 21(1), 26–33. https://doi.org/10.5951/mathteacmiddscho.21.1.0026 · DOI
  47. *McLaren, B.M., Adams, D.M. & Mayer, R.E. (2015). Delayed learning effects with erroneous examples: A study of learning decimals with a web-based tutor. International Journal of Artificial Intelligence in Education, 25(4), 520–542. https://doi.org/10.1007/s40593-015-0064-x · DOI · Paper page
  48. *Miller-Cotto, D. (2017). The role of prior knowledge, executive function, and perceived cognitive load on the effectiveness of faded worked examples in geometry. [Doctoral Dissertation, Temple University]. ProQuest Dissertations Publishing.
  49. *Miller-Cotto, D., & Auxter, A. E. (2019). Testing the ecological validity of faded worked examples in algebra. Educational Psychology, 41(2), 191–205. https://doi.org/10.1080/01443410.2019.1646411 · DOI
  50. *Mwangi, W., & Sweller, J. (1998). Learning to solve compare word problems: The effect of example format and generating self-explanations. Cognition and Instruction, 16(2), 173–199. https://doi.org/10.1207/s1532690xci1602_2 · DOI · Paper page
  51. *Newman, P. M., & DeCaro, M. S. (2019). Learning by exploring: How much guidance is optimal?. Learning and Instruction, 62, 49–63. · DOI · Paper page
  52. * Nye, B. D., Pavlik, P. I., Jr, Windsor, A., Olney, A. M., Hajeer, M., & Hu, X. (2018). SKOPE-IT (Shareable Knowledge Objects as Portable Intelligent Tutors): Overlaying natural language tutoring on an adaptive learning system for mathematics. International Journal of STEM Education, 5(1), 12. https://doi.org/10.1186/s40594-018-0109-4 · DOI · Paper page
  53. Pashler, H., Bain, P. M., Bottge, B. A., Graesser, A., Koedinger, K., McDaniel, M., & Metcalfe, J. (2007). Organizing instruction and study to improve student learning. IES Practice Guide. NCER 2007–2004. National Center for Education Research. · DOI · Paper page
  54. *Reed, S. K., Corbett, A., Hoffman, B., Wagner, A., & MacLaren, B. (2013). Effect of worked examples and cognitive tutor training on constructing equations. Instructional Science, 41(1), 1–24. https://doi.org/10.1007/s11251-012-9205-x · DOI
  55. *Reiss, K. M., Heinze, A., Renkl, A., & Große, C. (2008). Reasoning and proof in geometry: Effects of a learning environment based on heuristic worked-out examples. ZDM, 40(3), 455-467. https://doi.org/10.1007/S11858-008-0105-0 · DOI
  56. Renkl, A. (2014). Toward an instructionally oriented theory of example-based learning. Cognitive Science, 38(1), 1–37. https://doi.org/10.1111/cogs.12086 · DOI · Paper page
  57. Renkl, A., & Atkinson, R. K. (2010). Learning from worked-out examples and problem solving. In J. L. Plass, R. Moreno, & R. Brünken (Eds.), Cognitive load theory (pp. 91–108). Cambridge University Press. https://doi.org/10.1017/CBO9780511844744.007 · DOI
  58. *Retnowati, E., Ayres, P., & Sweller, J. (2010) Worked example effects in individual and group work settings. Educational Psychology, 30(3), 349–367. https://doi.org/10.1080/01443411003659960 · DOI · Paper page
  59. *Retnowati, E., Ayres, P., & Sweller, J. (2017). Can collaborative learning improve the effectiveness of worked examples in learning mathematics? Journal of Educational Psychology, 109(5), 666–679. https://doi.org/10.1037/edu0000167 · DOI · Paper page
  60. Rittle-Johnson, B., & Star, J. R. (2007). Does comparing solution methods facilitate conceptual and procedural knowledge? An experimental study on learning to solve equations. Journal of Educational Psychology, 99(3), 561–574. https://doi.org/10.1037/0022-0663.99.3.561 · DOI · Paper page
  61. Rittle-Johnson, B., Loehr, A. M., & Durkin, K. (2017). Promoting self-explanation to improve mathematics learning: A meta-analysis and instructional design principles. ZDM Mathematics Education, 49(4), 599–611. https://doi.org/10.1007/s11858-017-0834-z · DOI
  62. Sadler, P. M., & Tai, R. H. (2007). The two high-school pillars supporting college science. Science, 317(5837), 457–458. https://doi.org/10.1126/SCIENCE.1144214 · DOI · Paper page
  63. *Salden, R. J., Aleven, V., Schwonke, R., & Renkl, A. (2010). The expertise reversal effect and worked examples in tutored problem solving. Instructional Science, 38(3), 289-307. https://doi.org/10.1007/s11251-009-9107-8 · DOI
  64. *Schwonke, R., Wittwer, J., Aleven, V., Salden, R. J. C. M., Krieg, C., & Renkl, A. (2007). Can tutored problem solving benefit from faded worked-out examples. In Proceedings of EuroCogSci, (Vol. 7, pp. 59–64).
  65. Schwonke, R., Renkl, A., Krieg, C., Wittwer, J., Aleven, V., & Salden, R. (2009). The worked-example effect: Not an artefact of lousy control conditions. Computers in Human Behavior, 25(2), 258–266. https://doi.org/10.1016/j.chb.2008.12.011 · DOI · Paper page
  66. Shapka, J. D., Domene, J. F., & Keating, D. P. (2006). Trajectories of career aspirations through adolescence and young adulthood: Early math achievement as a critical filter. Educational Research and Evaluation, 12(4), 347–358. https://doi.org/10.1080/13803610600765752 · DOI · Paper page
  67. *Star, J. R., Pollack, C., Durkin, K., Rittle-Johnson, B., Lynch, K., Newton, K., & Gogolen, C. (2015). Learning from comparison in algebra. Contemporary Educational Psychology, 40, 41–54. https://doi.org/10.1016/j.cedpsych.2014.05.005 · DOI · Paper page
  68. Star, J. R., & Rittle-Johnson, B. (2009). It pays to compare: An experimental study on computational estimation. Journal of Experimental Child Psychology, 102(4), 408–426. https://doi.org/10.1016/j.jecp.2008.11.004 · DOI · Paper page
  69. Sweller, J. (2006). The worked example effect and human cognition. Learning and Instruction, 16(2), 165–169. https://doi.org/10.1016/j.learninstruc.2006.02.005 · DOI · Paper page
  70. Sweller, J. (2012). Human cognitive architecture: Why some instructional procedures work and others do not. In K. R. Harris, S. Graham, T. Urdan, C. B. McCormick, G. M. Sinatra, & J. Sweller (Eds.), APA educational psychology handbook, Vol. 1. Theories, constructs, and critical issues (pp. 295–325). American Psychological Association. https://doi.org/10.1037/13273-011 · DOI · Paper page
  71. Sweller, J., & Cooper, G. A. (1985). The use of worked examples as a substitute for problem solving in learning algebra. Cognition and Instruction, 2(1), 59–89. https://doi.org/10.1207/s1532690xci0201_3 · DOI · Paper page
  72. *Ter Vrugte, J., Jong, T., Vandercruysse, S., Wouters, P., Oostendorp, H., & Elen, J. (2017). Computer game-based mathematics education: Embedded faded worked examples facilitate knowledge acquisition. Learning and Instruction, 50, 44–53. https://doi.org/10.1016/j.learninstruc.2016.11.007 · DOI
  73. Trafton, J. G., & Reiser, B. J. (1993). Studying examples and solving problems: Contributions to skill acquisition [Conference session]. In Proceedings of the 15th conference of the Cognitive Science Society, pp. 1017–1022.
  74. *van Harsel, M., Hoogerheide, V., Verkoeijen, P., & van Gog, T. (2019). Effects of different sequences of examples and problems on motivation and learning. Contemporary Educational Psychology, 58, 260-275. https://doi.org/10.1016/j.cedpsych.2019.03.005 · DOI · Paper page
  75. VanLehn, K. (1996). Cognitive skill acquisition. Annual Review of Psychology, 47(1), 513–539. · DOI · Paper page
  76. *van Loon-Hillen, N., van Gog, T., & Brand-Gruwel, S. (2012) Effects of worked examples in a primary school mathematics curriculum, Interactive Learning Environments, 20(1), 89–99. https://doi.org/10.1080/10494821003755510 · DOI · Paper page
  77. Wallace, B.C., Small, K., Brodley, C. E., Lau, J., & Trikalinos, T., A. (2012). Deploying an interactive machine learning system in an evidence-based practice center: Abstrackr. Proceedings of the 2nd ACM SIGHT International Health Informatics Symposium (IHI), 819–824. · DOI · Paper page
  78. *Zimmerman, W. A. (2015). Impact of instructional materials eliciting low and high cognitive load on self-efficacy and demonstrated knowledge. [Doctoral Dissertation, The Pennsylvania State University].
  79. *Zormelo, B. (2018). Investigating the effect of using worked-out examples teaching approach when teaching properties of special quadrilaterals in grade 10 geometry. [Unpublished masters thesis]. University of South Africa.

Cited by

See all 55

Metadata

Authors
Barbieri, C. A., Miller-Cotto, D., Clerjuste, S. N., & Chawla, K.
Venue
Educational Psychology Review
Published
2023-01-30
Volume
35
Issue
1
ISSN
  • 1040-726X
  • 1573-336X
Cited by
55
References
13
Language
en
Licence

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A Meta-analysis of the Worked Examples Effect on Mathematics Performance. https://app.cochat.ai/papers/10.1007/s10648-023-09745-1
The paper
Barbieri, C. A., Miller-Cotto, D., Clerjuste, S. N., & Chawla, K. (2023). A Meta-analysis of the Worked Examples Effect on Mathematics Performance. Educational Psychology Review. https://doi.org/10.1007/s10648-023-09745-1

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.