Factors affecting learning of vector math from computer-based practice: Feedback complexity and prior knowledge
Open accessAbstract
In a computer-based learning environment providing a brief general explanation of the correct solution process leads to stronger learning gains than telling students about the correctness of their answer.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Feedback effectiveness depends on contextual factors (learning environment, learner characteristics) and intrinsic features (modality, delivery mode, source, content).
“Its impact depends on contextual factors such as the learning environment and learner characteristics (Heckler and Mikula, 2016), as well as intrinsic features of the feedback itself, including modality, delivery mode, source, and, most importantly, its content (Ramadan Elbaioumi Shaddad and Jember, 2024; Graham et al., 2015; Rüdian et al., 2025).”
From Assessing the Impact and Underlying Pathways of Sequenced AI feedback on Student Learning (2026) · cites this paper as Heckler and Mikula, 2016
The Summary and General Discussion reports that feedback effectiveness varied with students’ prior knowledge, supporting the learner-characteristics part of the clause cited to Heckler and Mikula. In “Varying complexity of feedback,” the authors caution that findings may not apply to a different domain and context, but they do not establish that differences between learning environments change feedback effectiveness. The later list of feedback features is attributed to other citations, not this paper. (LLM, conf=0.82)
Experimental — accuracy not yet measuredA particularly effective form of feedback provides the correct answer with an explanation of why it is correct.
“A particularly effective form of feedback provides the correct answer with an explanation of why it is the correct answer (Heckler and Mikula, 2016; Van der Kleij et al., 2015; Butler et al., 2013; Wisniewski et al., 2020).”
From Assessing the Impact and Underlying Pathways of Sequenced AI feedback on Student Learning (2026) · cites this paper as Heckler and Mikula, 2016
The Experiment 2 results section reports the largest gain over control for feedback combining the correct response and an explanation, and finds some evidence of added benefit. But it found no significant difference between that combination and explanation feedback alone; the benefit of more complex feedback was concentrated among students with low prior knowledge. The unqualified description of this combination as particularly effective overstates the finding. (LLM, conf=0.86)
Experimental — accuracy not yet measuredThe benefits of elaborated feedback are particularly pronounced for learners with lower prior knowledge and lower course grades.
“Further, Heckler and Mikula (2016) found that the benefits of elaborated feedback were particularly pronounced for learners with lower prior knowledge and lower course grades.”
From Assessing the Impact and Underlying Pathways of Sequenced AI feedback on Student Learning (2026) · cites this paper as Heckler and Mikula, 2016
There is robust evidence that elaborate feedback with correct answers facilitates learning.
“On the one hand, there is robust evidence that elaborate feedback with correct answers facilitates learning (Heckler and Mikula, 2016; Van der Kleij et al., 2015; Wisniewski et al., 2020).”
From Assessing the Impact and Underlying Pathways of Sequenced AI feedback on Student Learning (2026) · cites this paper as Heckler and Mikula, 2016
Elaborated feedback with correct answer produces larger learning gains, particularly for students with lower prior knowledge.
“Such elaborated feedback with the correct answer can deliver information directly and efficiently, and it can be further elaborated to include explanations, strategies, and guidance for self-regulation (Wisniewski et al., 2020), which shows effectiveness in producing larger learning gains, particularly for students with lower prior knowledge (Heckler and Mikula, 2016).”
From Assessing the Impact and Underlying Pathways of Sequenced AI feedback on Student Learning (2026) · cites this paper as Heckler and Mikula, 2016
Non-layered feedback can be effective without layering.
“However, non-layered feedback can be effective without layering (e.g., (Heckler and Mikula, 2016; Van der Kleij et al., 2015; Wisniewski et al., 2020)).”
From Assessing the Impact and Underlying Pathways of Sequenced AI feedback on Student Learning (2026) · cites this paper as Heckler and Mikula, 2016
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905 · see citing works
The role of deliberate practice in the acquisition of expert performance
Ericsson, K. A., Krampe, R. T., & Tesch-Römer, C. (1993) · Psychological Review · doi:10.1037/0033-295x.100.3.363 · Cited by 9,564 · cited 1× · see citing works
“Designing specific training to address these skills is in line with the theoretical frameworks of deliberate practice, in which expert performance in a domain is the result of focused efforts to improve performance [30], and reduction of cognitive load, [25,26].”
BackgroundKluger, A. N., & DeNisi, A. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.254 · Cited by 5,882 · see citing works
Shute, V. J. (2008) · Review of Educational Research · doi:10.3102/0034654307313795 · Cited by 4,631 · see citing works
Cognitive Load Theory and Complex Learning: Recent Developments and Future Directions
van Merriënboer, J. J. G., & Sweller, J. (2005) · Educational Psychology Review · doi:10.1007/s10648-005-3951-0 · Cited by 2,206 · see citing works
Handbook of research on educational communications and technology
(2004) · British Journal of Educational Technology · doi:10.1111/j.1467-8535.2004.00409_15.x · Cited by 1,853 · see citing works
The instructional effect of feedback in test-like events.
Bangert-Drowns, R. L., Kulik, C.-L. C., Kulik, J. A., & Morgan, M. (1991) · Review of Educational Research · doi:10.3102/00346543061002213 · Cited by 1,313 · see citing works
Expertise Reversal Effect and Its Implications for Learner-Tailored Instruction
Kalyuga, S. (2007) · Educational Psychology Review · doi:10.1007/s10648-007-9054-3 · Cited by 1,056 · see citing works
Tamim, R. M., Bernard, R. M., Borokhovski, E., Abrami, P. C., & Schmid, R. F. (2011) · Review of Educational Research · doi:10.3102/0034654310393361 · Cited by 1,029 · see citing works
Effectiveness of computer-based instruction: An updated analysis
Kulik, C. C., & Kulik, J. A. (1991) · Computers in Human Behavior · doi:10.1016/0747-5632(91)90030-5 · Cited by 963 · see citing works
Kapur, M. (2008) · Cognition and Instruction · doi:10.1080/07370000802212669 · Cited by 867 · see citing works
Van der Kleij, F. M., Feskens, R. C. W., & Eggen, T. J. H. M. (2015) · Review of Educational Research · doi:10.3102/0034654314564881 · Cited by 714 · cited 3× · see citing works
“[4], since they found the EF is best for higher level learning outcomes which, here, might be interpreted as relevant for students with low prior knowledge.”
BackgroundInfluentialWhy Do Only Some Events Cause Learning During Human Tutoring?
VanLehn, K. A., Siler, S. A., Murray, C., Yamauchi, T., & Baggett, W. B. (2003) · Cognition and Instruction · doi:10.1207/s1532690xci2103_01 · Cited by 443 · see citing works
Do People Have Insight Into Their Abilities? A Metasynthesis
Zell, E., & Križan, Z. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691613518075 · Cited by 437 · see citing works
(2009) · Routledge eBooks · doi:10.4324/9780203878842 · Cited by 332 · see citing works
Toward a theory of cognitive aptitude for learning from instruction.
Snow, R. E., & Lohman, D. F. (1984) · Journal of Educational Psychology · doi:10.1037//0022-0663.76.3.347 · Cited by 323 · see citing works
Handbook of Research on Learning and Instruction
Mayer, R., Alexander, P., & Fiorella, L. (2011) · Routledge eBooks · doi:10.4324/9780203839089 · Cited by 323 · see citing works
Optimizing distributed practice
Cepeda, N. J., Coburn, N., Rohrer, D., Wixted, J. T., Mozer, M. C., & Pashler, H. (2009) · Experimental Psychology · doi:10.1027/1618-3169.56.4.236 · Cited by 296 · see citing works
Effects of feedback in a computer-based assessment for learning
der Kleij, F. M. V., Eggen, T. J. H. M., Timmers, C. F., & Veldkamp, B. P. (2011) · Computers & Education · doi:10.1016/j.compedu.2011.07.020 · Cited by 245 · see citing works
Exploring the relationship between self‐efficacy and retention in introductory physics
Sawtelle, V., Brewe, E. T., & Kramer, L. (2012) · Journal of Research in Science Teaching · doi:10.1002/tea.21050 · Cited by 239 · see citing works
Toward a theory of cognitive aptitude for learning from instruction.
Snow, R. E., & Lohman, D. F. (1984) · Journal of Educational Psychology · doi:10.1037/0022-0663.76.3.347 · Cited by 233 · see citing works
Interactive Instruction and Feedback
Dempsey, J. V., & Sales, G. C. (1993) · Educational Technology Publications eBooks · Cited by 229 · see citing works
Lau, S., & Roeser, R. W. (2002) · Educational Assessment · doi:10.1207/s15326977ea0802_04 · Cited by 226 · see citing works
Comparative Effects of Computer-Assisted Instruction: A Synthesis of Reviews
Niemiec, R. P., & Walberg, H. J. (1987) · Journal of Educational Computing Research · doi:10.2190/rmx5-1ltb-qdcc-d5ha · Cited by 199 · see citing works
van Merriënboer, J. J. G., & Kirschner, P. A. (2012) · Routledge eBooks · doi:10.4324/9780203096864 · Cited by 157 · see citing works
Feedback complexity and corrective efficiency
Kulhavy, R. W., White, M. T., Topp, B., Chan, A. L., & Adams, J. B. (1985) · Contemporary Educational Psychology · doi:10.1016/0361-476x(85)90025-6 · Cited by 137 · see citing works
The effects of feedback during exploratory mathematics problem solving: Prior knowledge matters.
Fyfe, E. R., Rittle‐Johnson, B., & DeCaro, M. S. (2012) · Journal of Educational Psychology · doi:10.1037/a0028389 · Cited by 127 · see citing works
The vector knowledge of beginning physics students
Knight, R. D. (1995) · The Physics Teacher · doi:10.1119/1.2344143 · Cited by 102 · see citing works
Test of understanding of vectors: A reliable multiple-choice vector concept test
Barniol, P., & Zavala, G. (2014) · Physical Review Special Topics - Physics Education Research · doi:10.1103/physrevstper.10.010121 · Cited by 94 · see citing works
Feedback in Computer Assisted Instruction
Roper, W. J. (1977) · Programmed Learning and Educational Technology · doi:10.1080/1355800770140107 · Cited by 71 · see citing works
Adding and subtracting vectors: The problem with the arrow representation
Heckler, A. F., & Scaife, T. M. (2015) · Physical Review Special Topics - Physics Education Research · doi:10.1103/physrevstper.11.010101 · Cited by 63 · see citing works
Self-citationFeedback Complexity and Practice: Response Pattern Analysis in Retention and Transfer.
Phye, G. D., & Bender, T. (1989) · Contemporary Educational Psychology · doi:10.1016/0361-476x(89)90028-3 · Cited by 53 · see citing works
Clinical study of student learning using mastery style versus immediate feedback online activities
Gladding, G. E., Gutmann, B., Schroeder, N. L., & Stelzer, T. J. (2015) · Physical Review Special Topics - Physics Education Research · doi:10.1103/physrevstper.11.010114 · Cited by 43 · see citing works
The effects of computers on learning
Niemiec, R. P., & Walberg, H. J. (1992) · International Journal of Educational Research · doi:10.1016/0883-0355(92)90045-8 · Cited by 41 · see citing works
Effects of complex feedback on computer-assisted modular instruction
Gordijn, J., & Nijhof, W. (2002) · Comput. Educ. · doi:10.1016/s0360-1315(02)00025-8 · Cited by 40 · see citing works
Impact of a short intervention on novices’ categorization criteria
Docktor, J. L., Mestre, J. P., & Ross, B. H. (2012) · Physical Review Special Topics - Physics Education Research · doi:10.1103/physrevstper.8.020102 · Cited by 35 · see citing works
Narrated animated solution videos in a mastery setting
Schroeder, N. L., Gladding, G. E., Gutmann, B., & Stelzer, T. J. (2015) · Physical Review Special Topics - Physics Education Research · doi:10.1103/physrevstper.11.010103 · Cited by 22 · see citing works
“Do we need to memorize that?” or cognitive science for chemists
Hartman, J. R., & Nelson, E. A. (2015) · Foundations of Chemistry · doi:10.1007/s10698-015-9226-z · Cited by 19 · see citing works
Flagged first, then by citations
Research works printed but not linked: 6
- M. J. Hannafin, K. M. Hannafin, and D. W. Dalton, Feed- back and emerging instructional technologies, in Interac- tive Instruction and Feedback, edited by J. V. Demposey and G. C. Dales (Educational Technology, Englewood Cliffs, 1993), pp. 263-286.
- S. Narciss and K. Huth, How to design informative tutoring feedback for multimedia learning, in Instructional Design for Multimedia Learning, edited by H. M. Niegemann, D. Leutner, and R. Brunken (Waxman, Munster, NY, 2004), pp. 181-195.
- A. F. Heckler, B. Mikula, and R. Rosenblatt, Student accuracy in reading logarithmic plots: the problem and how to fix it, Proceedings of the 2013 IEEE Frontiers in Education Conference, pp. 1066-1071.
- B. D. Mikula and A. F. Heckler, The effectiveness of brief, spaced practice on student difficulties with basic and essential engineering skills, Proceedings of the 2013 IEEE Frontiers in Education Conference, pp. 1059-1065.
- B. D. Mikula and A. F. Heckler, Student difficulties with trigonometric vector components persist in multiple pop- ulations, Proceedings of the 2013 Physics Education Research Conference, Portland, OR, pp. 253-256.
- See Supplemental Material at http://link.aps.org/ supplemental/10.1103/PhysRevPhysEducRes.12.010134 for examples of training materials for vector essential skills and the DotCross vector assessment.
Cited by
Sorted by citations
Formative assessment and feedback for learning in higher education: A systematic review
Morris, R., Perry, T., & Wardle, L. (2021) · Review of Education · doi:10.1002/rev3.3292 · Cited by 358 · see citing works
Klein, P., Ivanjek, L., Dahlkemper, M. N., Jeličić, K., Geyer, M.-A., Küchemann, S., & Susac, A. (2021) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.17.010117 · Cited by 163 · see citing works
Mikula, B. D., & Heckler, A. F. (2017) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.13.010122 · Cited by 53 · see citing works
Self-citationMastery-style homework exercises in introductory physics courses: Implementation matters
Gutmann, B., Gladding, G. E., Lundsgaard, M., & Stelzer, T. J. (2018) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.14.010128 · Cited by 41 · see citing works
Omer, S. M. S., Evers, K., Wang, C.-Y., & Chen, S. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-05475-7 · Cited by 28 · see citing works
A systemic model of academic (mis)conduct to curb cheating in higher education
Allen, S. E., & Kizilcec, R. F. (2023) · Higher Education · doi:10.1007/s10734-023-01077-x · Cited by 18 · see citing works
Đorić, B. D., Lambić, D., & Jovanović, Ž. (2019) · Research in Science Education · doi:10.1007/s11165-019-9858-4 · Cited by 14 · see citing works
Lin, X. Y. (2025) · The Australian Educational Researcher · doi:10.1007/s13384-025-00856-y · Cited by 13 · see citing works
The Feedback Principle in Multimedia Learning
Johnson, C. I., & Marraffino, M. D. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108894333.042 · Cited by 11 · see citing works
Stephens, K., & Fox, A. (2018) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3197091.3197102 · Cited by 10 · see citing works
Schultze, T., Kumar, V. S., McKeown, G. J., O'Connor, P. A., Rychlowska, M., & Šparemblek, K. (2024) · doi:10.31234/osf.io/tvcag · Cited by 5 · see citing works
Holzmeyer, K., Lüneburg, L.-M., Oppici, L., Floessel, P., Lachmann, D., Krzywinski, J., & Narciss, S. (2025) · JMIR Formative Research · doi:10.2196/62903 · Cited by 4 · see citing works
Comparing Student Behavior in Mastery and Conventional Style Online Physics Homework
Guthrie, M. W., & Chen, Z. (2020) · Physics Education Research Conference (PERC) · doi:10.1119/perc.2019.pr.guthrie · Cited by 4 · see citing works
Principles Based on Generative Activity in Multimedia Learning
(2021) · Cambridge University Press eBooks · doi:10.1017/9781108894333.035 · Cited by 3 · see citing works
Hasanati, A., Supriana, E., & Mufti, N. (2021) · Jurnal Pendidikan Teori Penelitian dan Pengembangan · doi:10.17977/jptpp.v6i11.15112 · Cited by 2 · see citing works
Mobile Technologies for Teaching and Learning
Ramnath, R., & Kuriakose, A. (2019) · Springer eBooks · doi:10.1007/978-981-13-2766-7_35 · Cited by 2 · see citing works
Can the Effect of Automated Elaborated Feedback Be Increased with Affective Feedback?
Deni̇z, Y., & Bayrak, F. (2025) · Open Praxis · doi:10.55982/openpraxis.17.3.857 · Cited by 1 · see citing works
He, J., Li, T., Xu, Z., & Xie, K. (2025) · Future education and learning spaces · doi:10.1007/978-981-96-9251-4_11 · Cited by 1 · see citing works
Feedback complexities interact with prior knowledge
Töllner, F., Kuhl, P., & Besser, M. (2026) · Learning and Instruction · doi:10.1016/j.learninstruc.2026.102413 · Cited by 1 · see citing works
Mobile Technologies for Teaching and Learning
Ramnath, R., & Kuriakose, A. (2018) · Springer eBooks · doi:10.1007/978-3-642-41981-2_35-2 · Cited by 1 · see citing works
Stephens, K. (2017) · eScholarship (California Digital Library) · Cited by 1 · see citing works
Chen, Z., & Guthrie, M. W. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.08003 · Cited by 1 · see citing works
Assessing the Impact and Underlying Pathways of Sequenced AI feedback on Student Learning
Cao, J., Zhao, C. Q., Schunn, C., McLaughlin, E. A., Lin, J., & Koedinger, K. R. (2026) · arXiv · doi:10.48550/arxiv.2604.07469
Pebriana, I. N., Diyana, T. N., & Sutopo, S. (2021) · Jurnal Pendidikan Matematika dan Sains · doi:10.21831/jpms.v7i2.39720
Using the Test of Understanding of Vectors in an Algebra-Based Introductory Physics Course
Dubey, A., & Barniol, P. (2023) · World Engineering Education Forum - Global Engineering Deans Council (WEEF-GEDC) · doi:10.1109/weef-gedc59520.2023.10343624
Kontra, J. (2024) · doi:10.54597/mate.0120
Liu, Q., Prakash, H. M., & Heckler, A. F. (2025) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.21.010121
Self-citationDoes Student Learning Rate Depend on Feedback Type and Prior Knowledge?Preprint
Fleischer, H., Noglik, A., Borchers, C., & Schanze, S. (2025) · doi:10.31234/osf.io/an3bx_v1
Mulia, D., Fadhilah, & Irfan, D. (2025) · Jurnal Penelitian Pendidikan IPA · doi:10.29303/jppipa.v11i12.12929
Mirhanoğulları, B., & TUNAGÜR, M. (2026) · Ana Dili Eğitimi Dergisi · doi:10.16916/aded.1840936
Arhandi, P. P., Andoko, B. S., Nurmaya, Pinandito, A., & Hirashima, T. (2026) · Technology Knowledge and Learning · doi:10.1007/s10758-026-10042-3
- Authors
- Heckler, A. F., & Mikula, B. D.
- Affiliations
- The Ohio State University (US)
- ORCID
- Heckler, Andrew F.
- Venue
- Physical Review Physics Education Research
- Publisher
- American Physical Society (APS)
- Published
- 2016-06-09
- Volume
- 12
- Issue
- 1
- ISSN
- 2469-9896 (ISSN-L)
- OpenAlex
- W2414190984
- Cited by
- 32
- References
- 37
- Citations by year
- 2026: 4 · 2025: 8 · 2024: 4 · 2023: 2 · 2021: 5 · 2020: 1 · 2019: 3 · 2018: 3 · 2017: 2
- FWCI
- 2.20
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Physical Review Physics Education Research (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Science Foundation (DMR-1420451)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Social Sciences › Education › Mathematics Education and Teaching Techniques
- Keywords
- vector mathematics, feedback complexity, prior knowledge, physics learning, computer-assisted instruction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review