The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
Understanding Difficulties and Resulting Confusion in Learning: An Integrative Review
Open accessAbstract
Difficulties are often an unavoidable but important part of the learning process. This seems particularly so for complex conceptual learning. Challenges in the learning process are, however, particularly difficult to detect and respond to in educational environments where growing class sizes and the increased use of digital technologies mean that teachers are unable to provide nuanced and personalised feedback and support to help students overcome their difficulties. Individual differences, the specifics of the learning activity, and the difficulty of giving individual feedback in large classes and digital environments all add to the challenge of responding to student difficulties and confusion. In this integrative review, we aim to explore difficulties and resulting emotional responses in learning. We will review the primary principles of cognitive disequilibrium and contrast these principles with work on desirable difficulties, productive failure, impasse driven learning and pure discovery-based learning. We conclude with a theoretical model of the zones of optimal and sub-optimal confusion as a way of conceptualising the parameters of productive and non-productive difficulties experienced by students while they learn.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An argument for basic emotions
Ekman, P. (1992) · Cognition and Emotion · doi:10.1080/02699939208411068 · Cited by 9,646
Picard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
Motivational processes affecting learning.
Dweck, C. S. (1986) · American Psychologist · doi:10.1037/0003-066x.41.10.1040 · Cited by 6,971
Cognitive, social, and physiological determinants of emotional state.
Schachter, S., & Singer, J. (1962) · Psychological Review · doi:10.1037/h0046234 · Cited by 6,223
Positive affect facilitates creative problem solving.
Isen, A. M., Daubman, K. A., & Nowicki, G. P. (1987) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.52.6.1122 · Cited by 2,986
The Nature, Effects, and Relief of Mathematics Anxiety
Hembree, R. (1990) · Journal for Research in Mathematics Education · doi:10.2307/749455 · Cited by 1,979
Part I: Cognitive development in children: Piaget development and learning
Piaget, J. (1964) · Journal of Research in Science Teaching · doi:10.1002/tea.3660020306 · Cited by 1,802 · cited 1×
“The notion of cognitive disequilibrium is derived from Piaget’s work on cognitive development (Piaget, 1964).”
Method(2006) · In Search of Pedagogy Volume I · doi:10.4324/9780203088609-13 · Cited by 1,450
Does discovery-based instruction enhance learning?
Alfieri, L., Brooks, P. J., Aldrich, N. J., & Tenenbaum, H. R. (2011) · Journal of Educational Psychology · doi:10.1037/a0021017 · Cited by 1,338
Dynamics of affective states during complex learning
D’Mello, S., & Graesser, A. (2012) · Learning and Instruction · doi:10.1016/j.learninstruc.2011.10.001 · Cited by 1,087
Kapur, M. (2008) · Cognition and Instruction · doi:10.1080/07370000802212669 · Cited by 867
Overcoming intuition: Metacognitive difficulty activates analytic reasoning.
Alter, A. L., Oppenheimer, D. M., Epley, N., & Eyre, R. N. (2007) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.136.4.569 · Cited by 844
Confusion can be beneficial for learning
D’Mello, S., Lehman, B., Pekrun, R., & Graesser, A. (2014) · Learning and Instruction · doi:10.1016/j.learninstruc.2012.05.003 · Cited by 777
Foundations of problem‐based learning: some explanatory notes
SCHMIDT, H. G. (1993) · Medical Education · doi:10.1111/j.1365-2923.1993.tb00296.x · Cited by 760
Kort, B., Reilly, R., & Picard, R. W. (2002) · Proceedings IEEE International Conference on Advanced Learning Technologies · doi:10.1109/icalt.2001.943850 · Cited by 742
Toward constructivism for adult learners in online learning environments
Huang, H. (2002) · British Journal of Educational Technology · doi:10.1111/1467-8535.00236 · Cited by 694
Designing for Productive Failure
Kapur, M., & Bielaczyc, K. (2012) · Journal of the Learning Sciences · doi:10.1080/10508406.2011.591717 · Cited by 674 · cited 1×
“Despite the different kinds of tasks used, there are clear parallels between the “failure” aspect of productive failure, and the “difficulties” encountered by students within a desirable difficulty paradigm (Kapur and Bielaczyc, 2012).”
BackgroundMoreno, R. (2004) · Instructional Science · doi:10.1023/b:truc.0000021811.66966.1d · Cited by 615
Brain mechanisms of emotion and emotional learning
LeDoux, J. E. (1992) · Current Opinion in Neurobiology · doi:10.1016/0959-4388(92)90011-9 · Cited by 595
Psychology and the real world: Essays illustrating fundamental contributions to society.
Gernsbacher, M. A., Pew, R. W., Hough, L. M., & Pomerantz, J. R. (2011) · Cited by 460
Productive Failure in Learning Math
Kapur, M. (2014) · Cognitive Science · doi:10.1111/cogs.12107 · Cited by 453 · cited 1×
“Kapur (2014) tested groups of students who were given an opportunity to solve mathematics problems either before or after being given explicit instruction on the procedure associated with how to solve the problems.”
BackgroundWhy Do Only Some Events Cause Learning During Human Tutoring?
VanLehn, K., Siler, S., Murray, C., Yamauchi, T., & Baggett, W. B. (2003) · Cognition and Instruction · doi:10.1207/s1532690xci2103_01 · Cited by 443
Stupid tutoring systems, intelligent humans
Baker, R. S. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-016-0105-0 · Cited by 425
Affect-aware tutors: recognising and responding to student affect
Woolf, B., Burleson, W., Arroyo, I., Dragon, T., Cooper, D., & Picard, R. (2009) · International Journal of Learning Technology · doi:10.1504/ijlt.2009.028804 · Cited by 371
Fortune favors the ( ): Effects of disfluency on educational outcomes
Diemand-Yauman, C., Oppenheimer, D. M., & Vaughan, E. B. (2011) · Cognition · doi:10.1016/j.cognition.2010.09.012 · Cited by 321
Successful Remembering and Successful Forgetting : A Festschrift in Honor of Robert A. Bjork
Benjamin, A. S. (2011) · Cited by 277
Confusion and interest: The role of knowledge emotions in aesthetic experience.
Silvia, P. J. (2010) · Psychology of Aesthetics, Creativity, and the Arts · doi:10.1037/a0017081 · Cited by 270
A Review of the Use of Simulation in Dental Education
Perry, S., Bridges, S. M., & Burrow, M. F. (2015) · Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare · doi:10.1097/sih.0000000000000059 · Cited by 269
Students' Positive and Negative Experiences in Hybrid and Online Classes
Mansour, B. E., & Mupinga, D. M. (2007) · College student journal · Cited by 258
Deep Learning: How the Mind Overrides Experience
Ohlsson, S. (2011) · Cambridge University Press eBooks · doi:10.1017/cbo9780511780295 · Cited by 235
Progress and open problems in educational emotion research
Pekrun, R. (2005) · Learning and Instruction · doi:10.1016/j.learninstruc.2005.07.014 · Cited by 233
Toward a Theory of Impasse-Driven Learning
VanLehn, K. (1988) · Learning Issues for Intelligent Tutoring Systems · doi:10.1007/978-1-4684-6350-7_2 · Cited by 205
Mainhard, T., Oudman, S., Hornstra, L., Bosker, R. J., & Goetz, T. (2018) · Learning and Instruction · doi:10.1016/j.learninstruc.2017.07.011 · Cited by 198
The half-life of cognitive-affective states during complex learning
D'Mello, S., & Graesser, A. (2011) · Cognition and Emotion · doi:10.1080/02699931.2011.613668 · Cited by 195
Lepper, M. R., & Woolverton, M. (2002) · Improving Academic Achievement · doi:10.1016/b978-012064455-1/50010-5 · Cited by 180
Yue, C. L., Castel, A. D., & Bjork, R. A. (2013) · Memory & Cognition · doi:10.3758/s13421-012-0255-8 · Cited by 171
Origin, direction and impact of emotions in social online learning
Wosnitza, M., & Volet, S. (2005) · Learning and Instruction · doi:10.1016/j.learninstruc.2005.07.009 · Cited by 163
Confusion and complex learning during interactions with computer learning environments
Lehman, B., D'Mello, S., & Graesser, A. (2012) · The Internet and Higher Education · doi:10.1016/j.iheduc.2012.01.002 · Cited by 160
Graesser, A. C., Lu, S., Olde, B. A., Cooper, E., & Whitten, S. N. (2005) · Memory & Cognition · doi:10.3758/bf03193225 · Cited by 160
Harris, K. R., & American Psychological Association (2011) · American Psychological Association eBooks · doi:10.1037/13274-000 · Cited by 154
Saying the wrong thing: improving learning with multimedia by including misconceptions
Muller, D. A., Bewes, J., Sharma, M. D., & Reimann, P. (2008) · Journal of Computer Assisted Learning · doi:10.1111/j.1365-2729.2007.00248.x · Cited by 145
Emotions During the Learning of Difficult Material
Graesser, A. C., & D’Mello, S. K. (2012) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/b978-0-12-394293-7.00005-4 · Cited by 142
Learning from productive failure
Kapur, M. (2015) · Learning Research and Practice · doi:10.1080/23735082.2015.1002195 · Cited by 142
Memory and metamemory for inverted words: Illusions of competency and desirable difficulties
Sungkhasettee, V. W., Friedman, M. C., & Castel, A. D. (2011) · Psychonomic Bulletin & Review · doi:10.3758/s13423-011-0114-9 · Cited by 131
Ohlsson, S. (2011) · Cited by 120
Ohlsson, S. (2011) · Cited by 120
What Are You Feeling? Investigating Student Affective States During Expert Human Tutoring Sessions
Lehman, B. A., Matthews, M., D’Mello, S. K., & Person, N. K. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-69132-7_10 · Cited by 108
Impasse-driven learning in the context of video games
Blumberg, F. C., Rosenthal, S. F., & Randall, J. D. (2007) · Computers in Human Behavior · doi:10.1016/j.chb.2007.05.010 · Cited by 104
Inside Out: Detecting Learners’ Confusion to Improve Interactive Digital Learning Environments
Arguel, A., Lockyer, L., Lipp, O. V., Lodge, J. M., & Kennedy, G. E. (2016) · Journal of Educational Computing Research · doi:10.1177/0735633116674732 · Cited by 103
Self-citationExploring the Relationship between Novice Programmer Confusion and Achievement
Lee, D. M. C., Rodrigo, M. M. T., Baker, R. S., Sugay, J. O., & Coronel, A. D. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-24600-5_21 · Cited by 93
Productive failure in learning from generation and invention activities
Kapur, M., & Rummel, N. (2012) · Instructional Science · doi:10.1007/s11251-012-9235-4 · Cited by 87
Raising cognitive load with linear multimedia to promote conceptual change
Muller, D. A., Sharma, M. D., & Reimann, P. (2008) · Science Education · doi:10.1002/sce.20244 · Cited by 86
Fortune is fickle: null-effects of disfluency on learning outcomes
Rummer, R., Schweppe, J., & Schwede, A. (2015) · Metacognition and Learning · doi:10.1007/s11409-015-9151-5 · Cited by 69
Learning, thinking, and emoting with discourse technologies.
Graesser, A. C. (2011) · American Psychologist · doi:10.1037/a0024974 · Cited by 68
Chen, Y. L., Pan, P. R., Sung, Y., & Chang, K.-E. (2013) · Educational Technology & Society · Cited by 58
Cognitive Load and Alternative Conceptions in Learning Genetics: Effects from Provoking Confusion
Poehnl, S., & Bogner, F. X. (2013) · The Journal of Educational Research · doi:10.1080/00220671.2012.687790 · Cited by 20
Who Benefits from Confusion Induction during Learning? An Individual Differences Cluster Analysis
Lehman, B. A., D’Mello, S. K., & Graesser, A. C. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39112-5_6 · Cited by 15
Grawemeyer, B., Mavrikis, M., Holmes, W., Hansen, A., Loibl, K., & Gutiérrez-Santos, S. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-19773-9_70 · Cited by 15
Chapter 5: Nonverbal Communication in Teaching
Woolfolk, A., & Brooks, D. M. (1983) · Review of Research in Education · doi:10.3102/0091732x010001103 · Cited by 14
Erroneous Examples as Desirable Difficulty
Adams, D. M., McLaren, B. M., Mayer, R. E., George Goguadze, A., & Isotani, S. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39112-5_117 · Cited by 13
Understanding, assessing and enhancing student evaluative judgement in digital environments
Lodge, J. M., Kennedy, G. E., & Hattie, J. (2018) · Routledge eBooks · doi:10.4324/9781315109251-8 · Cited by 13
Self-citationUnpacking the hidden efficacies of learning in productive failure
Hung, D. W. L., Chen, V., & Lim, S. H. (2009) · Learning Inquiry · doi:10.1007/s11519-008-0037-1 · Cited by 11
An Exploratory Analysis of Confusion Among Students Using Newton’s Playground
Andres, J. M. L., Rodrigo, M. M. T., Sugay, J. O., Baker, R. S., Paquette, L., Shute, V. J., Ventura, M., & Small, M. (2014) · International Conference on Computers in Education · doi:10.58459/icce.2014.346 · Cited by 10
Cited by
Mangaroska, K., Sharma, K., Gašević, D., & Giannakos, M. (2022) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12590 · Cited by 100
Continuous Evaluation of Video Lectures from Real-Time Difficulty Self-Report
Srivastava, N., Velloso, E., Lodge, J. M., Erfani, S., & Bailey, J. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300816 · Cited by 24
Self-citationNew Methods for Confusion Detection in Course Forums: Student, Teacher, and Machine
Geller, S. A., Gal, K., Segal, A., Sripathi, K., Kim, H. G., Facciotti, M. T., Igo, M., Hoernle, N., & Karger, D. (2021) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2021.3123266 · Cited by 9
Metadata
- Authors
- Lodge, J. M., Kennedy, G., Lockyer, L., Arguel, A., & Pachman, M.
- Venue
- Frontiers in Education
- Publisher
- Frontiers Media SA
- Published
- 2018-06-28
- Volume
- 3
- ISSN
- 2504-284X (ISSN-L)
- OpenAlex
- W2807738726
- Cited by
- 286
- References
- 63
- FWCI
- 13.27
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.