Monitoring Affect States During Effortful Problem Solving Activities
The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
We explored the affective states that students experienced during effortful problem solving activities. We conducted a study where 41 students solved difficult analytical reasoning problems from the Law School Admission Test. Students viewed videos of their faces and screen captures and judged their emotions from a set of 14 states (basic emotions, learning-centered emotions, and neutral) at relevant points in the problem solving process (after new problem is displayed, in the midst of problem solving, after feedback is received). The results indicated that curiosity, frustration, boredom, confusion, happiness, and anxiety were the major emotions that students experienced, while contempt, anger, sadness, fear, disgust, eureka, and surprise were rare. Follow-up analyses on the temporal dynamics of the emotions, their contextual underpinnings, and relationships to problem solving outcomes supported a general characterization of the affective dimension of problem solving. Affective states differ in: (a) their probability of occurrence as regular, routine, or sporadic emotions, (b) their temporal dynamics as persistent or random emotions, (c) their characterizations as product or process related emotions, and (d) whether they were positively or negatively related to problem solving outcomes. A synthesis of our major findings, limitations, resolutions, and implications for affect-sensitive artificial learning environments are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An argument for basic emotions
Ekman, P. (1992) · Cognition and Emotion · doi:10.1080/02699939208411068 · Cited by 9,646
Assessment and Classroom Learning
Black, P., & Wiliam, D. (1998) · Assessment in Education: Principles, Policy & Practice · doi:10.1080/0969595980050102 · Cited by 8,152 · cited 1×
“Feedback is critical in both human and computer tutoring because it is directive (i.e., tells students what needs to be fixed), facilitative (i.e., helps students conceptualize information), ad has motivational functions (Black & William, 1998; Lepper & Woolverton, 2002; Shute, 2008).”
BackgroundCore affect and the psychological construction of emotion.
Russell, J. A. (2003) · Psychological Review · doi:10.1037/0033-295x.110.1.145 · Cited by 6,113 · cited 8×
“A two dimensional valence-arousal affect model (Barrett, 2006; Russell, 2003) does serve as a useful framework to understand the impact of affective states on problem solving activities.”
BackgroundInfluentialShute, V. J. (2008) · Review of Educational Research · doi:10.3102/0034654307313795 · Cited by 4,631
Enhancing teaching through constructive alignment
Biggs, J. (1996) · Higher Education · doi:10.1007/bf00138871 · Cited by 4,084
Positive affect facilitates creative problem solving.
Isen, A. M., Daubman, K. A., & Nowicki, G. P. (1987) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.52.6.1122 · Cited by 2,986
A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.52 · Cited by 2,797
Affect Grid: A single-item scale of pleasure and arousal.
Russell, J. A., Weiss, A., & Mendelsohn, G. A. (1989) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.57.3.493 · Cited by 2,068
Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications
Calvo, R. A., & D'Mello, S. (2010) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2010.1 · Cited by 1,893 · cited 3×
“…rely on physiological and bodily cues to detect emotions (Arroyo et al., 2009; Castellano, Kessous, & Caridakis, 2008; D'Mello & Graesser, 2010b), the link between affective experience and expression is diffuse, fuzzy, murky, and possibly indeterminate (Calvo & D’Mello, 2010; Russell et al., 2003).”
BackgroundSelf-citationBarrett, L. F. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00003.x · Cited by 1,859 · cited 2×
“A two dimensional valence-arousal affect model (Barrett, 2006; Russell, 2003) does serve as a useful framework to understand the impact of affectiv states on problem solving activities.”
BackgroundThe instructional effect of feedback in test-like events.
Bangert-Drowns, R. L., Kulik, C.-L. C., Kulik, J. A., & Morgan, M. (1991) · Review of Educational Research · doi:10.3102/00346543061002213 · Cited by 1,313
The world of emotions is not two-dimensional
Fontaine, J. R. J., Scherer, K. R., Roesch, E. B., & Ellsworth, P. C. (2007) · Psychological Science · doi:10.1111/j.1467-9280.2007.02024.x · Cited by 1,179
Basic Emotions, Natural Kinds, Emotion Schemas, and a New Paradigm
Izard, C. E. (2007) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2007.00044.x · Cited by 1,110
Baker, R. S. J. D., D'Mello, S. K., Rodrigo, M. M. T., & Graesser, A. C. (2010) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2009.12.003 · Cited by 936
Self-citationAleven, V. A. W. M. M., & Koedinger, K. R. (2002) · Cognitive Science · doi:10.1207/s15516709cog2602_1 · Cited by 895
How emotions inform judgment and regulate thought
Clore, G. L., & Huntsinger, J. R. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.08.005 · Cited by 881
Facial and vocal expressions of emotion
Russell, J. A., Bachorowski, J.-A., & Fernández-Dols, J.-M. (2003) · Annual Review of Psychology · doi:10.1146/annurev.psych.54.101601.145102 · Cited by 873
Chi, M. T. H., Siler, S. A., Jeong, H., Yamauchi, T., & Hausmann, R. G. (2001) · Cognitive Science · doi:10.1207/s15516709cog2504_1 · Cited by 855
Metacognition and affect: What can metacognitive experiences tell us about the learning process?
Efklides, A. (2006) · Educational Research Review · doi:10.1016/j.edurev.2005.11.001 · Cited by 724 · cited 2×
“…processes such as planning, re-planning, and monitoring continually operate throughout the problem solving process (Anderson, Douglass, & Qin, 2005; Brown, 1987; Chi, Siler, Jeong, Yamauchi, & Hausmann, 2001; Cromley, Azevedo, & Olson, 2005; Efklides, 2006; Jonassen, Peck, & Wilson, 1999).”
Interest, Prior Knowledge, and Learning
Tobias, S. (1994) · Review of Educational Research · doi:10.3102/00346543064001037 · Cited by 713 · cited 1×
“The fact that curiosity is related to interest (Berlyne, 1960, 1978; Deci, 1992; Izard & Ackerman, 2000; Tobias, 1994), is one possible explanation why curiosity was positively linked to performance.”
BackgroundAffect and learning: An exploratory look into the role of affect in learning with AutoTutor
Craig, S., Graesser, A., Sullins, J., & Gholson, B. (2004) · Journal of Educational Media · doi:10.1080/1358165042000283101 · Cited by 630
Re-conceptualizing Emotion and Motivation to Learn in Classroom Contexts
Meyer, D. K., & Turner, J. C. (2006) · Educational Psychology Review · doi:10.1007/s10648-006-9032-1 · Cited by 479
Ivon, A., Cooper David, G., Winslow, B., Park, W. B., Kasia, M., & Robert, C. (2009) · Frontiers in Artificial Intelligence and Applications · doi:10.3233/978-1-60750-028-5-17 · Cited by 382 · cited 20×
“This pattern of boredom is consistent with previous research that tracked boredom during tutorial sessions with ITSs (Baker et al., 2010; D’Mello & Graesser, in pressb).”
BackgroundInfluentialEmpirically Building and Evaluating a Probabilistic Model of User Affect
Conati, C., & Maclaren, H. (2009) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-009-9062-8 · Cited by 328 · cited 2×
“Since context plays a major role in shaping emotional experiences, it is important to couple bottom-up diagnostic assessments of affective reactions (i.e., face, speech, posture) with top-down contextually-driven predictive assessments (Conati & Maclaren, 2009).”
BackgroundD’Mello, S. K., & Graesser, A. (2010) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-010-9074-4 · Cited by 323
Self-citationA Meta-Analysis of the Effects of Feedback in Computer-Based Instruction
Azevedo, R., & Bernard, R. M. (1995) · Journal of Educational Computing Research · doi:10.2190/9lmd-3u28-3a0g-ftqt · Cited by 308
Lepper, M. R., & Woolverton, M. (2002) · Improving Academic Achievement · doi:10.1016/b978-012064455-1/50010-5 · Cited by 180 · cited 2×
“Feedback is critical in both human and computer tutoring because it is directive (i.e., tells students what needs to be fixed), facilitative (i.e., helps students conceptualize information), ad has motivational functions (Black & William, 1998; Lepper & Woolverton, 2002; Shute, 2008).”
Background
Cited by
Activity Achievement Emotions and Academic Performance: A Meta-analysis
Camacho-Morles, J., Slemp, G. R., Pekrun, R., Loderer, K., Hou, H., & Oades, L. G. (2021) · Educational Psychology Review · doi:10.1007/s10648-020-09585-3 · Cited by 475
Learner Engagement in Blended Learning Environments: A Conceptual Framework
Halverson, L. R., & Graham, C. R. (2019) · Online Learning · doi:10.24059/olj.v23i2.1481 · Cited by 437
Educational Data Mining and Learning Analytics: Applications to Constructionist Research
Berland, M., Baker, R. S., & Blikstein, P. (2014) · Technology, Knowledge and Learning · doi:10.1007/s10758-014-9223-7 · Cited by 257
Harley, J. M., Poitras, E. G., Jarrell, A., Duffy, M. C., & Lajoie, S. P. (2016) · Educational Technology Research and Development · doi:10.1007/s11423-015-9420-7 · Cited by 174
“Both coders drew upon their expertise on emotions, including the wording of questionnaires (e.g., AEQ) and definitions of emotions (Harley 2015; Harley et al. 2015a, in press; D’Mello et al. 2010; Pekrun and Perry 2014).”
BackgroundHutt, S., Krasich, K., R. Brockmole, J., & K. D'Mello, S. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445269 · Cited by 60
“It was modeled after interactions with expert human tutors [7, 15, 16, 53] and has been shown to be as efective at promoting learning compared to small group tutoring with novice human tutors [51].”
Background
Metadata
- Authors
- D'Mello, S. K., Lehman, B., & Person, N.
- Venue
- International Journal of Artificial Intelligence in Education
- Publisher
- IOS Press
- Published
- 2010-11
- Volume
- 20
- Issue
- 4
- Pages
- 361-389
- ISSN
- 1560-4292 (ISSN-L)
- 1560-4306
- OpenAlex
- W1685250317
- Cited by
- 98
- References
- 27
- FWCI
- 7.48
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.