Developing Emotion-Aware, Advanced Learning Technologies: A Taxonomy of Approaches and Features
Open accessThe DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
A growing body of work on intelligent tutoring systems, affective computing, and artificial intelligence in education is exploring creative, technology-driven approaches to enhance learners’ experience of adaptive, positively-valenced emotions while interacting with advanced learning technologies. Despite this, there has been no published work to date that captures this topic’s breadth. We took up this grand challenge by integrating related empirical studies and existing conceptual work and proposing a theoretically-guided taxonomy for the development and improvement of emotion-aware systems. In particular, multiple strategies system developers may use to help learners experience positive emotions are mapped out, including those that require different amounts and types of information about the user, as well as when this information is required. Examples from the literature are provided to illustrate how different emotion-aware system approaches can be combined to take advantage of different types of data, both prior to and during the learner-system interaction. High-level system features that emotion-aware systems can tailor to learners in order to elicit positive emotions are also described and exemplified. Theoretically, the taxonomy is primarily informed by the control-value theory of achievement emotions (Pekrun 2006 , 2011 ) and its assumptions about the relationship between distal and proximal antecedents and the elicitation and regulation of emotion. The taxonomy expands upon a dichotomy of emotion-aware systems proposed by D’Mello and Graesser ( 2015 ) and is intended to guide the design of emotion-aware systems that can foster positive emotions during learner-system interactions through the use of varied approaches, data sources, and design features.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
School Engagement: Potential of the Concept, State of the Evidence
Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004) · Review of Educational Research · doi:10.3102/00346543074001059 · Cited by 12,581 · cited 1×
“It is best viewed as a metaconstruct consisting of several components: cognitive, behavioral, motivational, cognitive-behavioral, and socialbehavioral (Fredricks et al. 2004; Pekrun & Linnenbrink-Garcia, 2012; see also Azevedo 2015).”
BackgroundGross, J. J., & John, O. P. (2003) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.85.2.348 · Cited by 11,929 · cited 2×
“, modifying appraisals; Pekrun and Perry 2014), and reappraisal in particular (Butler et al. 2003; Gross 1998; Gross and John 2003; Leroy et al. 2012; McCrae et al. 2012).”
BackgroundPekrun, R. (2006) · Educational Psychology Review · doi:10.1007/s10648-006-9029-9 · Cited by 5,566 · cited 14×
“…illustrate additional opportunities for, and sources of, emotions that can arise and must be regulated in relation to the academic environment as well as , achievement-oriented modifications to the environment, appraisals, and the experience of an emotion (Pekrun 2006; 2011; Pekrun and Perry 2014).”
BackgroundMethodResultInfluentialThe Role of Goal Orientation in Self-Regulated Learning
Pintrich, P. R. (2000) · Handbook of Self-Regulation · doi:10.1016/b978-012109890-2/50043-3 · Cited by 5,173 · cited 2×
“, algebra) by (1) setting sub goals, (2) using learning strategies, (3) monitoring and regulating certain aspects of cognition, behavior, emotions, and motivation, and (4) modifying behavior to achieve one’s goals (Azevedo et al. 2013; Boekaerts et al. 2000 ; Pintrich 2000; Zimmerman and Schunk 2001).”
BackgroundSweller, J. (2011) · Psychology of Learning and Motivation · doi:10.1016/b978-0-12-387691-1.00002-8 · Cited by 4,856
Gross, J. J. (1998) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.74.1.224 · Cited by 4,671 · cited 2×
“, modifying appraisals; Pekrun and Perry 2014), and reappraisal in particular (Butler et al. 2003; Gross 1998; Gross and John 2003; Leroy et al. 2012; McCrae et al. 2012).”
BackgroundAffect Grid: A single-item scale of pleasure and arousal.
Russell, J. A., Weiss, A., & Mendelsohn, G. A. (1989) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.57.3.493 · Cited by 2,068
Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications
Calvo, R. A., & D'Mello, S. (2010) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2010.1 · Cited by 1,893
Hiding feelings: The acute effects of inhibiting negative and positive emotion
Gross, J. J., & Levenson, R. W. (1997) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.106.1.95 · Cited by 1,834 · cited 1×
“…or ignore their emotion, although these tend to be ineffective, heighten arousal, and are detrimental to learning and social interactions, the latter having negative implications for social emotions (Butler et al. 2003; Chauncey-Strain and D’Mello 2015; Gross 2015; Gross and Levenson 1993, 1997).”
BackgroundThe social consequences of expressive suppression
Butler, E. A., Egloff, B., Wlhelm, F. H., Smith, N. C., Erickson, E. A., & Gross, J. J. (2003) · Emotion · doi:10.1037/1528-3542.3.1.48 · Cited by 1,400
Self-Regulated Learning and Academic Achievement
(2013) · doi:10.4324/9781410601032 · Cited by 1,325
Emotional suppression: Physiology, self-report, and expressive behavior.
Gross, J. J., & Levenson, R. W. (1993) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.64.6.970 · Cited by 1,262
Academic Emotions and Student Engagement
Pekrun, R., & Linnenbrink-Garcia, L. (2012) · Handbook of Research on Student Engagement · doi:10.1007/978-1-4614-2018-7_12 · Cited by 1,181
Baker, R. S. J. D., D'Mello, S. K., Rodrigo, M. M. T., & Graesser, A. C. (2010) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2009.12.003 · Cited by 936
Emotion regulation: taking stock and moving forward
Gross, J. J. (2013) · Emotion · doi:10.1037/a0032135 · Cited by 864 · cited 2×
“Other emotion-aware ALT strategy distinctions have included value-, context-, and control-oriented strategies (Arroyo et al. 2014), as well as experimentation with emotion regulation strategies outlined in Gross’ (2013, 2015) emotion regulation model (D’Mello et al. 2014b).”
BackgroundEmotion generation and emotion regulation: One or two depends on your point of view
Gross, J. J., & Feldman Barrett, L. (2011) · Emotion Review · doi:10.1177/1754073910380974 · Cited by 863 · cited 1×
“This goal was a different, albeit no less challenging one, than creating a comprehensive review of theories of emotion or emotion-intervention studies (see Quoidbach et al. 2015; Gross and Barret 2011).”
BackgroundHow seductive details do their damage: A theory of cognitive interest in science learning.
Harp, S. F., & Mayer, R. E. (1998) · Journal of Educational Psychology · doi:10.1037/0022-0663.90.3.414 · Cited by 855
The Development of Expertise: The Journey From Acclimation to Proficiency
Alexander, P. A. (2003) · Educational Researcher · doi:10.3102/0013189x032008010 · Cited by 700 · cited 2×
“Trait information, such as personality type and motivational tendencies, tend to be better aligned with proactive adaptive system features because they tend to be stable and unlikely to change, in contrast to emotions and students’ understanding of learning material that tend to be more variable over time (Alexander 2…”
BackgroundAffect and learning: An exploratory look into the role of affect in learning with AutoTutor
Craig, S., Graesser, A., Sullins, J., & Gholson, B. (2004) · Journal of Educational Media · doi:10.1080/1358165042000283101 · Cited by 630 · cited 1×
“While confusion is typically regarded as a negative, activating emotion in an achievement context and hypothesized to be associated with negative learning outcomes, it can also lead to deeper and better learning (Craig et al. 2004; D’Mello et al. 2014b).”
BackgroundPositive interventions: An emotion regulation perspective.
Quoidbach, J., Mikolajczak, M., & Gross, J. J. (2015) · Psychological Bulletin · doi:10.1037/a0038648 · Cited by 546 · cited 1×
“This goal was a different, albeit no less challenging one, than creating a comprehensive review of theories of emotion or emotion-intervention studies (see Quoidbach et al. 2015; Gross and Barret 2011).”
BackgroundAzevedo, R. (2015) · Educational Psychologist · doi:10.1080/00461520.2015.1004069 · Cited by 418 · cited 2×
“It is best viewed as a metaconstruct consisting of several components: cognitive, behavioral, motivational, cognitive-behavioral, and socialbehavioral (Fredricks et al. 2004; Pekrun & Linnenbrink-Garcia, 2012; see also Azevedo 2015).”
BackgroundRowe, J. P., & Lester, J. C. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-19773-9_42 · Cited by 48 · cited 4×
“ALT is a broad term that includes a variety of sophisticated learning environments such as intelligent tutoring systems (AutoTutor: Graesser & D’Mello, 2013; Wayang Outpost: Woolf et al., 2009), multi-agent systems (MetaTutor: Azevedo et al. 2013; Betty’s Brain: Segedy et al. 2013), serious games (Crystal Island: Sabo…”
BackgroundInfluential
Cited by
Schiff, D. (2022) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-021-00270-2 · Cited by 489
“…from the fact that intelligent tutoring systems and learning robots are increasingly incorporating the capacity to detect and respond to human emotions, such as through text, audio, individual avatars or agents (Dennis et al. 2016; Graesser et al. 2014; Harley et al. 2017; Woolf et al. 2010).”
BackgroundBernacki, M. L., Greene, M. J., & Lobczowski, N. G. (2021) · Educational Psychology Review · doi:10.1007/s10648-021-09615-8 · Cited by 455
Out of the laboratory and into the classroom: the future of artificial intelligence in education
Schiff, D. (2021) · AI & SOCIETY · doi:10.1007/s00146-020-01033-8 · Cited by 334
Emotion Regulation in Achievement Situations: An Integrated Model
Harley, J. M., Pekrun, R., Taxer, J. L., & Gross, J. J. (2019) · Educational Psychologist · doi:10.1080/00461520.2019.1587297 · Cited by 309
Self-citationA Conceptual Framework for Human–AI Hybrid Adaptivity in Education
Holstein, K., Aleven, V., & Rummel, N. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-52237-7_20 · Cited by 168
Metadata
- Authors
- Harley, J. M., Lajoie, S. P., Frasson, C., & Hall, N. C.
- Venue
- International Journal of Artificial Intelligence in Education
- Published
- 2016-12-01
- Volume
- 27
- Issue
- 2
- Pages
- 268-297
- ISSN
- 1560-4292 (ISSN-L)
- 1560-4306
- OpenAlex
- W2558428663
- Cited by
- 90
- References
- 22
- FWCI
- 6.64
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.