Knowledge Elicitation Methods for Affect Modelling in Education
The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
Research on the relationship between affect and cognition in Artificial Intelligence in Education (AIEd) brings an important dimension to our understanding of how learning occurs and how it can be facilitated. Emotions are crucial to learning, but their nature, the conditions under which they occur, and their exact impact on learning for different learners in diverse contexts still needs to be mapped out. The study of affect during learning can be challenging, because emotions are subjective, fleeting phenomena that are often difficult for learners to report accurately and for observers to perceive reliably. Context forms an integral part of learners' affect and the study thereof. This review provides a synthesis of the current knowledge elicitation methods that are used to aid the study of learners' affect and to inform the design of intelligent technologies for learning. Advantages and disadvantages of the specific methods are discussed along with their respective potential for enhancing research in this area, and issues related to the interpretation of data that emerges as the result of their use. References to related research are also provided together with illustrative examples of where the individual methods have been used in the past. Therefore, this review is intended as a resource for methodological decision making for those who want to study emotions and their antecedents in AIEd contexts, i.e. where the aim is to inform the design and implementation of an intelligent learning environment or to evaluate its use and educational efficacy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Core affect and the psychological construction of emotion.
Russell, J. A. (2003) · Psychological Review · doi:10.1037/0033-295x.110.1.145 · Cited by 6,113 · cited 1×
“…intermediate-length mood states (e.g., being downhearted because of bad weather), and transient emotions (e.g., frustration from being stuck), to rapid reflexive responses (e.g., startled) (Barrett, Mesquita, Ochsner, & Gross, 2007; Ekman, 1992; Izard, 2010; Rosenberg, 1998; Russell, 2003).”
BackgroundEricsson (1993) · doi:10.1037/0033-295x.87.3.215 · Cited by 4,539
What are emotions? And how can they be measured?
Scherer, K. R. (2005) · Social Science Information · doi:10.1177/0539018405058216 · Cited by 4,264 · cited 5×
“The Geneva Emotion Wheel arranges emotions in two-dimensional space and, by denoting the distance from the origin, it is able to represent the intensity of the associated feeling.”
BackgroundMethodInfluentialSensitive questions in surveys.
Tourangeau, R., & Yan, T. (2007) · Psychological Bulletin · doi:10.1037/0033-2909.133.5.859 · Cited by 3,057 · cited 2×
“Applying this method requires significant time commitment on the part of researchers and the reporters and therefore may not be feasible on a large scale, for example if the reporters are students who are about to complete a course.”
BackgroundMethodA Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.52 · Cited by 2,797
Affect Grid: A single-item scale of pleasure and arousal.
Russell, J. A., Weiss, A., & Mendelsohn, G. A. (1989) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.57.3.493 · Cited by 2,068
On the universality and cultural specificity of emotion recognition: a meta-analysis
Elfenbein, H. A., & Ambady, N. (2002) · Psychological Bulletin · doi:10.1037/0033-2909.128.2.203 · Cited by 2,049 · cited 2×
“The issues of logistics and procedure in this type of field observation are discussed in further detail in (Ocumpaugh et al., 2012).”
BackgroundAffect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications
Calvo, R. A., & D'Mello, S. (2010) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2010.1 · Cited by 1,893
Self-citationUniversals and cultural differences in the judgments of facial expressions of emotion.
Ekman, P., Friesen, W. V., O'Sullivan, M., Chan, A., Diacoyanni-Tarlatzis, I., Heider, K., Krause, R., LeCompte, W. A., Pitcairn, T., Ricci-Bitti, P. E., et al. (1987) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.53.4.712 · Cited by 1,763
Russell, J. A. (1994) · Psychological Bulletin · doi:10.1037/0033-2909.115.1.102 · Cited by 1,640 · cited 3×
“, anger, fear, sadness) are universal and are recognisable cross-culturally, there is also evidence that recognising affect in specific contexts is difficult across cultures, particularly among cultures with exposure to Western mass media (Elfenbein & Ambady, 2002; Russell, 1994).”
BackgroundBarrett, L. F., Mesquita, B., Ochsner, K. N., & Gross, J. J. (2007) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085709 · Cited by 1,425
Student engagement in high school classrooms from the perspective of flow theory
Shernoff, D. J., Csikszentmihalyi, M., Shneider, B., & Shernoff, E. S. (2003) · School Psychology Quarterly · doi:10.1521/scpq.18.2.158.21860 · Cited by 1,237 · cited 2×
“…too high nor too low, is necessary to enabling effective, long-term learning, a hypothesis seen in more recent theoretical accounts of cognition and emotion as well (Csikszentmihalyi, 1990; Shernoff et al., 2003; Barth and Funke, 2010; Clore and Huntsinger, 2007; Isen, 2008; Schwartz, in press).”
BackgroundThe Tie That Binds? Coherence Among Emotion Experience, Behavior, and Physiology.
Mauss, I. B., Levenson, R. W., McCarter, L., Wilhelm, F. H., & Gross, J. J. (2005) · Emotion · doi:10.1037/1528-3542.5.2.175 · Cited by 1,201
The world of emotions is not two-dimensional
Fontaine, J. R. J., Scherer, K. R., Roesch, E. B., & Ellsworth, P. C. (2007) · Psychological Science · doi:10.1111/j.1467-9280.2007.02024.x · Cited by 1,179
How emotions inform judgment and regulate thought
Clore, G. L., & Huntsinger, J. R. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.08.005 · Cited by 881
Toward an affect-sensitive multimodal human-computer interaction
Pantic, M., & Rothkrantz, L. J. M. (2003) · Proceedings of the IEEE · doi:10.1109/jproc.2003.817122 · Cited by 791
Affect and learning: An exploratory look into the role of affect in learning with AutoTutor
Craig, S., Graesser, A., Sullins, J., & Gholson, B. (2004) · Journal of Educational Media · doi:10.1080/1358165042000283101 · Cited by 630
Pantic, M., & Patras, I. (2006) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2005.859075 · Cited by 580
The many meanings/aspects of emotion: definitions, functions, activation, and regulation
Izard, C. E. (2010) · Emotion Review · doi:10.1177/1754073910374661 · Cited by 574 · cited 2×
“In contrast to affective traits and moods, emotions are brief, intense states that occupy the forefront of consciousness, have significant physiological and behavioural manifestations, and rapidly prepare the bodily systems for action (Ekman, 1992; Izard, 2010).”
BackgroundIvon, A., Cooper David, G., Winslow, B., Park, W. B., Kasia, M., & Robert, C. (2009) · Frontiers in Artificial Intelligence and Applications · doi:10.3233/978-1-60750-028-5-17 · Cited by 382 · cited 4×
“It is important to consider that all learners’ reports result in data that is subjective in nature and that may reflect their folk theories about what their affective states are or should be.”
BackgroundMethodInfluentialAffect-aware tutors: recognising and responding to student affect
Woolf, B., Burleson, W., Arroyo, I., Dragon, T., Cooper, D., & Picard, R. (2009) · International Journal of Learning Technology · doi:10.1504/ijlt.2009.028804 · Cited by 371
Empirically Building and Evaluating a Probabilistic Model of User Affect
Conati, C., & Maclaren, H. (2009) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-009-9062-8 · Cited by 328 · cited 4×
“It is important to consider that all learners’ reports result in data that is subjective in nature and that may reflect their folk theories about what their affective states are or should be.”
BackgroundMethodInfluentialSelf-citationMeta-Analysis of the First Facial Expression Recognition Challenge
Valstar, M. F., Mehu, M., Jiang, B., Pantic, M., & Scherer, K. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2012.2200675 · Cited by 297
Cited by
The Faces of Engagement: Automatic Recognition of Student Engagementfrom Facial Expressions
Whitehill, J., Serpell, Z., Lin, Y.-C., Foster, A., & Movellan, J. R. (2014) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2014.2316163 · Cited by 677
Advanced, Analytic, Automated (AAA) Measurement of Engagement During Learning
D'Mello, S., Dieterle, E., & Duckworth, A. (2017) · Educational Psychologist · doi:10.1080/00461520.2017.1281747 · Cited by 350
Self-citationEngagement detection in online learning: a review
Dewan, M. A. A., Murshed, M., & Lin, F. (2019) · Smart Learning Environments · doi:10.1186/s40561-018-0080-z · Cited by 350
Automatic Detection of Learning-Centered Affective States in the Wild
Bosch, N., D'Mello, S., Baker, R., Ocumpaugh, J., Shute, V., Ventura, M., Wang, L., & Zhao, W. (2015) · Proceedings of the 20th International Conference on Intelligent User Interfaces · doi:10.1145/2678025.2701397 · Cited by 178
“It should be noted that there are many possible affect annotation schemes, each with their strengths and weaknesses, as recently reviewed in [36].”
BackgroundSelf-citationUna revisión sistemática del uso de la inteligencia artificial en la educación
Bolaño-García, M., & Duarte-Acosta, N. (2023) · Revista Colombiana de Cirugía · doi:10.30944/20117582.2365 · Cited by 99
Metadata
- Authors
- Porayska-Pomsta, K., Mavrikis, M., D'Mello, S., Conati, C., & Baker, R. S. J. D.
- Venue
- International Journal of Artificial Intelligence in Education
- Publisher
- IOS Press
- Published
- 2013-08
- Volume
- 22
- Issue
- 3
- Pages
- 107-140
- ISSN
- 1560-4292 (ISSN-L)
- 1560-4306
- OpenAlex
- W1691662474
- Cited by
- 75
- References
- 23
- FWCI
- 13.99
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.