The DOI matches its Crossref record; 137 of the 137 references it cites were found in a registry or an index.
Advanced, Analytic, Automated (AAA) Measurement of Engagement During Learning
Open accessAbstract
It is generally acknowledged that engagement plays a critical role in learning. Unfortunately, the study of engagement has been stymied by a lack of valid and efficient measures. We introduce the advanced, analytic, and automated (AAA) approach to measure engagement at fine-grained temporal resolutions. The AAA measurement approach is grounded in embodied theories of cognition and affect, which advocate a close coupling between thought and action. It uses machine-learned computational models to automatically infer mental states associated with engagement (e.g., interest, flow) from machine-readable behavioral and physiological signals (e.g., facial expressions, eye tracking, click-stream data) and from aspects of the environmental context. We present15 case studies that illustrate the potential of the AAA approach for measuring engagement in digital learning environments. We discuss strengths and weaknesses of the AAA approach, concluding that it has significant promise to catalyze engagement research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.5.879 · Cited by 82,194
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Ryan, R. M., & Deci, E. L. (2000) · American Psychologist · doi:10.1037//0003-066x.55.1.68 · Cited by 54,599 · cited 1×
“Theories of motivation, including self-determination theory (Deci & Ryan, 1985; Ryan & Deci, 2000), expectancy-value theory (Eccles & Wigfield, 2002), and self-efficacy theory (Bandura, 1986, 1997; Schunk & Pajares, 2005), focus on precursors of engagement, such as self-efficacy, interest in and value…”
BackgroundSelf-efficacy: The exercise of control
Bandura, A., Freeman, W. H., & Lightsey, R. (1999) · Journal of Cognitive Psychotherapy · doi:10.1891/0889-8391.13.2.158 · Cited by 46,835
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
Intrinsic Motivation and Self-Determination in Human Behavior
Deci, E. L., & Ryan, R. M. (1985) · doi:10.1007/978-1-4899-2271-7 · Cited by 26,772
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856 · cited 2×
“The ROC curve is obtained by plotting true-positives versus false-positives at various decision thresholds ranging from 100% true positives to 100% false positives (Hanley & McNeil, 1982).”
MethodIntrinsic Motivation and Self-Determination in Human Behavior
Miller, K. A., Deci, E. L., & Ryan, R. M. (1988) · Contemporary Sociology · doi:10.2307/2070638 · Cited by 15,312
School Engagement: Potential of the Concept, State of the Evidence
Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004) · Review of Educational Research · doi:10.3102/00346543074001059 · Cited by 12,581 · cited 1×
“Fredricks, Blumenfeld, and Paris (2004) proposed three components of engagement.”
BackgroundThe expression of the emotions in man and animals.
Darwin, C. (1872) · J. Murray eBooks · doi:10.1037/10001-000 · Cited by 11,657
An argument for basic emotions
Ekman, P. (1992) · Cognition and Emotion · doi:10.1080/02699939208411068 · Cited by 9,646 · cited 1×
“…posit that these mental states manifest in the body in multiple ways because cognition and affect are in the service of action and bodies are the agents of action (Barsalou, 2008; deVega, Glenberg, & Graesser, 2008; Ekman, 1992; Niedenthal, 2007; Russell, Bachorowski, & Fernandez-Dols, 2003).”
BackgroundEye movements in reading and information processing: 20 years of research
Rayner, K. (1998) · Psychological Bulletin · doi:10.1037/0033-2909.124.3.372 · Cited by 7,979
Motivational beliefs, values, and goals
Eccles, J. S., & Wigfield, A. (2002) · Annual Review of Psychology · doi:10.1146/annurev.psych.53.100901.135153 · Cited by 7,587
Core affect and the psychological construction of emotion.
Russell, J. A. (2003) · Psychological Review · doi:10.1037/0033-295x.110.1.145 · Cited by 6,113 · cited 1×
“Second, other than the rare case of extreme or prototypical emotions, there are weak relationships among the various bodily signals, perhaps because different situations demand different bodily responses (Barrett, 2006; Larsen et al., 2008; Russell, 2003).”
BackgroundBarsalou, L. W. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.103006.093639 · Cited by 5,936 · cited 1×
“…posit that these mental states manifest in the body in multiple ways because cognition and affect are in the service of action and bodies are the agents of action (Barsalou, 2008; deVega, Glenberg, & Graesser, 2008; Ekman, 1992; Niedenthal, 2007; Russell, Bachorowski, & Fernandez-Dols, 2003).”
BackgroundThe four-phase model of interest development
Hidi, S., & Renninger, K. A. (2006) · Educational Psychologist · doi:10.1207/s15326985ep4102_4 · Cited by 4,702
Handbook of Competence and Motivation
Elliot, A. J., & Dweck, C. S. (2013) · Cited by 4,671
Answering the Call for a Standard Reliability Measure for Coding Data
Hayes, A. F., & Krippendorff, K. (2007) · Communication Methods and Measures · doi:10.1080/19312450709336664 · Cited by 4,225 · cited 1×
“Several studies reported recognition rate, which is the proportion of cases in which computer estimates match the human-provided annotations and is highly flawed when there is class skew (i.e., uneven division among categories being discriminated; Hayes & Krippendorff, 2007).”
BackgroundMoral Identity and Developmental Theory
Lapsley, D. (2015) · Human Development · doi:10.1159/000435926 · Cited by 3,819
Skinner, E. A., & Belmont, M. J. (1993) · Journal of Educational Psychology · doi:10.1037/0022-0663.85.4.571 · Cited by 3,428 · cited 1×
“…records, such as homework completion, absences, achievement test scores, and teacher ratings of classroom conduct (Lehr, Sinclair, & Christenson, 2004; Skinner & Belmont, 1993), but these measures are limited in what they can reveal about engagement at the microan-alytic level espoused here.”
BackgroundA Survey Method for Characterizing Daily Life Experience: The Day Reconstruction Method
Kahneman, D., Krueger, A. B., Schkade, D. A., Schwarz, N., & Stone, A. A. (2004) · Science · doi:10.1126/science.1103572 · Cited by 3,422 · cited 1×
“Examples include experience-sam-pling methods (Csikszentmihalyi & Larson, 1987), day reconstruction (Kahneman, Krueger, Schkade, Schwarz, & Stone, 2004), and interviews (Turner & Meyer, 2000).”
A few useful things to know about machine learning
Domingos, P. (2012) · Communications of the ACM · doi:10.1145/2347736.2347755 · Cited by 3,326 · cited 1×
“This is done with machine learning, which pre-scribes methods to learn a program (or computational model) from data (Domingos, 2012).”
MethodHandbook of Research on Student Engagement
(2012) · doi:10.1007/978-1-4614-2018-7 · Cited by 3,050
The ICAP framework: Linking cognitive engagement to active learning outcomes
Chi, M. T. H., & Wylie, R. (2014) · Educational Psychologist · doi:10.1080/00461520.2014.965823 · Cited by 2,911
Opensmile: the munich versatile and fast open-source audio feature extractor
Eyben, F., Wöllmer, M., & Schuller, B. (2010) · Proceedings of the 18th ACM international conference on Multimedia · doi:10.1145/1873951.1874246 · Cited by 2,642 · cited 1×
“Similarly, digital signal processing techniques in the speech domain (Eyben, W € ollmer, & Schuller, 2010) are used to extract paralinguistic (also called acoustic-prosodic) features such as pitch and amplitude from an audio signal recorded with microphones (the sensor).”
MethodValidity and reliability of the Experience-Sampling Method
CSIKSZENTMIHALYI, M., & LARSON, R. (1987) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-198709000-00004 · Cited by 2,544
On the universality and cultural specificity of emotion recognition: a meta-analysis
Elfenbein, H. A., & Ambady, N. (2002) · Psychological Bulletin · doi:10.1037/0033-2909.128.2.203 · Cited by 2,049
Saccade target selection and object recognition: Evidence for a common attentional mechanism
Deubel, H., & Schneider, W. X. (1996) · Vision Research · doi:10.1016/0042-6989(95)00294-4 · Cited by 1,979
Barrett, L. F. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00003.x · Cited by 1,859 · cited 3×
“Sample features, computed by applying computer vision techniques to video, include activations of specific facial muscles (also called action units, such as inner brow raise or lip pucker; Ekman & Friesen, 1978), facial textures, and head position and orientation (Pantic & AAA MEASUREMENT APPROACH Patras, 2006; Valstar…”
BackgroundKrosnick, J. A. (1999) · Annual Review of Psychology · doi:10.1146/annurev.psych.50.1.537 · Cited by 1,852
Proceedings of the 29th Annual Conference of the Cognitive Science Society
Rohde, H., Kehler, A., & Elman, J. L. (2007) · Cognitive Science · Cited by 1,788
Agency as a fourth aspect of students’ engagement during learning activities
Reeve, J., & Tseng, C.-M. (2011) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2011.05.002 · Cited by 1,618
Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam
Poh, M.-Z., McDuff, D. J., & Picard, R. W. (2011) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2010.2086456 · Cited by 1,486
The role of visual attention in saccadic eye movements
Hoffman, J. E., & Subramaniam, B. (1995) · Perception & Psychophysics · doi:10.3758/bf03206794 · Cited by 1,432
Niedenthal, P. M. (2007) · Science · doi:10.1126/science.1136930 · Cited by 1,406
Aviation, Space, and Environmental Medicine
(2011) · Wilderness & Environmental Medicine · doi:10.1016/j.wem.2010.11.006 · Cited by 1,188
Pekrun, R., Goetz, T., Daniels, L. M., Stupnisky, R. H., & Perry, R. P. (2010) · Journal of Educational Psychology · doi:10.1037/a0019243 · Cited by 1,182
Academic Emotions and Student Engagement
Pekrun, R., & Linnenbrink-Garcia, L. (2012) · Handbook of Research on Student Engagement · doi:10.1007/978-1-4614-2018-7_12 · Cited by 1,181 · cited 2×
“Alterna-tively, Pekrun and Linnenbrink-Garcia (2012) proposed a five-component model that includes cognitive (e.g., attention and memory processes), motivational (e.g., intrinsic and extrinsic motivation), behavioral (e.g., effort and persistence), social-behavioral (e.g., participating with peers),…”
BackgroundWang, R., Chen, F., Chen, Z., Li, T., Harari, G., Tignor, S., Zhou, X., Ben-Zeev, D., & Campbell, A. T. (2014) · Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2632048.2632054 · Cited by 1,116 · cited 1×
“Sensor-based measures are currently limited to small-scale Institutional Review Board–approved research studies conducted by interdisciplinary teams of psychologists, computer scientists, and education researchers (e.g., Bosch et al., 2016; Wang et al., 2014).”
BackgroundDynamics of affective states during complex learning
D’Mello, S., & Graesser, A. (2012) · Learning and Instruction · doi:10.1016/j.learninstruc.2011.10.001 · Cited by 1,087
Self-citationHeine, S. J., Lehman, D. R., Peng, K., & Greenholtz, J. (2002) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.82.6.903 · Cited by 1,080
(1984) · doi:10.4324/9781315798806-24 · Cited by 1,061
Pianta, R. C., Hamre, B. K., & Allen, J. P. (2012) · Handbook of Research on Student Engagement · doi:10.1007/978-1-4614-2018-7_17 · Cited by 1,055 · cited 1×
“Observational methods are an attractive alternative to self-and informer-reports because they are arguably more objective (Nystrand & Gamoran, 1991; Pianta, Hamre, & Allen, 2012; Renninger & Bachrach, 2015; Ryu & Lombardi, 2015; Volpe, DiPerna, Hintze, & Shapiro, 2005).”
Fredricks, J. A., & McColskey, W. (2012) · Handbook of Research on Student Engagement · doi:10.1007/978-1-4614-2018-7_37 · Cited by 1,052
The Challenges of Defining and Measuring Student Engagement in Science
Sinatra, G. M., Heddy, B. C., & Lombardi, D. (2015) · Educational Psychologist · doi:10.1080/00461520.2014.1002924 · Cited by 1,044
Measuring student engagement in technology-mediated learning: A review
Henrie, C. R., Halverson, L. R., & Graham, C. R. (2015) · Computers & Education · doi:10.1016/j.compedu.2015.09.005 · Cited by 1,010 · cited 1×
“The most widely used measures of engagement are self-report questionnaires; see Fredricks and McColskey (2012), Greene (2015), Henrie et al. (2015) for reviews.”
MethodDuckworth, A. L., & Yeager, D. S. (2015) · Educational Researcher · doi:10.3102/0013189x15584327 · Cited by 993
Self-citationJingle, Jangle, and Conceptual Haziness: Evolution and Future Directions of the Engagement Construct
Reschly, A. L., & Christenson, S. L. (2012) · Handbook of Research on Student Engagement · doi:10.1007/978-1-4614-2018-7_1 · Cited by 980
The psychophysiology of emotion.
Larsen, J. T., Berntson, G. G., Poehlmann, K. M., Ito, T. A., & Cacioppo, J. T. (1993) · Cited by 956
The Unengaged Mind: Defining Boredom in Terms of Attention
Eastwood, J. D., Frischen, A., Fenske, M. J., & Smilek, D. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612456044 · Cited by 909
Facial and vocal expressions of emotion
Russell, J. A., Bachorowski, J.-A., & Fernández-Dols, J.-M. (2003) · Annual Review of Psychology · doi:10.1146/annurev.psych.54.101601.145102 · Cited by 873
EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks.
Berka, C., Levendowski, D. J., Lumicao, M. N., Yau, A., Davis, G., Zivkovic, V. T., Olmstead, R. E., Tremoulet, P. D., & Craven, P. L. (2007) · PubMed · Cited by 765
AutoTutor: an intelligent tutoring system with mixed-initiative dialogue.
Graesser, A. C., Chipman, P., Haynes, B. C., & Olney, A. (2005) · IEEE Transactions on Education · doi:10.1109/te.2005.856149 · Cited by 750
The Faces of Engagement: Automatic Recognition of Student Engagementfrom Facial Expressions
Whitehill, J., Serpell, Z., Lin, Y.-C., Foster, A., & Movellan, J. R. (2014) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2014.2316163 · Cited by 677
Proceedings of the 7th International Conference on Educational Data Mining.
Stamper, J. C., Pardos, Z. A., Mavrikis, M., & McLaren, B. M. (2014) · Educational Data Mining · Cited by 667
A Review and Meta-Analysis of Multimodal Affect Detection Systems
D'mello, S. K., & Kory, J. (2015) · ACM Computing Surveys · doi:10.1145/2682899 · Cited by 628
Self-citationBridging emotion theory and neurobiology through dynamic systems modeling
Lewis, M. D. (2005) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0500004x · Cited by 618
Pantic, M., & Patras, I. (2006) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2005.859075 · Cited by 580
Instructional Discourse, Student Engagement, and Literature Achievement
Nystrand, M., & Gamoran, A. (1991) · Research in the Teaching of English · doi:10.58680/rte199115462 · Cited by 551
The computer expression recognition toolbox (CERT)
Littlewort, G., Whitehill, J., Wu, T., Fasel, I., Frank, M., Movellan, J., & Bartlett, M. (2011) · Face and Gesture 2011 · doi:10.1109/fg.2011.5771414 · Cited by 539
Keltner, D., Ekman, P., Gonzaga, & Beer, J. (2002) · Handbook of Affective Sciences · doi:10.1093/oso/9780195126013.003.0022 · Cited by 513
Probabilistic assessment of user's emotions in educational games
Conati, C. (2002) · Applied Artificial Intelligence · doi:10.1080/08839510290030390 · Cited by 498
IEEE Transactions on Affective Computing
(2023) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.5165369 · Cited by 492
The Oxford Handbook of Affective Computing
(2015) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199942237.001.0001 · Cited by 482
Perceptual Learning Incepted by Decoded fMRI Neurofeedback Without Stimulus Presentation
Shibata, K., Watanabe, T., Sasaki, Y., & Kawato, M. (2011) · Science · doi:10.1126/science.1212003 · Cited by 463
Students’ emotions and academic engagement: Introduction to the special issue
Linnenbrink-Garcia, L., & Pekrun, R. (2011) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2010.11.004 · Cited by 459
When attention matters: The curious incident of the wandering mind
Smallwood, J., McSpadden, M., & Schooler, J. W. (2008) · Memory & Cognition · doi:10.3758/mc.36.6.1144 · Cited by 458
Physiological parameter monitoring from optical recordings with a mobile phone
Scully, C. G., Lee, J., Meyer, J., Gorbach, A. M., Granquist-Fraser, D., Mendelson, Y., & Chon, K. H. (2012) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2011.2163157 · Cited by 452
Mehl, M. R., Pennebaker, J. W., Crow, D. M., Dabbs, J., & Price, J. H. (2001) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195410 · Cited by 452
Measuring Cognitive Engagement With Self-Report Scales: Reflections From Over 20 Years of Research
Greene, B. A. (2015) · Educational Psychologist · doi:10.1080/00461520.2014.989230 · Cited by 438
Azevedo, R. (2015) · Educational Psychologist · doi:10.1080/00461520.2015.1004069 · Cited by 418 · cited 3×
“This point is aptly made by Azevedo (2015) in his commentary on the special issue and his perspective on the future of the field: It is important to explicitly highlight that the first path [to develop an overarching and unifying theoretical framework to account for the majority of critical elements…”
BackgroundIvon, A., Cooper David, G., Winslow, B., Park, W. B., Kasia, M., & Robert, C. (2009) · Frontiers in Artificial Intelligence and Applications · doi:10.3233/978-1-60750-028-5-17 · Cited by 382 · cited 5×
“…that can be considered as pioneering in the field, such as the first study showcasing multimodal engagement measurement in real-world classrooms (Arroyo et al., 2009), the first study emphasizing generalizability beyond the individual (Ocumpaugh, Baker, Gowda, Heffernan, & Heffernan, 2014), or…”
BackgroundInfluentialInternational handbook of emotions in education
Robertson, L. (2015) · Educational Psychology in Practice · doi:10.1080/02667363.2014.994350 · Cited by 373
Multimodal affect recognition in learning environments
Kapoor, A., & Picard, R. W. (2005) · Proceedings of the 13th annual ACM international conference on Multimedia · doi:10.1145/1101149.1101300 · Cited by 339
Automated Detection of Engagement Using Video-Based Estimation of Facial Expressions and Heart Rate
Monkaresi, H., Bosch, N., Calvo, R. A., & D'Mello, S. K. (2017) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2016.2515084 · Cited by 329
Self-citationAutomatic detection of learner’s affect from conversational cues
D’Mello, S. K., Craig, S. D., Witherspoon, A., McDaniel, B., & Graesser, A. (2008) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-007-9037-6 · Cited by 317
Self-citationFoundations of Augmented Cognition
(2005) · CRC Press eBooks · doi:10.1201/9781482289701 · Cited by 315
Automated Posture Analysis for Detecting Learner's Interest Level
Mota, S., & Picard, R. W. (2003) · 2003 Conference on Computer Vision and Pattern Recognition Workshop · doi:10.1109/cvprw.2003.10047 · Cited by 314
Meta-Analysis of the First Facial Expression Recognition Challenge
Valstar, M. F., Mehu, M., Jiang, B., Pantic, M., & Scherer, K. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2012.2200675 · Cited by 297
Bernardin, H. J., & Buckley, M. R. (1981) · Academy of Management Review · doi:10.5465/amr.1981.4287782 · Cited by 278
Tian, Y., Kanade, T., & Cohn, J. F. (2011) · Handbook of Face Recognition · doi:10.1007/978-0-85729-932-1_19 · Cited by 255
Symbols and EmbodimentDebates on meaning and cognition
de Vega, M., Glenberg, A., & Graesser, A. (2008) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199217274.001.0001 · Cited by 239
Part I Commentary: So What Is Student Engagement Anyway?
Eccles, J., & Wang, M.-T. (2012) · Handbook of Research on Student Engagement · doi:10.1007/978-1-4614-2018-7_6 · Cited by 239
On the move : the psychology of change and transition
Fisher, S., & Cooper, C. L. (1990) · Cited by 231
British Journal of Educational Psychology
(2010) · British Journal of Educational Psychology · doi:10.1111/(issn)2044-8279 · Cited by 230
Emotions in Context: A Sociodynamic Model of Emotions
Mesquita, B., & Boiger, M. (2014) · Emotion Review · doi:10.1177/1754073914534480 · Cited by 229
Daschmann, E. C., Goetz, T., & Stupnisky, R. H. (2011) · British Journal of Educational Psychology · doi:10.1348/000709910x526038 · Cited by 228
Studying Triggers for Interest and Engagement Using Observational Methods
Renninger, K. A., & Bachrach, J. E. (2015) · Educational Psychologist · doi:10.1080/00461520.2014.999920 · Cited by 226
Lehr, C. A., Sinclair, M. F., & Christenson, S. L. (2004) · Journal of Education for Students Placed at Risk (JESPAR) · doi:10.1207/s15327671espr0903_4 · Cited by 223
Automatic Decoding of Facial Movements Reveals Deceptive Pain Expressions
Bartlett, M. S., Littlewort, G. C., Frank, M. G., & Lee, K. (2014) · Current Biology · doi:10.1016/j.cub.2014.02.009 · Cited by 215
Roseman, I. J. (2011) · Emotion Review · doi:10.1177/1754073911410744 · Cited by 200 · cited 1×
“If the system itself produces “beyond-chance probabilistic” output (Roseman, 2011 p. 440), then so will attempts to computationally model it.”
BackgroundThe half-life of cognitive-affective states during complex learning
D'Mello, S., & Graesser, A. (2011) · Cognition and Emotion · doi:10.1080/02699931.2011.613668 · Cited by 195
Self-citationTurner, J. C., & Meyer, D. K. (2000) · Educational Psychologist · doi:10.1207/s15326985ep3502_2 · Cited by 193
(2008) · Cited by 193
Automatic gaze-based user-independent detection of mind wandering during computerized reading
Bixler, R., & D’Mello, S. K. (2015) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-015-9167-1 · Cited by 188
Self-citationAn automated behavioral measure of mind wandering during computerized reading
Faber, M., Bixler, R., & D’Mello, S. K. (2017) · Behavior Research Methods · doi:10.3758/s13428-017-0857-y · Cited by 187
Self-citationUsing Reading Times and Eye-Movements to Measure Cognitive Engagement
Miller, B. (2015) · Educational Psychologist · doi:10.1080/00461520.2015.1004068 · Cited by 186
Observing Students in Classroom Settings: A Review of Seven Coding Schemes
Volpe, R. J., DiPerna, J. C., Hintze, J. M., & Shapiro, E. S. (2005) · School Psychology Review · doi:10.1080/02796015.2005.12088009 · Cited by 174
Towards Sensor-Free Affect Detection in Cognitive Tutor Algebra.
Baker, R. S., Gowda, S. M., Wixon, M., Kalka, J., Wagner, A. Z., Salvi, A., Aleven, V. A. W. M. M., Kusbit, G. W., Ocumpaugh, J. L., & Rossi, L. M. (2012) · Educational Data Mining · Cited by 170
Population validity for educational data mining models: A case study in affect detection
Ocumpaugh, J., Baker, R., Gowda, S., Heffernan, N., & Heffernan, C. (2014) · British Journal of Educational Technology · doi:10.1111/bjet.12156 · Cited by 168
Bernardin, H. J., & Buckley, M. R. (1981) · Academy of Management Review · doi:10.2307/257876 · Cited by 167
Assessment and Learning of Qualitative Physics in Newton's Playground
Shute, V. J., Ventura, M., & Kim, Y. J. (2013) · The Journal of Educational Research · doi:10.1080/00220671.2013.832970 · Cited by 162
Pardos, Z. A., Baker, R. S. J. D., San Pedro, M. O. C. Z., Gowda, S. M., & Gowda, S. M. (2013) · Proceedings of the Third International Conference on Learning Analytics and Knowledge · doi:10.1145/2460296.2460320 · Cited by 159
Ruch, W. (1995) · Cognition & Emotion · doi:10.1080/02699939508408964 · Cited by 140
Using Video to Automatically Detect Learner Affect in Computer-Enabled Classrooms
Bosch, N., D’Mello, S. K., Ocumpaugh, J. L., Baker, R. S., & Shute, V. J. (2016) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/2946837 · Cited by 140
Self-citationOperationalizing and Detecting Disengagement Within Online Science Microworlds
Gobert, J. D., Baker, R. S., & Wixon, M. (2015) · Educational Psychologist · doi:10.1080/00461520.2014.999919 · Cited by 137
Real-time eye gaze tracking with an unmodified commodity webcam employing a neural network
Sewell, W., & Komogortsev, O. (2010) · CHI '10 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1753846.1754048 · Cited by 136
Emergent Ghosts of the Emotion Machine
Coan, J. A. (2010) · Emotion Review · doi:10.1177/1754073910361978 · Cited by 132
Emotional Facial Expressions in Infancy
Camras, L. A., & Shutter, J. M. (2010) · Emotion Review · doi:10.1177/1754073909352529 · Cited by 131
Modeling Learner Affect with Theoretically Grounded Dynamic Bayesian Networks
Sabourin, J. L., Mott, B., & Lester, J. C. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-24600-5_32 · Cited by 128
Overview of the DARPA Augmented Cognition Technical Integration Experiment
St. John, M., Kobus, D. A., Morrison, J. G., & Schmorrow, D. (2004) · International Journal of Human-Computer Interaction · doi:10.1207/s15327590ijhc1702_2 · Cited by 124
Coding Classroom Interactions for Collective and Individual Engagement
Ryu, S., & Lombardi, D. (2015) · Educational Psychologist · doi:10.1080/00461520.2014.1001891 · Cited by 124
What Are You Feeling? Investigating Student Affective States During Expert Human Tutoring Sessions
Lehman, B. A., Matthews, M., D’Mello, S. K., & Person, N. K. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-69132-7_10 · Cited by 121
Self-citationDetection of Emotions during Learning with AutoTutor
Chipman, P., D’Mello, S. K., Gholson, B., Graesser, A. C., McDaniel, B., & Witherspoon, A. M. (2006) · Proceedings of the Annual Meeting of the Cognitive Science Society · Cited by 120
Self-citationBixler, R., & D’Mello, S. K. (2013) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/2449396.2449426 · Cited by 115
Self-citationAssessment and Learning of Qualitative Physics in Newton’s Playground
Ventura, M., Shute, V. J., & Kim, Y. J. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39112-5_63 · Cited by 110
Social regulation of emotion: messy layers
Kappas, A. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00051 · Cited by 105
Knowledge Elicitation Methods for Affect Modelling in Education
Porayska‐Pomsta, K., Mavrikis, M., D’Mello, S. K., Conati, C., & Baker, R. S. (2013) · International Journal of Artificial Intelligence in Education · doi:10.3233/jai-130032 · Cited by 101
Self-citationPedro, M. O. C. Z. S., Baker, R. S., Bowers, A. J., & Heffernan, N. T. (2013) · Educational Data Mining · Cited by 100
Dynamical systems approaches to emotional development
Camras, L. A., & Witherington, D. C. (2005) · Developmental Review · doi:10.1016/j.dr.2005.10.002 · Cited by 96
Automated Physiological-Based Detection of Mind Wandering during Learning
Blanchard, N., Bixler, R., Joyce, T., & D’Mello, S. K. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-07221-0_7 · Cited by 95
Self-citationHutt, S. J., Mills, C., Bosch, N., Krasich, K., Brockmole, J. R., & D’Mello, S. K. (2017) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3079628.3079669 · Cited by 81
Self-citationBackground and Instructional Effects on Achievement in Eighth-Grade English and Social Studies
Gamoran, A., & Nystrand, M. (1991) · Journal of Research on Adolescence · doi:10.1207/s15327795jra0103_5 · Cited by 80
School Psychology Review: 2006-2010
Power, T. J. (2006) · School Psychology Review · doi:10.1080/02796015.2006.12087998 · Cited by 80
Web-Based Intelligent Multimedia Tutoring for High Stakes Achievement Tests
Arroyo, I., Beal, C., Murray, T., Walles, R., & Woolf, B. P. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-30139-4_44 · Cited by 74 · cited 1×
“These data streams were collected from 38 high school and 29 female undergraduate students (potential elementary school teachers) who used the Wayang Outpost geometry ITS as part of regular mathematics instruction over the course of 4 to 5 days (Arroyo, Beal, Murray, Walles, & Woolf, 2004).”
MethodDisequilibrium in the mind, disharmony in the body
D’Mello, S. K., Dale, R. A. C., & Graesser, A. C. (2011) · Cognition & Emotion · doi:10.1080/02699931.2011.575767 · Cited by 63
Self-citationA psycho-ethological approach to social signal processing
Méhu, M., & Scherer, K. R. (2012) · Cognitive Processing · doi:10.1007/s10339-012-0435-2 · Cited by 61
In the Zone: Towards Detecting Student Zoning Out Using Supervised Machine Learning
Drummond, J., & Litman, D. J. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-13437-1_53 · Cited by 52
Attending to Attention: Detecting and Combating Mind Wandering during Computerized Reading
D’Mello, S. K., Kopp, K. J., Bixler, R., & Bosch, N. (2016) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2851581.2892329 · Cited by 51
Self-citationMotion Tracker: Camera-Based Monitoring of Bodily Movements Using Motion Silhouettes
Kory-Westlund, J. M., D’Mello, S. K., & Olney, A. M. (2015) · PLoS ONE · doi:10.1371/journal.pone.0130293 · Cited by 45
Self-citationInteraction-Based Affect Detection in Educational Software
Calvo, R. A., D'Mello, S., Gratch, J., Kappas, A., Baker, R. S., & Ocumpaugh, J. L. (2014) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199942237.013.009 · Cited by 44
Self-citationAccuracy vs. Availability Heuristic in Multimodal Affect Detection in the Wild
Bosch, N., Chen, H., D’Mello, S. K., Baker, R. S., & Shute, V. J. (2015) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2818346.2820739 · Cited by 42
Self-citationD’Mello, S. K. (2015) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2015.2457413 · Cited by 38
Self-citationSelf Versus Teacher Judgments of Learner Emotions During a Tutoring Session with AutoTutor
D’Mello, S. K., Taylor, R., Davidson, K. F., & Graesser, A. C. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-69132-7_6 · Cited by 31
Self-citationNatural Affect Data: Collection and Annotation
Afzal, S., & Robinson, P. (2011) · Springer eBooks · doi:10.1007/978-1-4419-9625-1_5 · Cited by 29
D’Mello, S. K., Dowell, N., & Graesser, A. C. (2013) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2013.19 · Cited by 21
Self-citationCost-Effective, Actionable Engagement Detection at Scale.
Baker, R. S., & Ocumpaugh, J. L. (2014) · Cited by 3
Cited by
Duckworth, A. L., & Yeager, D. S. (2015) · Educational Researcher · doi:10.3102/0013189x15584327 · Cited by 993
Self-citationTeacher emotions in the classroom and their implications for students
Frenzel, A. C., Daniels, L., & Burić, I. (2021) · Educational Psychologist · doi:10.1080/00461520.2021.1985501 · Cited by 470
Emotion Regulation in Achievement Situations: An Integrated Model
Harley, J. M., Pekrun, R., Taxer, J. L., & Gross, J. J. (2019) · Educational Psychologist · doi:10.1080/00461520.2019.1587297 · Cited by 309
Supporting Groups’ Emotion and Motivation Regulation during Collaborative Learning
Järvenoja, H., Järvelä, S., & Malmberg, J. (2020) · Learning and Instruction · doi:10.1016/j.learninstruc.2017.11.004 · Cited by 194
How Do We Model Learning at Scale? A Systematic Review of Research on MOOCs
Joksimović, S., Poquet, O., Kovanović, V., Dowell, N., Mills, C., Gašević, D., Dawson, S., Graesser, A. C., & Brooks, C. (2018) · Review of Educational Research · doi:10.3102/0034654317740335 · Cited by 182
Metadata
- Authors
- D'Mello, S., Dieterle, E., & Duckworth, A.
- Venue
- Educational Psychologist
- Publisher
- Informa UK Limited
- Published
- 2017-02-21
- Volume
- 52
- Issue
- 2
- Pages
- 104-123
- ISSN
- 0046-1520 (ISSN-L)
- 1532-6985
- OpenAlex
- W2590255117
- Cited by
- 350
- References
- 137
- FWCI
- 24.66
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.