Defining and Measuring Engagement and Learning in Science: Conceptual, Theoretical, Methodological, and Analytical Issues
The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
Engagement is one of the most widely misused and overgeneralized constructs found in the educational, learning, instructional, and psychological sciences. The articles in this special issue represent a wide range of traditions and highlight several key conceptual, theoretical, methodological, and analytical issues related to defining and measuring engagement. All the approaches exemplified by the contributors show different ways of conceptualizing and measuring engagement and demonstrate the strengths and weaknesses of each method to significantly augment our current understanding of engagement. Despite the numerous issues raised by the authors of this special issue and in my commentary, I argue that focusing on process data will lead to advances in models, theory, methods, analytical techniques, and ultimately instructional recommendations for learning contexts that effectively engage students.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“AI has the potential not only to support SRL but also to improve its measurement by leveraging multimodal data (Azevedo, 2015; Cloude et al., 2022; Molenaar et al., 2023).”
From Enhancing School Students' Self-Regulated Learning through Generative AI Support: A Randomized Controlled Trial (2026) · cites this paper as Azevedo, 2015
In the citing paper
“Although one data source is unlike to capture all CAMM processes, there seems to be a better fit between certain CAMM processes and data streams (Azevedo, 2015; Azevedo et al., 2018).”
From Measuring self-regulated learning and the role of AI: Five years of research using multimodal multichannel data (2023) · cites this paper as Azevedo, 2015
Citations
Cites
School Engagement: Potential of the Concept, State of the Evidence
Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004) · Review of Educational Research · doi:10.3102/00346543074001059 · Cited by 12,581
Motivational and self-regulated learning components of classroom academic performance.
Pintrich, P. R., & De Groot, E. V. (1990) · Journal of Educational Psychology · doi:10.1037/0022-0663.82.1.33 · Cited by 8,332
Expectancy-value theory of achievement motivation
Wigfield, A., & Eccles, J. S. (2000) · Contemporary Educational Psychology · doi:10.1006/ceps.1999.1015 · Cited by 7,383 · cited 1×
“…which may be based on distinct theoretical models (e.g., a macrolevel category for cognitive strategies, another one for emotions, and another one for motivation because they each have a distinct theoretical basis; Azevedo et al., 2010; Pekrun & Linnenbrink Garcia, 2014; Wigfield & Eccles, 2000)?”
BackgroundMotivation in Education: Theory, Research, and Applications
Pintrich, P. R., & Schunk, D. H. (1995) · Cited by 6,248
The Role of Goal Orientation in Self-Regulated Learning
Pintrich, P. R. (2000) · Handbook of Self-Regulation · doi:10.1016/b978-012109890-2/50043-3 · Cited by 5,173 · cited 1×
“…following: (a) How is engagement the same as or different from other leading theoretical frameworks, models, and theories of self-regulation (e.g., Pintrich, 2000; Winne & Hadwin, 2008; Zimmerman & Schunk, 2011) and contemporary frameworks of socially shared regulation (Hadwin, J€arvel€a, &…”
BackgroundZimmerman, B. J. (2008) · American Educational Research Journal · doi:10.3102/0002831207312909 · Cited by 3,735 · cited 2×
“…special issue, as well as others (Azevedo et al., 2010; Winne & Azevedo, 2014), the problem is that self-reports are based on students’ perceptions of how one would or did enact certain processes, and these perceptions often do not align with what actually occurs during learning (Zimmerman, 2008).”
BackgroundAssessing Metacognitive Awareness
Schraw, G., & Dennison, R. S. (1994) · Contemporary Educational Psychology · doi:10.1006/ceps.1994.1033 · Cited by 3,199 · cited 2×
“In contrast, self-report measures (e.g., MSLQ, PALS, LASSI, AEQ, ERQ, MAI, and OMQ) provide evidence regarding students’ self-perceptions of a number of cognitive, metacognitive, affective, and motivational beliefs across contexts.”
MethodHandbook of Research on Student Engagement
(2012) · doi:10.1007/978-1-4614-2018-7 · Cited by 3,050
Pekrun, R., Goetz, T., Frenzel, A. C., Barchfeld, P., & Perry, R. P. (2011) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2010.10.002 · Cited by 2,248
Handbook of Self-Regulation of Learning and Performance
Schunk, D. H. (2011) · Routledge eBooks · doi:10.4324/9780203839010 · Cited by 2,122
Handbook of Self-Regulation of Learning and Performance
(2017) · Routledge eBooks · doi:10.4324/9781315697048 · Cited by 1,816 · cited 1×
“…(a) How is engagement the same as or different from other leading theoretical frameworks, models, and theories of self-regulation (e.g., Pintrich, 2000; Winne & Hadwin, 2008; Zimmerman & Schunk, 2011) and contemporary frameworks of socially shared regulation (Hadwin, J€arvel€a, & Miller, 2011)?”
BackgroundInternational Handbook of Emotions in Education
(2014) · Routledge eBooks · doi:10.4324/9780203148211 · Cited by 1,579
Motivation and Self-Regulated Learning: Theory, Research, and Applications
Collins, N. (2009) · The Journal of Higher Education · doi:10.1080/00221546.2009.11779027 · Cited by 1,435
Fredricks, J. A., & McColskey, W. (2012) · Handbook of Research on Student Engagement · doi:10.1007/978-1-4614-2018-7_37 · Cited by 1,052 · cited 1×
“EDUCATIONAL PSYCHOLOGIST, 50(1), 84–94, 2015 Copyright Division 15, American Psychological Association ISSN: 0046-1520 print / 1532-6985 online DOI: 10.1080/00461520.2015.1004069 Fredricks & McColskey, 2012).”
InfluentialThe Challenges of Defining and Measuring Student Engagement in Science
Sinatra, G. M., Heddy, B. C., & Lombardi, D. (2015) · Educational Psychologist · doi:10.1080/00461520.2014.1002924 · Cited by 1,044
Educational Data Mining and Learning Analytics
Baker, R. S., & Inventado, P. S. (2014) · Learning Analytics · doi:10.1007/978-1-4614-3305-7_4 · Cited by 1,029
The Cambridge Handbook of the Learning Sciences
(2014) · doi:10.1017/cbo9781139519526 · Cited by 907
Emotion regulation: taking stock and moving forward
Gross, J. J. (2013) · Emotion · doi:10.1037/a0032135 · Cited by 864 · cited 1×
“Greene & Azevedo, 2009; Shute, in press), and affective and motivational science (Calvo et al., 2014; Gross, 2013; Pekrun, Goetz, Frenzel, Petra, & Perry, 2011; Scherer, 2013; Schunk, Meece, & Pintrich, 2013).”
New Frontiers: Regulating Learning in CSCL
Järvelä, S., & Hadwin, A. F. (2013) · Educational Psychologist · doi:10.1080/00461520.2012.748006 · Cited by 722
Educational Data Mining and Learning Analytics
Baker, R., & Siemens, G. (2014) · The Cambridge Handbook of the Learning Sciences · doi:10.1017/cbo9781139519526.016 · Cited by 490
The Oxford Handbook of Affective Computing
(2015) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199942237.001.0001 · Cited by 482 · cited 1×
“…data mining and machine learning (Baker & Siemens, 2014), educational statistics (J. A. Greene & Azevedo, 2009; Shute, in press), and affective and motivational science (Calvo et al., 2014; Gross, 2013; Pekrun, Goetz, Frenzel, Petra, & Perry, 2011; Scherer, 2013; Schunk, Meece, & Pintrich, 2013).”
Measuring Cognitive Engagement With Self-Report Scales: Reflections From Over 20 Years of Research
Greene, B. A. (2015) · Educational Psychologist · doi:10.1080/00461520.2014.989230 · Cited by 438
International Handbook of Metacognition and Learning Technologies
(2013) · Springer International Handbooks of Education · doi:10.1007/978-1-4419-5546-3 · Cited by 403
Self-citationGreene, J. A., & Azevedo, R. (2009) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2008.05.006 · Cited by 364
Self-citation(2012) · doi:10.4324/9780203831076-17 · Cited by 361 · cited 1×
“…(a) How is engagement the same as or different from other leading theoretical frameworks, models, and theories of self-regulation (e.g., Pintrich, 2000; Winne & Hadwin, 2008; Zimmerman & Schunk, 2011) and contemporary frameworks of socially shared regulation (Hadwin, J€arvel€a, & Miller, 2011)?”
BackgroundEducational psychologist: (537492009-017)
(2005) · PsycEXTRA Dataset · doi:10.1037/e537492009-017 · Cited by 359
AZEVEDO, R., MOOS, D. C., JOHNSON, A. M., & CHAUNCEY, A. D. (2010) · Educational Psychologist · doi:10.1080/00461520.2010.515934 · Cited by 324
Self-citationShame and Pride and their Effects on Student Achievement
Oades-Sese, G. V., Matthews, T. A., & Lewis, M. (2015) · International Handbook of Emotions in Education · doi:10.4324/9780203148211.ch13 · Cited by 308
Scherer, K. R. (2013) · Emotion Review · doi:10.1177/1754073912468166 · Cited by 238 · cited 1×
“…data mining and machine learning (Baker & Siemens, 2014), educational statistics (J. A. Greene & Azevedo, 2009; Shute, in press), and affective and motivational science (Calvo et al., 2014; Gross, 2013; Pekrun, Goetz, Frenzel, Petra, & Perry, 2011; Scherer, 2013; Schunk, Meece, & Pintrich, 2013).”
Co-Regulation of Student Motivation and Emergent Identity
McCASLIN, M. (2009) · Educational Psychologist · doi:10.1080/00461520902832384 · Cited by 234 · cited 1×
“This approach is deeply rooted in Vygostksy’s work, as well as other work in the areas of self-regulation and motivation (McCaslin, 2009).”
MethodStudying Triggers for Interest and Engagement Using Observational Methods
Renninger, K. A., & Bachrach, J. E. (2015) · Educational Psychologist · doi:10.1080/00461520.2014.999920 · Cited by 226
Winne, P. H., & Azevedo, R. (2014) · Cambridge University Press eBooks · doi:10.1017/cbo9781139519526.006 · Cited by 195 · cited 1×
“As amply acknowledged and stated by contributors to this special issue, as well as others (Azevedo et al., 2010; Winne & Azevedo, 2014), the problem is that self-reports are based on students’ perceptions of how one would or did enact certain processes, and these perceptions often do not align with…”
Self-citationThe SAGE Encyclopedia of Educational Technology
Spector, J. M. (2015) · Sage eBooks · doi:10.4135/9781483346397 · Cited by 195
Azevedo, R., Harley, J. M., Trevors, G., Duffy, M. C., Feyzi-Behnagh, R., Bouchet, F., & Landis, R. S. (2013) · Springer international handbooks of education · doi:10.1007/978-1-4419-5546-3_28 · Cited by 186 · cited 3×
“Multiple methodologies are critical to systematically and accurately capture the temporally unfolding cognitive, metacognitive, motivational, and affective processes deployed during learning (e.g., Azevedo et al., 2013).”
BackgroundResultSelf-citationOperationalizing and Detecting Disengagement Within Online Science Microworlds
Gobert, J. D., Baker, R. S., & Wixon, M. B. (2015) · Educational Psychologist · doi:10.1080/00461520.2014.999919 · Cited by 114
The SAGE encyclopedia of educational technology
(2015) · Choice Reviews Online · doi:10.5860/choice.191338 · Cited by 63
Betts, J. (2012) · Springer eBooks · doi:10.1007/978-1-4614-2018-7_38 · Cited by 61 · cited 1×
“…and analyze engagement, as well as the accuracy of the inferences drawn about engagement based on the methodologies and analytical techniques (Betts, 2012; Correspondence should be addressed to Roger Azevedo, Department of Psychology, North Carolina State University, 640 Poe Hall, 2310…”
Method
Research works printed but not linked: 8
- Calvo R., 2014, Handbook of affective computing
- Gobert J. D., Educational Psychologist, 50
- Greene B. A., Educational Psychologist, 50
- Miller B. W., Educational Psychologist, 50
- Renninger K. A., Educational Psychologist, 50
- Ryu S., Educational Psychologist, 50
- Sinatra G. M., Educational Psychologist, 50
- Weinstein C. E., 1987, LASSI user's manual for those administering the Learning and Study Strategies Inventory
Cited by
Bond, M., Buntins, K., Bedenlier, S., Zawacki-Richter, O., & Kerres, M. (2020) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-019-0176-8 · Cited by 1,097
“…strength and depth of student engagement theorising remains e.g. (Boekaerts, 2016; Kahn, 2014; Zepke, 2018), the quality of which has had a direct impact on the rigour of subsequent research (Lawson & Lawson, 2013; Trowler, 2010), prompting calls for further synthesis (Azevedo, 2015; Eccles, 2016).”
BackgroundThe Challenges of Defining and Measuring Student Engagement in Science
Sinatra, G. M., Heddy, B. C., & Lombardi, D. (2015) · Educational Psychologist · doi:10.1080/00461520.2014.1002924 · Cited by 1,044
Measuring Student Engagement in the Online Course: The Online Student Engagement Scale (OSE)
Dixson, M. D. (2015) · Online Learning · doi:10.24059/olj.v19i4.561 · Cited by 707
“Student engagement has been conceptualized in multiple ways across researchers and disciplines (Azvedo, 2015).”
BackgroundSystematic Reviews in Educational Research: Methodology, Perspectives and Application
Newman, M., & Gough, D. (2020) · Systematic Reviews in Educational Research · doi:10.1007/978-3-658-27602-7_1 · Cited by 591
Bernacki, M. L., Greene, J. A., & Crompton, H. (2020) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2019.101827 · Cited by 484
“Likewise, the engagement often assumed in studies and theories of informal learning has numerous aspects (i.e., cognitive, behavioral, motivational, emotional or affective; Azevedo, 2015) that could and should be measured and understood to best leverage the affordances of informal environmental for mobile learning.”
Background
Metadata
- Authors
- Azevedo, R.
- Affiliations
- North Carolina State University (US)
- Corresponding author
- Azevedo, Roger
- ORCID
- Azevedo, Roger
- Venue
- Educational Psychologist
- Publisher
- Informa UK Limited
- Published
- 2015-01-02
- Volume
- 50
- Issue
- 1
- Pages
- 84-94
- ISSN
- 0046-1520 (ISSN-L)
- 1532-6985
- OpenAlex
- W2129514660
- Cited by
- 418
- References
- 37
- Citations by year
- 2026: 34 · 2025: 46 · 2024: 29 · 2023: 44 · 2022: 41 · 2021: 36 · 2020: 40 · 2019: 56 · 2018: 28 · 2017: 33 · 2016: 24 · 2015: 7
- FWCI
- 46.19
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Educational Psychologist (publishedVersion)
- Funders
- Institute of Education Sciences
- Topics
- Social Sciences › Psychology › Developmental and Educational Psychology › Education, Achievement, and Giftedness
- Social Sciences › Education › Science Education and Pedagogy
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Keywords
- student engagement, engagement measurement, process data, science learning, engagement theory, instructional design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.