A scoping review of research instruments for measuring student engagement: In need for convergence
Open accessThe DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
This article reports on how student engagement is measured in research on technology enhanced learning in higher education. For this purpose, a secondary analysis of a previously conducted systematic review on student engagement in higher education was carried out. 246 research instruments were extracted that relate to the cognitive, affective, and behavioral dimensions of student engagement. Although published in peer-reviewed journals, only 57.4% of the studies reveal their instrument or provide information on how they measured student engagement. Only 30.6% of the presented research instruments report reliability scores but most of those instruments rather relate to learning in general than to learning in educational technology contexts. Only four research instruments were used more than one time. These findings demonstrate the need for a convergence of instruments to operationalize student engagement. For further research, it is highly recommended to re-use instruments developed before and rely on scales with proven psychometric quality: A convergence of evaluated instruments is needed for researchers to rely on an established set of scales for the different dimensions of student engagement. To this end, we recommend relying on generic student engagement scales, as many of these reviewed instruments already exist and fulfill the requirements of psychometric criteria.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
School Engagement: Potential of the Concept, State of the Evidence
Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004) · Review of Educational Research · doi:10.3102/00346543074001059 · Cited by 12,581
Reliability and Predictive Validity of the Motivated Strategies for Learning Questionnaire (Mslq)
Pintrich, P. R., Smith, D. A. F., Garcia, T., & Mckeachie, W. J. (1993) · Educational and Psychological Measurement · doi:10.1177/0013164493053003024 · Cited by 3,646
Validation of a New General Self-Efficacy Scale
Chen, G., Gully, S. M., & Eden, D. (2001) · Organizational Research Methods · doi:10.1177/109442810141004 · Cited by 3,542
Cognitive Load Measurement as a Means to Advance Cognitive Load Theory
Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_8 · Cited by 2,527
The revised two‐factor Study Process Questionnaire: R‐SPQ‐2F
Biggs, J., Kember, D., & Leung, D. Y. P. (2001) · British Journal of Educational Psychology · doi:10.1348/000709901158433 · Cited by 2,122
Framing student engagement in higher education
Kahu, E. R. (2013) · Studies in Higher Education · doi:10.1080/03075079.2011.598505 · Cited by 2,103
The general self-efficacy scale: multicultural validation studies
Luszczynska, A., Scholz, U., & Schwarzer, R. (2005) · The Journal of Psychology · doi:10.3200/jrlp.139.5.439-457 · Cited by 1,878
A Self-determination Theory Perspective on Student Engagement
Reeve, J. (2012) · Handbook of Research on Student Engagement · doi:10.1007/978-1-4614-2018-7_7 · Cited by 1,650
Agency as a fourth aspect of students’ engagement during learning activities
Reeve, J., & Tseng, C.-M. (2011) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2011.05.002 · Cited by 1,618
Student engagement in the educational interface: Understanding the mechanisms of student success
Kahu, E. R., & Nelson, K. (2018) · Higher Education Research & Development · doi:10.1080/07294360.2017.1344197 · Cited by 1,108
Bond, M., Buntins, K., Bedenlier, S., Zawacki-Richter, O., & Kerres, M. (2020) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-019-0176-8 · Cited by 1,097
Self-citationFredricks, J. A., & McColskey, W. (2012) · Handbook of Research on Student Engagement · doi:10.1007/978-1-4614-2018-7_37 · Cited by 1,052
Measuring student engagement in technology-mediated learning: A review
Henrie, C. R., Halverson, L. R., & Graham, C. R. (2015) · Computers & Education · doi:10.1016/j.compedu.2015.09.005 · Cited by 1,010
Jingle, Jangle, and Conceptual Haziness: Evolution and Future Directions of the Engagement Construct
Reschly, A. L., & Christenson, S. L. (2012) · Handbook of Research on Student Engagement · doi:10.1007/978-1-4614-2018-7_1 · Cited by 980
Fredricks, J. A., Filsecker, M., & Lawson, M. A. (2016) · Learning and Instruction · doi:10.1016/j.learninstruc.2016.02.002 · Cited by 851
New Benchmarks in Higher Education: Student Engagement in Online Learning
Robinson, C. C., & Hullinger, H. (2008) · Journal of Education for Business · doi:10.3200/joeb.84.2.101-109 · Cited by 618
The Math and Science Engagement Scales: Scale development, validation, and psychometric properties
Wang, M.-T., Fredricks, J. A., Ye, F., Hofkens, T. L., & Linn, J. S. (2016) · Learning and Instruction · doi:10.1016/j.learninstruc.2016.01.008 · Cited by 592
A systematic review of research on the flipped learning method in engineering education
Karabulut‐Ilgu, A., Jaramillo Cherrez, N., & Jahren, C. T. (2018) · British Journal of Educational Technology · doi:10.1111/bjet.12548 · Cited by 581
Facilitating Student Engagement Through Educational Technology: Towards a Conceptual Framework
Bond, M., & Bedenlier, S. (2019) · Journal of Interactive Media in Education · doi:10.5334/jime.528 · Cited by 374
The Index of Cognitive Activity: measuring cognitive workload
Marshall, S. P. (2003) · Proceedings of the IEEE 7th Conference on Human Factors and Power Plants · doi:10.1109/hfpp.2002.1042860 · Cited by 266
Wang, F. H. (2017) · Computers & Education · doi:10.1016/j.compedu.2017.06.012 · Cited by 252
Higher Education Student Engagement Scale (HESES): Development and Psychometric Evidence
Zhoc, K. C. H., Webster, B. J., King, R. B., Li, J. C. H., & Chung, T. S. H. (2019) · Research in Higher Education · doi:10.1007/s11162-018-9510-6 · Cited by 218
Differentiating Different Types of Cognitive Load: a Comparison of Different Measures
Korbach, A., Brünken, R., & Park, B. (2018) · Educational Psychology Review · doi:10.1007/s10648-017-9404-8 · Cited by 153
Eccles, J. S. (2016) · Learning and Instruction · doi:10.1016/j.learninstruc.2016.02.003 · Cited by 149
The effect of social interaction on learning engagement in a social networking environment
Lu, J., & Churchill, D. (2014) · Interactive Learning Environments · doi:10.1080/10494820.2012.680966 · Cited by 117
Exploring the potential of LMS log data as a proxy measure of student engagement
Henrie, C. R., Bodily, R., Larsen, R., & Graham, C. R. (2018) · Journal of Computing in Higher Education · doi:10.1007/s12528-017-9161-1 · Cited by 92
The instrumental value of conceptual frameworks in educational technology research
Antonenko, P. D. (2015) · Educational Technology Research and Development · doi:10.1007/s11423-014-9363-4 · Cited by 81
The validity and utility of activity logs as a measure of student engagement
Motz, B., Quick, J., Schroeder, N., Zook, J., & Gunkel, M. (2019) · Proceedings of the 9th International Conference on Learning Analytics & Knowledge · doi:10.1145/3303772.3303789 · Cited by 47
Cited by
Student Engagement in Open, Distance, and Digital Education
Bond, M., & Bergdahl, N. (2022) · Handbook of Open, Distance and Digital Education · doi:10.1007/978-981-19-0351-9_79-1 · Cited by 33
Methodische Ansätze zu Evidenzsynthesen in der Bildungstechnologie: Eine tertiäre Übersichtsarbeit
Buntins, K., Bedenlier, S., Marín, V., Händel, M., & Bond, M. (2023) · MedienPädagogik: Zeitschrift für Theorie und Praxis der Medienbildung · doi:10.21240/mpaed/54/2023.12.20.x · Cited by 13
Self-citationBond, M., Viberg, O., & Bergdahl, N. (2023) · LAK23: 13th International Learning Analytics and Knowledge Conference · doi:10.1145/3576050.3576085 · Cited by 8
Metadata
- Authors
- Buntins, K., Kerres, M., & Heinemann, A.
- Venue
- International Journal of Educational Research Open
- Publisher
- Elsevier BV
- Published
- 2021
- Volume
- 2
- Pages
- 100099
- ISSN
- 2666-3740 (ISSN-L)
- OpenAlex
- W4205735798
- Cited by
- 35
- References
- 28
- FWCI
- 8.35
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.