Exploring Factors, and Indicators for Measuring Students’ Sustainable Engagement in e-Learning
Open accessThe DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Abstract
The topic of engagement has been attracting increasing amounts of attention in the field of e-learning. Research shows that multifarious benefits occur when students are engaged in their own learning, including increased motivation and achievement. Previous studies have proposed many scales for measuring student engagement. However, very few have been developed to measure engagement in e-learning environments. Thus, developing an instrument for measuring student engagement in e-learning environments is the purpose of this study. The participants of this study were 737 Korean online university students. Initial items were designed based on the literature. The instrument items were reduced from an initial 48 to 24 items after obtaining expert opinion and then validity and reliability analysis. Exploratory and confirmatory factor analyses were also conducted. Six factors, including psychological motivation, peer collaboration, cognitive problem solving, interaction with instructors, community support, and learning management emerged in the 24-item scale. This scale is expected to help instructors and curriculum designers to find conditions to improve student engagement in e-learning environments, and ultimately prevent students from dropping out of online courses.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
School Engagement: Potential of the Concept, State of the Evidence
Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004) · Review of Educational Research · doi:10.3102/00346543074001059 · Cited by 12,581 · cited 2×
“Cognitive engagement relates to learners’ investment of thought, mental effort, or learning achievement strategies [8,20].”
BackgroundThe measurement of engagement and burnout: a two sample confirmatory factor analytic approach.
Schaufeli, W. B., Salanova, M., González-romá, V., & Bakker, A. B. (2002) · Journal of Happiness Studies · doi:10.1023/a:1015630930326 · Cited by 10,014 · cited 1×
“What behaviors then can be expected of engaged learners? In a study on student engagement in face-to-face learning environments, engagement encompasses learners’ cognitive, emotional, and behavioral reactions to educational activities [27].”
BackgroundHandbook of Research on Student Engagement
(2012) · doi:10.1007/978-1-4614-2018-7 · Cited by 3,050
Finn, J. D. (1989) · Review of Educational Research · doi:10.2307/1170412 · Cited by 2,702 · cited 2×
“Finn [24] explained that student engagement consists of behavioral factors (participation) and emotional factors (identification) in his presentation of the participation-identification model.”
BackgroundFraming student engagement in higher education
Kahu, E. R. (2013) · Studies in Higher Education · doi:10.1080/03075079.2011.598505 · Cited by 2,103 · cited 1×
“Burch, Heller, Burch, Freed, and Steed [29] suggested the types of engagement that can occur in the class include enthusiasm for the course, interest for learning, effort, invested energy for learning, concentration on learning, and attention to class.”
BackgroundRelationships matter: linking teacher support to student engagement and achievement.
Klem, A. M., & Connell, J. P. (2004) · Journal of School Health · doi:10.1111/j.1746-1561.2004.tb08283.x · Cited by 2,082 · cited 1×
“Measurement in the face-to-face environment has mainly focused on behavioral or emotional types of engagement, and researchers have recently begun to pay attention to the cognitive process of learning [43].”
BackgroundMeasuring cognitive and psychological engagement: Validation of the Student Engagement Instrument
Appleton, J. J., Christenson, S. L., Kim, D., & Reschly, A. L. (2006) · Journal of School Psychology · doi:10.1016/j.jsp.2006.04.002 · Cited by 1,858
Student Engagement and Student Learning: Testing the Linkages*
Carini, R. M., Kuh, G. D., & Klein, S. P. (2006) · Research in Higher Education · doi:10.1007/s11162-005-8150-9 · Cited by 1,782
Marks, H. M. (2000) · American Educational Research Journal · doi:10.2307/1163475 · Cited by 1,554
Academic success among students at risk for school failure
Finn, J. D., & Rock, D. A. (1997) · Journal of Applied Psychology · doi:10.1037/0021-9010.82.2.221 · Cited by 1,397
The first decade of the community of inquiry framework: A retrospective
Garrison, D. R., Anderson, T., & Archer, W. (2010) · The Internet and Higher Education · doi:10.1016/j.iheduc.2009.10.003 · Cited by 1,219
A Measure of College Student Course Engagement
Handelsman, M. M., Briggs, W. L., Sullivan, N., & Towler, A. (2005) · The Journal of Educational Research · doi:10.3200/joer.98.3.184-192 · Cited by 857
Engaging online learners: The impact of Web-based learning technology on college student engagement
Chen, P.-S. D., Lambert, A. D., & Guidry, K. R. (2010) · Computers & Education · doi:10.1016/j.compedu.2009.11.008 · Cited by 785 · cited 1×
“E-learning leads to positive learning outcomes, such as a high level of learning achievement and higher-order thinking abilities, because it allows for leaners to actively engage in learning anytime and anywhere [1,2].”
BackgroundA review of online course dropout research: implications for practice and future research
Lee, Y., & Choi, J. (2011) · Educational Technology Research and Development · doi:10.1007/s11423-010-9177-y · Cited by 747
Measuring Student Engagement in the Online Course: The Online Student Engagement Scale (OSE)
Dixson, M. D. (2015) · Online Learning · doi:10.24059/olj.v19i4.561 · Cited by 707 · cited 1×
“As suggested by Dixon [36], the factors of engagement in online learning included skills, emotion, participation, and performance.”
BackgroundSupporting Autonomy in the Classroom: Ways Teachers Encourage Student Decision Making and Ownership
Stefanou, C. R., Perencevich, K. C., DiCintio, M., & Turner, J. C. (2004) · Educational Psychologist · doi:10.1207/s15326985ep3902_2 · Cited by 707
New Benchmarks in Higher Education: Student Engagement in Online Learning
Robinson, C. C., & Hullinger, H. (2008) · Journal of Education for Business · doi:10.3200/joeb.84.2.101-109 · Cited by 618
Hu, S., & Kuh, G. D. (2002) · Research in Higher Education · doi:10.1023/a:1020114231387 · Cited by 565
Learning Engagement and Persistence in Massive Open Online Courses (MOOCS)
Jung, Y., & Lee, J. (2018) · Computers & Education · doi:10.1016/j.compedu.2018.02.013 · Cited by 514
Self-citationLife Satisfaction and Student Engagement in Adolescents
Lewis, A. D., Huebner, E. S., Malone, P. S., & Valois, R. F. (2011) · Journal of Youth and Adolescence · doi:10.1007/s10964-010-9517-6 · Cited by 493
Joo, Y. J., Lim, K. Y., & Kim, E. K. (2011) · Computers & Education · doi:10.1016/j.compedu.2011.02.008 · Cited by 397
Student engagement scale: development, reliability and validity
Gunuc, S., & Kuzu, A. (2015) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2014.938019 · Cited by 353
Horton, W. (2011) · Wiley eBooks · doi:10.1002/9781118256039 · Cited by 261
Supporting Self-Regulation in Student-Centered Web-Based Learning Environments
Dabbagh, N. H., & Kitsantas, A. (2004) · International journal on e-learning · Cited by 253
Connell, J. P., Halpem-Felsher, B. L., Clifford, E., Crichlow, W., & Usinger, P. (1995) · Journal of Adolescent Research · doi:10.1177/0743554895101004 · Cited by 246
Student Engagement: Developing a Conceptual Framework and Survey Instrument
Burch, G. F., Heller, N. A., Burch, J. J., Freed, R., & Steed, S. A. (2015) · Journal of Education for Business · doi:10.1080/08832323.2015.1019821 · Cited by 211
Changing teaching practices to promote achievement and bonding to school.
Abbott, R. D., O'Donnell, J., Hawkins, J. D., Hill, K. G., Kosterman, R., & Catalano, R. F. (1998) · American Journal of Orthopsychiatry · doi:10.1037/h0080363 · Cited by 182
Heaven, P. C. L., Mak, A. S., Barry, J., & Ciarrochi, J. (2002) · Personality and Individual Differences · doi:10.1016/s0191-8869(01)00041-1 · Cited by 161
Cho, M., & Cho, Y. (2013) · The Internet and Higher Education · doi:10.1016/j.iheduc.2013.10.008 · Cited by 155
Exploring intensive longitudinal measures of student engagement in blended learning
Henrie, C. R., Bodily, R., Manwaring, K. C., & Graham, C. R. (2015) · The International Review of Research in Open and Distributed Learning · doi:10.19173/irrodl.v16i3.2015 · Cited by 149
Problems in the Evaluation of Students and Student Disengagement from Secondary Schools.
Natriello, G. (1984) · Journal of research and development in education · Cited by 127
Student E-Learning Intrinsic Motivation: A Qualitative Analysis
Shroff, R. H., Vogel, D., Coombes, J. E., & Lee, F. (2007) · Communications of the Association for Information Systems · doi:10.17705/1cais.01912 · Cited by 123
Nash Unsworth, A., Brewer, G. A., & Spillers, G. J. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.5.931 · Cited by 118
Hu, S., Kuh, G. D., & Li, S. (2008) · Innovative Higher Education · doi:10.1007/s10755-008-9066-z · Cited by 113
Student-led action for sustainability in higher education: a literature review
Murray, J. (2018) · International Journal of Sustainability in Higher Education · doi:10.1108/ijshe-09-2017-0164 · Cited by 109
Li, F., Qi, J., Wang, G., & Wang, X. (2014) · International Journal of Emerging Technologies in Learning (iJET) · doi:10.3991/ijet.v9i2.3268 · Cited by 78
Kim, T.-D., Yang, M.-Y., Bae, J., Min, B.-A., Lee, I., & Kim, J. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2016.09.019 · Cited by 78
Guidelines for Item Selection in Inventories Yielding Score Profiles
Meir, E. I., & Gati, I. (1981) · Educational and Psychological Measurement · doi:10.1177/001316448104100409 · Cited by 71
The impact of student retention strategies: an empirical study
Leeds, E., Campbell, S., Baker, H., Ali, R., Brawley, D., & Crisp, J. (2013) · International Journal of Management in Education · doi:10.1504/ijmie.2013.050812 · Cited by 63
Critical Success Factors for the Online Learner
Golladay, R. M., Prybutok, V. R., & Huff, R. A. (2000) · Journal of Computer Information Systems · doi:10.1080/08874417.2000.11647468 · Cited by 54
The competencies required for effective performance in a university e-learning environment
Parkes, M., Reading, C., & Stein, S. J. (2013) · Australasian Journal of Educational Technology · doi:10.14742/ajet.38 · Cited by 32
Research works printed but not linked: 2
- Newmann, F.M. (1992). Student Engagement and Achievement in American Secondary Schools, Teachers College Press.
- Choi, 2013, The extent of and reasons for non-re-enrollment: A case of Korea National Open University, Int. Rev. Res. Open Distrib. Learn., 14, 19
Cited by
El-Sabagh, H. A. (2021) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-021-00289-4 · Cited by 566
Rajabalee, Y. B., & Santally, M. I. (2021) · Education and Information Technologies · doi:10.1007/s10639-020-10375-1 · Cited by 381
Kim, S., & Kim, D.-J. (2021) · Sustainability · doi:10.3390/su13126734 · Cited by 107
“[38] reported that peer collaboration and interaction with instructors are elements reflected in student engagement in online courses.”
BackgroundPersonalisation methods in e-learning-A literature review
Mikić, V., Ilić, M., Kopanja, L., & Vesin, B. (2022) · Computer Applications in Engineering Education · doi:10.1002/cae.22566 · Cited by 39
“This category contains reviews that highlight motivation and engagement [89, 165], contribute to effective learning and teaching [106], provide positive social effects [236], identify students at risk [36] and provide positive pedagogical effects [37].”
BackgroundUsing narrative inquiry research methodology in online educational environments
Rice, M. F. (2024) · Educational technology research and development · doi:10.1007/s11423-023-10260-x · Cited by 6
“Engagement in a cognitive frame is defined as an individual mental effort to use strategies to learn from materials that are presented (Lee et al., 2019; Li & Lajoie, 2021).”
Metadata
- Authors
- Lee, J., Song, H.-D., & Hong, A. J.
- Affiliations
- Department of Education, College of Education, Chung-Ang University, Seoul 06974, Korea
- Chung-Ang University (KR)
- Corresponding author
- Song, Hae-Deok
- ORCID
- Hong, Ah Jeong
- Venue
- Sustainability
- Publisher
- MDPI AG
- Published
- 2019-02-14
- Volume
- 11
- Issue
- 4
- Pages
- 985
- ISSN
- 2071-1050 (ISSN-L)
- OpenAlex
- W2911930513
- Cited by
- 323
- References
- 42
- Citations by year
- 2026: 14 · 2025: 46 · 2024: 45 · 2023: 74 · 2022: 67 · 2021: 51 · 2020: 18 · 2019: 7
- FWCI
- 96.56
- Type
- journal article
- Language
- en
- Open access
- gold
- dx.doi.org
- Licence
- Locations
- Sustainability (publishedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Ministry of Education of the Republic of Korea and the National Research Foundations of Korea (NRF-2017S1A3A2066878)
- Topics
- Social Sciences › Education › Online and Blended Learning
- Physical Sciences › Computer Science › Computer Science Applications › Online Learning and Analytics
- Social Sciences › Education › Technology-Enhanced Education Studies
- Keywords
- student engagement, online learning, sustainable engagement, motivation, peer collaboration, cognitive problem solving, instructor-student interaction, online learning communities, learning management, online university students, school dropout prevention
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.