Predicting student satisfaction of emergency remote learning in higher education during COVID-19 using machine learning techniques
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
Despite the wide adoption of emergency remote learning (ERL) in higher education during the COVID-19 pandemic, there is insufficient understanding of influencing factors predicting student satisfaction for this novel learning environment in crisis. The present study investigated important predictors in determining the satisfaction of undergraduate students (N = 425) from multiple departments in using ERL at a self-funded university in Hong Kong while Moodle and Microsoft Team are the key learning tools. By comparing the predictive accuracy between multiple regression and machine learning models before and after the use of random forest recursive feature elimination, all multiple regression, and machine learning models showed improved accuracy while the most accurate model was the elastic net regression with 65.2% explained variance. The results show only neutral (4.11 on a 7-point Likert scale) regarding the overall satisfaction score on ERL. Even majority of students are competent in technology and have no obvious issue in accessing learning devices or Wi-Fi, face-to-face learning is more preferable compared to ERL and this is found to be the most important predictor. Besides, the level of efforts made by instructors, the agreement on the appropriateness of the adjusted assessment methods, and the perception of online learning being well delivered are shown to be highly important in determining the satisfaction scores. The results suggest that the need of reviewing the quality and quantity of modified assessment accommodated for ERL and structured class delivery with the suitable amount of interactive learning according to the learning culture and program nature.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
The DeLone and McLean Model of Information Systems Success: A Ten-Year Update
(2003) · Journal of Management Information Systems · doi:10.1080/07421222.2003.11045748 · Cited by 11,791 · cited 2×
“, (2020), the direct association between system quality and student satisfaction was assumed in the original model of Delone and Mclean (2003) [8, 34].”
BackgroundMethodThe Difference between Emergency Remote Teaching and Online Learning
Hodges, C. B., Moore, S., Lockee, B. B., Trust, T., & Bond, M. A. (2024) · Handbook of Research in Online Learning · doi:10.1163/9789004702813_021 · Cited by 6,253
Eating habits and lifestyle changes during COVID-19 lockdown: an Italian survey.
Di Renzo, L., Gualtieri, P., Pivari, F., Soldati, L., Attinà, A., Cinelli, G., Leggeri, C., Caparello, G., Barrea, L., Scerbo, F., et al. (2020) · Journal of Translational Medicine · doi:10.1186/s12967-020-02399-5 · Cited by 2,234 · cited 14×
“To what extent do the predictors of six constructs (readiness, accessibility, instructor related factors, assessment-related factors, learning-related factors, and self-concern) predict student satisfaction using ERL during the COVID-19 pandemic?”
BackgroundInfluentialImpacts of the COVID-19 pandemic on life of higher education students: A global perspective
Aristovnik, A., Keržič, D., Ravšelj, D., Tomaževič, N., & Umek, L. (2020) · Sustainability · doi:10.3390/su12208438 · Cited by 2,047
Evaluating E-learning systems success: An empirical study
Al-Fraihat, D., Joy, M., Masa'deh, R., & Sinclair, J. (2020) · Computers in Human Behavior · doi:10.1016/j.chb.2019.08.004 · Cited by 1,350
College students’ use and acceptance of emergency online learning due to COVID-19
Patricia Aguilera-Hermida, A. (2020) · International Journal of Educational Research Open · doi:10.1016/j.ijedro.2020.100011 · Cited by 1,286 · cited 1×
“Also, self-efficacy, defined as the individuals’ belief in their own ability to perform a certain task, challenge or successfully engage with educational technology [38, 39], showed to be interconnected with student satisfaction levels [40].”
BackgroundKuo, Y.-C., Walker, A. E., Schroder, K. E. E., & Belland, B. R. (2014) · The Internet and Higher Education · doi:10.1016/j.iheduc.2013.10.001 · Cited by 1,082
Murphy, M. P. A. (2020) · Contemporary Security Policy · doi:10.1080/13523260.2020.1761749 · Cited by 1,032
Abdullah, F., & Ward, R. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2015.11.036 · Cited by 986 · cited 1×
“Apart from the aforementioned models, other technology acceptance and Elearning quality models have been developed with an emphasis on usefulness and ease of use [8, 35].”
BackgroundKintu, M. J., Zhu, C., & Kagambe, E. (2017) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-017-0043-4 · Cited by 764
Predicting student satisfaction and perceived learning within online learning environments
Alqurashi, E. (2019) · Distance Education · doi:10.1080/01587919.2018.1553562 · Cited by 697
Staying Engaged: Knowledge and Research Needs in Student Engagement
Wang, M.-T., & Degol, J. (2014) · Child Development Perspectives · doi:10.1111/cdep.12073 · Cited by 420 · cited 1×
“Also, self-efficacy, defined as the individuals’ belief in their own ability to perform a certain task, challenge or successfully engage with educational technology [38, 39], showed to be interconnected with student satisfaction levels [40].”
BackgroundAbu Saa, A., Al-Emran, M., & Shaalan, K. (2019) · Technology, Knowledge and Learning · doi:10.1007/s10758-019-09408-7 · Cited by 229
Zihni, E., Madai, V. I., Livne, M., Galinovic, I., Khalil, A. A., Fiebach, J. B., & Frey, D. (2020) · PLOS ONE · doi:10.1371/journal.pone.0231166 · Cited by 187
On students’ (mis)judgments of learning and teaching effectiveness.
Carpenter, S. K., Witherby, A. E., & Tauber, S. K. (2020) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2019.12.009 · Cited by 183
Self–efficacy and student satisfaction in the context of blended learning courses
Prifti, R. (2022) · Open Learning: The Journal of Open, Distance and e-Learning · doi:10.1080/02680513.2020.1755642 · Cited by 175
Application of Improved LightGBM Model in Blood Glucose Prediction
Wang, Y., & Wang, T. (2020) · Applied Sciences · doi:10.3390/app10093227 · Cited by 129 · cited 6×
“After data pre-processing, conventional and stepwise multiple linear regression was developed with R in Rstudio (version 1.2.5001), while machine learning models including KNN, SVR, MLPR, LightGBM, RF, and ENet regression were built using Jupyter Notebook with the scikit-learn package in Python 3.”
BackgroundMethodInfluentialMUZAMMIL, M., SUTAWIJAYA, A., & HARSASI, M. (2020) · Turkish Online Journal of Distance Education · doi:10.17718/tojde.770928 · Cited by 128
Power Distance in Online Learning: Experience of Chinese Learners in U.S. Higher Education
Zhang, Y. (. (2013) · The International Review of Research in Open and Distributed Learning · doi:10.19173/irrodl.v14i4.1557 · Cited by 75
Cited by
Bond, M., Khosravi, H., De Laat, M., Bergdahl, N., Negrea, V., Oxley, E., Pham, P., Chong, S. W., & Siemens, G. (2024) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-023-00436-z · Cited by 852
“…accuracy of their ML model, allowing them to predict student satisfaction with online education with nearly perfect accuracy, and the second (Ho et al., 2021) investigated the most important predictors in determining the satisfaction of undergraduate students during the COVID-19 pandemic…”
BackgroundGuleria, P., & Sood, M. (2023) · Education and Information Technologies · doi:10.1007/s10639-022-11221-2 · Cited by 178
“During COVID-19 crises, remote learning has facilitated the students in achieving higher education and ML techniques have been implemented for predicting student satisfaction with the online learning models (Ho et al., 2021).”
MethodRangel-de Lázaro, G., & Duart, J. M. (2023) · Sustainability · doi:10.3390/su15043507 · Cited by 95
A systematic review on machine learning models for online learning and examination systems
Kaddoura, S., Popescu, D. E., & Hemanth, J. D. (2022) · PeerJ Computer Science · doi:10.7717/peerj-cs.986 · Cited by 75
Metadata
- Authors
- Ho, I. M. K., Cheong, K. Y., & Weldon, A.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2021-04-02
- Volume
- 16
- Issue
- 4
- Pages
- e0249423
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W3144626303
- Cited by
- 208
- References
- 21
- FWCI
- 70.79
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.