Measuring Learner Satisfaction of an Adaptive Learning System
Open accessThe DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Abstract
Tertiary educational institutions have continually implemented various educational technologies to support student learning. An example is adaptive learning systems, within which learners take ownership of their learning experience and accelerate future learning. Despite the importance of considering learner satisfaction in the development of such systems given how it has been widely acknowledged as an indication of the success of e-learning systems, research in the area of adaptive learning technologies for education has concentrated more on tailoring instruction to implement personalised learning. A review of instruments measuring learner satisfaction of virtual learning environments found that the learner satisfaction questionnaire (LSQ) that was developed to measure learner satisfaction of e-learning systems, and preliminarily validated by means of exploratory factor analysis, was most suitable for adaptation. This study sought to adapt and validate the LSQ for the purpose of measuring learner satisfaction of an adaptive learning system developed in-house. A total of 121 tertiary students recruited via availability sampling took part in this study. Hierarchical confirmatory factor analysis was performed as part of the validation. Results presented the adapted LSQ as a 14-item instrument that can be readily deployed on a broad scale basis. The adapted LSQ also yielded valid and reliable satisfaction scores both at the subscale as well as the overall scale level. Practical implications are discussed, noting that such scores could inform the further development and refinement of AdLeS or similar systems, with the view of benefiting students.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“High satisfaction leads to lower drop-out rates and higher persistence”
From Using an adaptive learning tool to improve student performance and satisfaction in online and face-to-face education for a more personalized approach (2024) · cites this paper as Lim et al., 2022
The cited source says what the claim attributes to it.
In the citing paper
“Adaptive learning technology for education has focused on personalized instruction, but not enough on learner satisfaction as a key indicator of success (Lim et al., 2022).”
From Using an adaptive learning tool to improve student performance and satisfaction in online and face-to-face education for a more personalized approach (2024) · cites this paper as Lim et al., 2022
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788 · cited 1×
“Confirmatory factor models within this study were evaluated on the basis of recommendations by [52,56,57].”
MethodThe DeLone and McLean Model of Information Systems Success: A Ten-Year Update
(2003) · Journal of Management Information Systems · doi:10.1080/07421222.2003.11045748 · Cited by 11,791
Information Systems Success: The Quest for the Dependent Variable
DeLone, W. H., & McLean, E. R. (1992) · Information Systems Research · doi:10.1287/isre.3.1.60 · Cited by 10,697
Wolf, E. J., Harrington, K. M., Clark, S. L., & Miller, M. W. (2013) · Educational and Psychological Measurement · doi:10.1177/0013164413495237 · Cited by 3,931
A Theoretical Integration of User Satisfaction and Technology Acceptance
Wixom, B. H., & Todd, P. A. (2005) · Information Systems Research · doi:10.1287/isre.1050.0042 · Cited by 2,835 · cited 1×
“The empirical research of [22] reported that user satisfaction and acceptance should be considered when researching users’ perceptions on any information system.”
Background(1995) · Cited by 1,801
The SAGE Encyclopedia of Educational Research, Measurement, and Evaluation
Frey, B. B. (2018) · doi:10.4135/9781506326139 · Cited by 1,471 · cited 1×
“Following stage 1, the LSQ-adapted (LSQa) was administered to participants recruited on the basis of availability sampling [51]; ethics approval was sought from the university institution review board before participants were asked to complete the LSQa voluntarily.”
MethodMeasuring e-Commerce Success: Applying the DeLone & McLean Information Systems Success Model
DeLone, W. H., & McLean, E. R. (2004) · International Journal of Electronic Commerce · doi:10.1080/10864415.2004.11044317 · Cited by 1,399
Kuo, Y.-C., Walker, A. E., Schroder, K. E. E., & Belland, B. R. (2014) · The Internet and Higher Education · doi:10.1016/j.iheduc.2013.10.001 · Cited by 1,082 · cited 1×
“[43] Kuo et al. (2014) 221 participants from undergraduate and graduate online classes - Learner–content interaction - Learner–instructor interaction Five-item subscale on learner satisfaction focussed on satisfaction about course (e.g., this course contributed to my educational development; in the…”
BackgroundA study of student satisfaction in a blended e-learning system environment
Wu, J.-H., Tennyson, R. D., & Hsia, T.-L. (2010) · Computers & Education · doi:10.1016/j.compedu.2009.12.012 · Cited by 1,001 · cited 1×
“[46] Wu et al. (2010) 212 participants from blended e-learning course - Performance expectations - Learning climate - Learning satisfaction - Interaction - Content feature - System functionality - Computer self-efficacy 21-item questionnaire across seven subscales with one subscale of four items on…”
BackgroundPaechter, M., Maier, B., & Macher, D. (2010) · Computers & Education · doi:10.1016/j.compedu.2009.08.005 · Cited by 731 · cited 1×
“[45] Paechter et al. (2010) 2196 participants using an e-learning system - Clarity of the course structure - Pace of learning - Opportunities for self-regulated learning and collaborative learning - Tasks results Learner satisfaction was reflected by learner expectations and assessment of course…”
MethodAssessment of learner satisfaction with asynchronous electronic learning systems
Wang, Y.-S. (2003) · Information & Management · doi:10.1016/s0378-7206(03)00028-4 · Cited by 718 · cited 10×
“CFA served to assess the dimensionality of the LSQa and determine the appropriateness of the factorial structure established through exploratory factor analysis proffered by [47].”
BackgroundMethodInfluentialE-learning success determinants: Brazilian empirical study
Cidral, W. A., Oliveira, T., Di Felice, M., & Aparicio, M. (2018) · Computers & Education · doi:10.1016/j.compedu.2017.12.001 · Cited by 639
Higher Education Students' Attitudes to Student-centred Learning: Beyond 'educational bulimia'?
Lea, S. J., Stephenson, D., & Troy, J. (2003) · Studies in Higher Education · doi:10.1080/03075070309293 · Cited by 584 · cited 1×
“Given this, a student-centred context for adult learners is essential as it focuses on learning experience [4], individual interest, and autonomy; in doing so, a student-centred context supports understanding and deep learning [5,6].”
BackgroundThe acceptance and use of computer based assessment
Terzis, V., & Economides, A. A. (2011) · Computers & Education · doi:10.1016/j.compedu.2010.11.017 · Cited by 443 · cited 1×
“While the measures in Table 1 attempted to address learner satisfaction, some presented subscales were associated with the computer-based assessment acceptance model (CBAAM) proffered by [48] (e.”
MethodAbuhassna, H., Al-Rahmi, W. M., Yahya, N., Zakaria, M. A. Z. M., Kosnin, A. B. M., & Darwish, M. (2020) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-020-00216-z · Cited by 411 · cited 1×
“However, there are challenges with online technologies such as unsatisfying interactions [11].”
BackgroundWalkington, C. A. (2013) · Journal of Educational Psychology · doi:10.1037/a0031882 · Cited by 322 · cited 1×
“With adaptive learning systems, learners could take ownership of their learning experience [9] and accelerate future learning [10].”
BackgroundAl-Samarraie, H., Teng, B. K., Alzahrani, A. I., & Alalwan, N. (2018) · Studies in Higher Education · doi:10.1080/03075079.2017.1298088 · Cited by 321 · cited 1×
“[32,33] highlighted the use of users’ continued satisfaction as an indication of success of an e-learning system.”
BackgroundYükseltürk, E., & Yıldırım, Z. (2008) · OpenMETU (Middle East Technical University) · Cited by 237
Ali, A., & Ahmad, I. (2011) · Contemporary Educational Technology · doi:10.30935/cedtech/6047 · Cited by 231
Validation of the DeLone and McLean Information Systems Success Model
Ojo, A. I. (2017) · Healthcare Informatics Research · doi:10.4258/hir.2017.23.1.60 · Cited by 221
Assessing the success behind the use of education management information systems in higher education
Martins, J., Branco, F., Gonçalves, R., Au-Yong-Oliveira, M., Oliveira, T., Naranjo-Zolotov, M., & Cruz-Jesus, F. (2019) · Telematics and Informatics · doi:10.1016/j.tele.2018.10.001 · Cited by 204 · cited 1×
“[32,33] highlighted the use of users’ continued satisfaction as an indication of success of an e-learning system.”
BackgroundYakubu, N., & dasuki, S. (2018) · Journal of Information Technology Education: Research · doi:10.28945/4077 · Cited by 191
Instructor Presence in Online Courses and Student Satisfaction
Ladyshewsky, R. K. (2013) · International Journal for the Scholarship of Teaching and Learning · doi:10.20429/ijsotl.2013.070113 · Cited by 179 · cited 1×
“[44] Ladyshewsky (2013) Post graduate participants from six online courses with class sizes averaging around 35 students - Instructor’s presence in areas of feedback - Quality of teaching - Facilitation of productive discourse Learner satisfaction data (11 items) was collected using the…”
MethodStudent-centred learning: a humanist perspective
Tangney, S. (2013) · Teaching in Higher Education · doi:10.1080/13562517.2013.860099 · Cited by 175 · cited 1×
“Given this, a student-centred context for adult learners is essential as it focuses on learning experience [4], individual interest, and autonomy; in doing so, a student-centred context supports understanding and deep learning [5,6].”
BackgroundSalam, M., & Farooq, M. S. (2020) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-020-00189-z · Cited by 173 · cited 2×
“[39] Salam and Farooq (2020) 120 undergraduate students using an online information-based system - System quality - Service quality - High sociability quality Four-item subscale (e.”
MethodCitizens’ intention to use and recommend e-participation: Drawing upon UTAUT and citizen empowerment
Naranjo-Zolotov, M., Oliveira, T., & Casteleyn, S. (2019) · Information Technology & People · doi:10.1108/itp-08-2017-0257 · Cited by 164 · cited 1×
“Researchers have indicated that success of an e-learning system can be measured with learners’ satisfaction and intention to adopt it for a longer period of time [31].”
BackgroundMtebe, J. S., & Raphael, C. (2018) · Australasian Journal of Educational Technology · doi:10.14742/ajet.2993 · Cited by 156 · cited 2×
“[40] proposed that learner satisfaction could be measured via five subscales (i.”
BackgroundFramework to improve e-learner satisfaction and further strengthen e-learning implementation
Asoodar, M., Vaezi, S., & Izanloo, B. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2016.05.060 · Cited by 150 · cited 2×
“[42] concluded, on the basis of a 132-item”
BackgroundMethodTsai, W.-H., Lee, P., Shen, Y.-S., & Lin, H.-L. (2011) · Information & Management · doi:10.1016/j.im.2011.09.007 · Cited by 140 · cited 1×
“[23,24] concurred with similar viewpoints by postulating that user satisfaction is one of the most important factors when addressing the success of an information system.”
BackgroundSystem Characteristics, Satisfaction and E-Learning Usage: A Structural Equation Model (SEM)
Ramayah, T., & Lee, J. W. C. (2012) · The Turkish Online Journal of Educational Technology · Cited by 112
A Review of Personalised E-Learning: Towards Supporting Learner Diversity
O’Donnell, E., Lawless, S., Sharp, M., & Wade, V. P. (2015) · International Journal of Distance Education Technologies · doi:10.4018/ijdet.2015010102 · Cited by 98
Examining First- and Second-Order Factor Structures for News Credibility
Yale, R. N., Jensen, J. D., Carcioppolo, N., Sun, Y., & Liu, M. (2015) · Communication Methods and Measures · doi:10.1080/19312458.2015.1061652 · Cited by 90 · cited 1×
“Owing to this, a three-factor second-order CFA was performed restricting correlation between factors; performing a second-order CFA was also considerably more viable when the first-order CFA returned discriminant validity issues [59].”
MethodXu, F., & Du, J. T. (2019) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2019.102072 · Cited by 87
Tawafak, R. M., Romli, A. B., & Arshah, R. A. (2018) · IEEE Access · doi:10.1109/access.2018.2877760 · Cited by 85 · cited 1×
“[36] Tawafak et al. (2018) 295 undergraduates using an e-learning system - Learners’ perceived usefulness - Learners’ perceived ease of use - Learners’ satisfaction affects continued intention to use 35-item questionnaire across 12 subscales with one subscale of two items on learner satisfaction.”
MethodYazon, J. M. O., Mayer-Smith, J. A., & Redfield, R. J. (2002) · Computers & Education · doi:10.1016/s0360-1315(01)00081-1 · Cited by 83 · cited 1×
“With adaptive learning systems, learners could take ownership of their learning experience [9] and accelerate future learning [10].”
BackgroundThe comparison of students’ satisfaction between ubiquitous and web-basedlearning environments
Virtanen, M. A., Kääriäinen, M., Liikanen, E., & Haavisto, E. (2016) · Education and Information Technologies · doi:10.1007/s10639-016-9561-2 · Cited by 75 · cited 1×
“[41] Virtanen et al. (2017) 115 students using virtual and digital learnings - Diverse, motivational, and clear supportive learning material - Easy to use and re-use learning content 24-item questionnaire across five subscales.”
BackgroundAdaptive Learning Technology Relationship with Student Learning Outcomes
White, G. L. (2020) · Journal of Information Technology Education Research · doi:10.28945/4526 · Cited by 74 · cited 1×
“To promote student-centred contexts, adaptive learning systems have been merged with conventional didactic lectures to enhance active learning via blended learning [7]; adaptive learning systems can assist learners and provide them a dynamic learning experience capable of enhancing satisfaction, motivation, and potent…”
BackgroundUniversity Student Perceptions of Technology Use in Mathematics Learning
Zogheib, B., Rabaa’i, A. A., Zogheib, S., & Saheli, A. E. (2015) · Journal of Information Technology Education Research · doi:10.28945/2315 · Cited by 63 · cited 1×
“self-efficacy lead to user intentions of utilising learning systems [13,14].”
BackgroundUbiquitous learning: Determinants impacting learners’ satisfaction and performance with smartphones
Jung, H.-J. (2014) · Language Learning & Technology · doi:10.64152/10125/44386 · Cited by 62
Forster, Y., Hergeth, S., Naujoks, F., Krems, J. F., & Keinath, A. (2019) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2019.11.017 · Cited by 57
Albert, A., & Hallowel, M. R. (2013) · Construction Economics and Building · doi:10.5130/ajceb.v13i3.3178 · Cited by 47
Examining Students' Satisfaction and Learning Autonomy through Web-Based Courses
Abuhassna, H. (2020) · International Journal of Advanced Trends in Computer Science and Engineering · doi:10.30534/ijatcse/2020/53912020 · Cited by 44 · cited 1×
“[35] found that student background, experience, collaboration, interaction, and autonomy affected student satisfaction.”
BackgroundA Rasch Analysis of Students’ Academic Motivation toward Mathematics in an Adaptive Learning System
Lim, L., Lim, S. H., & Lim, W.-Y. (2022) · Behavioral Sciences · doi:10.3390/bs12070244 · Cited by 31
Self-citationBi, T., Lyons, R. M., Fox, G., & Muntean, G. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.3025669 · Cited by 30
What Influences Internet-Based Learning?
Liao, P., & Hsieh, J. Y. (2011) · Social Behavior and Personality An International Journal · doi:10.2224/sbp.2011.39.7.887 · Cited by 29 · cited 1×
“It refers to a learner’s personal feelings about the learning process in which satisfaction and positive feelings are generated and experienced during learning activities and reflects how students perceive their learning experiences associated with programme quality, evaluation, and studentrelated outcomes [26,27].”
BackgroundWhat is student centredness and is it enough?
Taylor, J. A. (2013) · Student Success · doi:10.5204/intjfyhe.v4i2.168 · Cited by 25
Ho, Y. Y., & Lim, L. (2020) · Higher Education Research & Development · doi:10.1080/07294360.2020.1818062 · Cited by 20 · cited 1×
“However, after being away from the classroom for some time, adult learners might encounter learning roadblocks and subsequently experience difficulties in learning [1].”
BackgroundSelf-citationLim, L., & Chapman, E. (2022) · SAGE Open · doi:10.1177/21582440221085271 · Cited by 18 · cited 1×
“As the sample presented modest non-normalities, the maximum likelihood with Satorra–Bentler scaled chi-squared statistic for model fit that adjusts the chi-squared statistic and standard errors for data non-normality was used for more precise goodness-of-fit statistics [49,58].”
MethodSelf-citation(2018) · The SAGE Encyclopedia of Educational Research, Measurement, and Evaluation · doi:10.4135/9781506326139.n155 · Cited by 14
The influence of staff use of a virtual learning environment on student satisfaction
Graven, O. H., Helland, M., & MacKinnon, L. (2006) · International Conference on Information Technology Based Higher Education and Training (ITHET) · doi:10.1109/ithet.2006.339794 · Cited by 9 · cited 1×
“[37] pointed out that different applications of technologies in higher education could directly or indirectly interfere with learner academic performance and”
BackgroundLim, L. (2019) · Journal of Psychoeducational Assessment · doi:10.1177/0734282919828464 · Cited by 5 · cited 2×
“As the sample presented modest non-normalities, the maximum likelihood with Satorra–Bentler scaled chi-squared statistic for model fit that adjusts the chi-squared statistic and standard errors for data non-normality was used for more precise goodness-of-fit statistics [49,58].”
MethodSelf-citationA Technology Integration Framework and Co-operative Reflection Model for Service Learning
Salam, M. (2020) · Unimas Institutional Repository (Universiti Malaysia Sarawak) · Cited by 5
Research works printed but not linked: 7
- Knowles, M.S., Holton, E.F., and Swanson, R.A. (2011). The Adult Learner: The Definitive Classic in Adult Education and Human Resource Development, Elsevier Inc.. [7th ed.].
- Mardiana, 2015, DeLone-McLean information system success model revisited: The separation of intention to use and the integration of technology acceptance models, Int. J. Econ. Financ. Issues, 5, 172
- Debourgh, G. (2022, May 30). Technology is the Tool, Teaching is the Task: Student Satisfaction in Distance Learning, Proceedings of the Society for Information and Technology & Teacher Education International Conference, Available online: http://files.eric.ed.gov/fulltext/ED432226.pdf.
- Hair, J.F., Black, W.C., Babin, B.J., and Anderson, R.E. (2019). Multivariate Data Analysis Eight Edition, Cengage.
- Kline, R.B. (2010). Principles and Practice of Structural Equation Modelling, Guilford Press. [3rd ed.].
- Brown, T.A. (2015). Confirmatory Factor Analysis for Applied Research, The Guildford Press.
- Edsurge (2016). Decoding Adaptive, Pearson.
Cited by
Artificial intelligence-enabled adaptive learning platforms: A review
Tan, L. Y., Hu, S., Yeo, D. J., & Cheong, K. H. (2025) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2025.100429 · Cited by 207
Contrino, M. F., Reyes-Millán, M., Vázquez-Villegas, P., & Membrillo-Hernández, J. (2024) · Smart Learning Environments · doi:10.1186/s40561-024-00292-y · Cited by 158
“Adaptive learning technology for education has focused on personalized instruction, but not enough on learner satisfaction as a key indicator of success (Lim et al., 2022).”
BackgroundKlar, M. (2025) · Smart Learning Environments · doi:10.1186/s40561-025-00385-2 · Cited by 39
“Furthermore, seven items were included to measure affective and evaluative aspects of the participants’ experience, including adaptations from Lim et al. (2022).”
Kim, H., Hwang, J., Kim, T.-Y., Choi, M., Lee, D., & Ko, J. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2531267 · Cited by 42
“While learning achievement represents objective outcomes, satisfaction is a subjective indicator of learners ’ positive sentiments about the process (Lim et al., 2022).”
Hu, C., Li, F., Wang, S., Gao, Z., Pan, S. L., & Qing, M. (2025) · Cogent Education · doi:10.1080/2331186x.2025.2490425 · Cited by 31
“This level of customization ensures that each student receives the support they need to succeed, rather than relying on generalized teaching methods (Lim et al., 2022).”
Metadata
- Authors
- Lim, L., Lim, S. H., & Lim, R. W. Y.
- Affiliations
- Singapore University of Social Sciences (SG)
- Corresponding author
- Lim, Lyndon
- Venue
- Behavioral Sciences
- Publisher
- MDPI AG
- Published
- 2022-07-30
- Volume
- 12
- Issue
- 8
- Pages
- 264
- ISSN
- 2076-328X (ISSN-L)
- PMC
- PMC9404708
- OpenAlex
- W4289109864
- Cited by
- 37
- References
- 52
- Citations by year
- 2026: 8 · 2025: 9 · 2024: 10 · 2023: 9 · 2022: 1
- FWCI
- 15.64
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Behavioral Sciences (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Ministry of Education, Singapore, under its Tertiary Education Research Fund (MOE2020-TRF-012)
- Topics
- Social Sciences › Education › Online and Blended Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Physical Sciences › Computer Science › Computer Science Applications › Online Learning and Analytics
- Keywords
- student satisfaction, adaptive learning systems, instrument adaptation, scale validation, e-learning systems, virtual learning environments, personalized learning, tertiary students
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
