The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Perceived satisfaction of university students with the use of chatbots as a tool for self-regulated learning
Open accessAbstract
Chatbots are a promising resource for giving students feedback and helping them deploy metacognitive strategies in their learning processes. In this study we worked with a sample of 57 university students, 42 undergraduate and 15 Master's degree students in Health Sciences. A mixed research methodology was applied. The quantitative study analysed the influence of the variables educational level (undergraduate vs. master's degree) and level of prior knowledge on the frequency of chatbot use (low vs. average), learning outcomes, and satisfaction with the chatbot's usefulness. In addition, we examined whether the frequency of chatbot use depended on students' metacognitive strategies. The qualitative study analysed the students' suggestions for improvement to the chatbot and the type of questions it used. The results indicated that the level of degree being studied influenced the frequency of chatbot use and learning outcomes, with Master's students exhibiting higher levels of both, but levels of prior knowledge only influenced learning outcomes. Significant differences were also found in students' perceived satisfaction with the use of the chatbot, with Master's students scoring higher, but not with respect to the level of prior knowledge. No conclusive results were found regarding frequency of chatbot use and the levels of students' metacognitive strategies. Further studies are needed to guide this research based on the students' suggestions for improvement.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Figures







Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The study found that master’s students demonstrated higher learning gains and used the chatbot more frequently than bachelor’s students.”
From Digital affordances of AI chatbots in nursing education: a systematic review of learning gains and gaps in the evidence (2026) · cites this paper as [28]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Personalization (n = 4) by AI chatbots, through timely feedback, have shown a significant impact on students’ diagnostic skills, engagement, and frequency of chatbot use (19, 28, 44).”
From Digital affordances of AI chatbots in nursing education: a systematic review of learning gains and gaps in the evidence (2026) · cites this paper as [28]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Similarly, personalization (n = 3) by AI chatbots was found to significantly enhance nursing students’ prior knowledge and academic performance (25, 28).”
From Digital affordances of AI chatbots in nursing education: a systematic review of learning gains and gaps in the evidence (2026) · cites this paper as [28]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Sáiz-Manzanares et al. (28), employing a mixed-methods approach, found that students with moderate prior knowledge and those pursuing master’s degrees showed superior learning gains.”
From Digital affordances of AI chatbots in nursing education: a systematic review of learning gains and gaps in the evidence (2026) · cites this paper as [28]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Additionally, with the rapid advancements in nursing research and the advent of new diseases and medications, nursing professionals are challenged to quickly adapt to evolving medical knowledge, make accurate decisions in real-case scenarios, and master complex nursing skills (1, 17, 26–28).”
From Digital affordances of AI chatbots in nursing education: a systematic review of learning gains and gaps in the evidence (2026) · cites this paper as [28]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
- STATISTICAL PACKAGE FOR SOCIAL SCIENCES
Reddy, M. V. (2014) · Apple Academic Press eBooks · doi:10.1201/b17560-26 · Cited by 12,121
I.—COMPUTING MACHINERY AND INTELLIGENCE
TURING, A. M. (1950) · Mind · doi:10.1093/mind/lix.236.433 · Cited by 10,290 · cited 1×
“The design of chatbots can be traced back to the work of Weizenbaum [51] which was developed from Turing’s [52] emulation and which was applied to the context of patient-therapist interaction [53].”
MethodDesigning Qualitative Research
Flick, U. (2008) · SAGE Publications Ltd eBooks · doi:10.4135/9781849208826 · Cited by 9,067
Cohen, J. (1992) · Current Directions in Psychological Science · doi:10.1111/1467-8721.ep10768783 · Cited by 5,870
ELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452
Handbook of Self-Regulation of Learning and Performance
Schunk, D. H. (2011) · Routledge eBooks · doi:10.4324/9780203839010 · Cited by 2,191
Metacognition and learning: conceptual and methodological considerations
Veenman, M. V. J., Van Hout-Wolters, B. H. A. M., & Afflerbach, P. (2006) · Metacognition and Learning · doi:10.1007/s11409-006-6893-0 · Cited by 2,023
Designing qualitative research
Fu, Y. (2011) · Organization Management Journal · doi:10.1057/omj.2011.23 · Cited by 1,140
Handbook of Research on Learning and Instruction
Mayer, R. E., & Alexander, P. A. (2011) · Routledge eBooks · doi:10.4324/9780203839089 · Cited by 969
Chatbots for learning: A review of educational chatbots for the Facebook Messenger
Smutny, P., & Schreiberova, P. (2020) · Computers & Education · doi:10.1016/j.compedu.2020.103862 · Cited by 770
Self-Regulated Learning and Performance : An Introduction and an Overview
Zimmerman, B. J., & Schunk, D. H. (2011) · doi:10.4324/9780203839010-4 · Cited by 469
The relation between intellectual and metacognitive skills from a developmental perspective
Veenman, M. V. J., Wilhelm, P., & Beishuizen, J. J. (2004) · Learning and Instruction · doi:10.1016/j.learninstruc.2003.10.004 · Cited by 430
Essel, H. B., Vlachopoulos, D., Tachie-Menson, A., Johnson, E. E., & Baah, P. K. (2022) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-022-00362-6 · Cited by 428
Skills, plans, and self-regulation
Brown, A. L., & DeLoache, J. S. (1978) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · Cited by 411
Facilitating student engagement through the flipped learning approach in K-12: A systematic review
Bond, M. (2020) · Computers & Education · doi:10.1016/j.compedu.2020.103819 · Cited by 380
Carey, S. E., & Markman, E. M. (1984) · Springer eBooks · doi:10.1007/978-1-4899-2177-2_3 · Cited by 377
Azevedo, R., Moos, D. C., Johnson, A. M., & Chauncey, A. (2010) · Educational Psychologist · doi:10.1080/00461520.2010.515934 · Cited by 352
Hew, K. F., Huang, W., Du, J., & Jia, C. (2023) · Journal of Computing in Higher Education · doi:10.1007/s12528-022-09338-x · Cited by 245 · cited 1×
“Using technological resources—such as chatbots—that promote real-time interaction about the questions and issues students may have throughout their learning processes is important in effectively personalizing these processes [58].”
BackgroundAn analysis of children’ interaction with an AI chatbot and its impact on their interest in reading
Liu, C.-C., Liao, M.-G., Chang, C.-H., & Lin, H.-M. (2022) · Computers & Education · doi:10.1016/j.compedu.2022.104576 · Cited by 240
Survey on Virtual Assistant: Google Assistant, Siri, Cortana, Alexa
Tulshan, A. S., & Dhage, S. (2019) · Communications in computer and information science · doi:10.1007/978-981-13-5758-9_17 · Cited by 190
Fidan, M., & Gencel, N. (2022) · Journal of Educational Computing Research · doi:10.1177/07356331221077901 · Cited by 186
From Design to Implementation to Practice a Learning by Teaching System: Betty’s Brain
Biswas, G., Segedy, J. R., & Bunchongchit, K. (2015) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-015-0057-9 · Cited by 182
Sequential and temporal characteristics of self and socially regulated learning
Molenaar, I., & Järvelä, S. (2014) · Metacognition and Learning · doi:10.1007/s11409-014-9114-2 · Cited by 182
van der Stel, M., & Veenman, M. V. J. (2013) · European Journal of Psychology of Education · doi:10.1007/s10212-013-0190-5 · Cited by 160
Binali, T., Tsai, C., & Chang, H. (2021) · Computers & Education · doi:10.1016/j.compedu.2021.104315 · Cited by 145
Technologies for the future of learning: state of the art
Hernández-de-Menéndez, M., Escobar, C. A., & Morales-Menéndez, R. (2019) · International Journal on Interactive Design and Manufacturing (IJIDeM) · doi:10.1007/s12008-019-00640-0 · Cited by 143
Chatbot usage intention analysis: Veterinary consultation
Huang, D.-H., & Chueh, H.-E. (2020) · Journal of Innovation & Knowledge · doi:10.1016/j.jik.2020.09.002 · Cited by 138
LEARNING TO SELF-MONITOR AND SELF-REGULATE
Veenman, M. V. J. (2011) · Routledge eBooks · doi:10.4324/9780203839089-18 · Cited by 132
Veenman, M. V. J., & Beishuizen, J. J. (2004) · Learning and Instruction · doi:10.1016/j.learninstruc.2004.09.004 · Cited by 129
FAQ chatbot and inclusive learning in massive open online courses
Han, S., & Lee, M. K. (2021) · Computers & Education · doi:10.1016/j.compedu.2021.104395 · Cited by 126
Taub, M., & Azevedo, R. (2018) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-018-0165-4 · Cited by 123
Chatbot as an Intelligent Personal Assistant for Mobile Language Learning
Pham, X. L., Phạm, T. H., Nguyen, Q. M., Nguyen, T. H., & Cao, T. T. H. (2018) · International Conference on Education and E-Learning (ICEEL) · doi:10.1145/3291078.3291115 · Cited by 121
Taub, M., Azevedo, R., Rajendran, R., Cloude, E. B., Biswas, G., & Price, M. J. (2019) · Learning and Instruction · doi:10.1016/j.learninstruc.2019.04.001 · Cited by 114
Health-focused conversational agents in person-centered care: a review of apps
Parmar, P., Ryu, J., Pandya, S., Sedoc, J., & Agarwal, S. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00560-6 · Cited by 113
Azevedo, R. (2014) · Metacognition and Learning · doi:10.1007/s11409-014-9123-1 · Cited by 94
Schellings, G. L. M., van Hout‐Wolters, B. H. A. M., Veenman, M. V. J., & Meijer, J. M. (2012) · European Journal of Psychology of Education · doi:10.1007/s10212-012-0149-y · Cited by 90
(2017) · Smart innovation, systems and technologies · doi:10.1007/978-3-319-59454-5 · Cited by 90
Taub, M., Sawyer, R., Lester, J. C., & Azevedo, R. (2019) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-019-00191-1 · Cited by 83
Learning to Self-Monitor and Self-Regulate
Veenman, M. V. J. (2015) · Routledge eBooks · doi:10.4324/9780203839089.ch10 · Cited by 72
Supporting Inclusive Learning Using Chatbots? A Chatbot-Led Interview Study
Gupta, S., & Chen, Y. (2022) · Journal of Information Systems Education · doi:10.62273/tvtf4203 · Cited by 71
Student satisfaction with online teaching in times of COVID-19
Manzanares, M. C. S., Casanova, J. R., Lencastre, J. A., Almeida, L. S., & Antón, L. J. M. (2021) · Comunicar · doi:10.3916/c70-2022-03 · Cited by 69
Self-citationThe effect of contextualized conversational feedback in a complex open-ended learning environment
Segedy, J. R., Kinnebrew, J. S., & Biswas, G. (2012) · Educational Technology Research and Development · doi:10.1007/s11423-012-9275-0 · Cited by 68
Kinnebrew, J. S., Segedy, J. R., & Biswas, G. (2015) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2015.2513387 · Cited by 67
Smart Education and e-Learning 2017
Lněnička, M., Máchová, R., Komárková, J., & Pásler, M. (2017) · Smart innovation, systems and technologies · doi:10.1007/978-3-319-59451-4 · Cited by 67
Effectiveness of Using Voice Assistants in Learning: A Study at the Time of COVID-19
Manzanares, M. C. S., Sánchez, R. M., & Ochoa-Orihuel, J. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17155618 · Cited by 53
Will personalized e-Learning increase deep learning in higher education?
Manzanares, M. C. S., García‐Osorio, C., Díez-Pastor, J.-F., & Antón, L. J. M. (2019) · Information Discovery and Delivery · doi:10.1108/idd-08-2018-0039 · Cited by 49
Schophuizen, M., Kreijns, K., Slavi Stoyanov, A., & Kalz, M. (2017) · The Internet and Higher Education · doi:10.1016/j.iheduc.2017.08.002 · Cited by 48
Envisioned Pedagogical Uses of Chatbots in Higher Education and Perceived Benefits and Challenges
Tsivitanidou, O., & Ioannou, A. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-77943-6_15 · Cited by 44
Birgili, B., & Demir, Ö. (2021) · Computers & Education · doi:10.1016/j.compedu.2021.104352 · Cited by 43
Manzanares, M. C. S., Sánchez, R. M., Rodríguez, J. J., Arribas, S. R., Díez-Pastor, J.-F., & Ji, Y. (2021) · Journal of Computing in Higher Education · doi:10.1007/s12528-021-09289-9 · Cited by 34
Students’ Perceptions on Chatbots’ Potential and Design Characteristics in Healthcare Education
Natalia, S., Sokratis, N., Klas, K., Konstantinidis Stathis, T., Bamidis Panagiotis, D., Pattichis Constantinos, S., & Nadia, D. (2020) · Studies in Health Technology and Informatics · doi:10.3233/shti200531 · Cited by 29
Engineering Education for a Smart Society
(2017) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-60937-9 · Cited by 24
Hadwin, A. F. (2019) · Learning and Instruction · doi:10.1016/j.learninstruc.2019.101287 · Cited by 21
Zhang, Y., Paquette, L., Bosch, N., Ocumpaugh, J. L., Biswas, G., Hutt, S. J., & Baker, R. S. (2022) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2022.102064 · Cited by 20
The Gamification Model for E-Learning Participants Engagement
Rutkauskienė, D., Gudonienė, D., Maskeliūnas, R., & Blažauskas, T. (2016) · Smart innovation, systems and technologies · doi:10.1007/978-3-319-39690-3_26 · Cited by 18
Moodle LMS Integration with Amazon Alexa: A Practical Experience
Ochoa-Orihuel, J., Sánchez, R. M., & Manzanares, M. C. S. (2020) · Applied Sciences · doi:10.3390/app10196859 · Cited by 17
UBUMonitor: An Open-Source Desktop Application for Visual E-Learning Analysis with Moodle
Sánchez, R. M., Nozal, C. L., Ji, Y., Pardo, C., & González, Á. A. (2022) · Electronics · doi:10.3390/electronics11060954 · Cited by 15
Implementation of Voice User Interfaces to Enhance Users’ Activities on Moodle
Kita, T., Nagaoka, C., Hiraoka, N., & Dougiamas, M. (2019) · doi:10.1109/incit.2019.8912086 · Cited by 12
Information and Communication Technology for Competitive Strategies (ICTCS 2022)
Kaiser, M. S., Xie, J., & Rathore, V. S. (2023) · Lecture notes in networks and systems · doi:10.1007/978-981-19-9304-6 · Cited by 12
A Neural Network Approach to Intention Modeling for User-Adapted Conversational Agents
Griol, D., & Callejas, Z. (2015) · Computational Intelligence and Neuroscience · doi:10.1155/2016/8402127 · Cited by 11
Can intelligent agents improve data quality in online questiosnnaires? A pilot study
Söderström, A., Shatte, A. B. R., & Fuller‐Tyszkiewicz, M. (2021) · Behavior Research Methods · doi:10.3758/s13428-021-01574-w · Cited by 10
Proceedings of the 2018 2nd International Conference on Education and E-Learning
Indonesia, I. 2. 2. 2. I. C. O. E. A. E.-L. 2. B., & Association for Computing Machinery-Digital Library (2018) · doi:10.1145/3291078 · Cited by 8
Activity and Dropout Tracking in Moodle Using UBUMonitor Application
Ji, Y., Sánchez, R. M., Pardo, C., Nozal, C. L., & Juez-Gil, M. (2022) · IEEE Revista Iberoamericana de Tecnologias del Aprendizaje · doi:10.1109/rita.2022.3191279 · Cited by 7
Functional Monitoring and Control in Electronic Information and Educational Environment
Dobudko, T. V., Викторович, О. А., Васильевич, Г. С., Hashim, W., & Maseleno, A. (2019) · International Journal of Recent Technology and Engineering (IJRTE) · doi:10.35940/ijrte.b2030.078219 · Cited by 6
AI-Based Interactive Agent for Health Care Using NLP and Deep Learning
Hemavathi, U., & Medona, A. C. V. (2022) · Lecture notes in networks and systems · doi:10.1007/978-981-19-0095-2_2 · Cited by 5
Alexa skill voice interface for the moodle learning management system
MeltonMichelle, & FenwickJames (2019) · Journal of computing sciences in colleges · doi:10.5555/3381631.3381636 · Cited by 4
A Virtual Learning System in Environmental Monitoring
Brogan, D. S., Basu, D., & Lohani, V. K. (2017) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-60937-9_27 · Cited by 4
Alexa Skill Voice Interface For The Moodle Learning Management System
Melton, M. L. (2019) · NC Digital Online Collection of Knowledge and Scholarship (The University of North Carolina at Greensboro) · doi:10.71889/5fylantbak.29863580 · Cited by 4
Research works printed but not linked: 2
- Reoyo, 2017, Characteristics of teaching effectiveness from the perspectives of teachers and future secondary school teachers, Rev. Educ., 376, 62
- Gupta, 2019, vol. 213
Cited by
Sorted by citations
Exploring Students’ Perceptions of ChatGPT: Thematic Analysis and Follow-Up Survey
Shoufan, A. (2023) · IEEE Access · doi:10.1109/access.2023.3268224 · Cited by 499
“They have been used to support learning [6], [7], increase students’ engagement [8], [9], assess students [10], [11], and perform various administrative functions [12], [13].”
BackgroundEffects of Generative Chatbots in Higher Education
Ilieva, G., Yankova, T., Klisarova-Belcheva, S., Dimitrov, A., Bratkov, M., & Angelov, D. (2023) · Information · doi:10.3390/info14090492 · Cited by 258
Pan, M., Lai, C., & Guo, K. (2024) · The Internet and Higher Education · doi:10.1016/j.iheduc.2024.100991 · Cited by 145
Exploring chatbot trust: Antecedents and behavioural outcomes
Alagarsamy, S., & Mehrolia, S. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e16074 · Cited by 142
Debets, T., Banihashem, S. K., Brinke, D. J.-T., Vos, T. E. J., Wenniger, G. M. D. B., & Camp, G. (2025) · Computers & Education · doi:10.1016/j.compedu.2025.105323 · Cited by 124
Metadata
- Authors
- Sáiz-Manzanares, M. C., Marticorena-Sánchez, R., Martín-Antón, L. J., González Díez, I., & Almeida, L.
- Affiliations
- University of Minho (PT)
- ORCID
- Venue
- Heliyon
- Publisher
- Elsevier BV
- Published
- 2023-01
- Volume
- 9
- Issue
- 1
- Pages
- e12843
- ISSN
- 2405-8440 (ISSN-L)
- PMC
- PMC9871218
- OpenAlex
- W4318264071
- Cited by
- 96
- References
- 65
- Citations by year
- 2026: 13 · 2025: 30 · 2024: 29 · 2023: 24
- FWCI
- 22.53
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Heliyon (publishedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- Repositorio Institucional de la Universidad de Burgos (University of Burgos) (submittedVersion, cc-by-nc-nd)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Gobierno de España Ministerio de Ciencia e Innovación (PID2020-117111RB-I00)
- Ministerio de Ciencia e Innovación
- Topics
- Social Sciences › Education › Artificial Intelligence in Education
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Keywords
- chatbots, student self-regulation, student satisfaction, metacognitive strategies, learning outcomes, prior knowledge, educational attainment, health sciences students
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review