The evaluation of chatbot as a tool for health literacy education among undergraduate students
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
This study discussed and evaluated the usefulness, performance, and technology acceptance of a chatbot developed to educate users and provide health literacy. A semi-structured interview and analytic sessions were provided on Google Analytics dashboard, and the users’ acceptance toward the technology was measured using the Unified Theory of Acceptance and Use of Technology 2 (UTAUT2). A total of 75 undergraduate students were involved over a total period of two months. Each respondent explored the health chatbot actively to get advice from it with a phrase that matched the chatbot’s intents via mobile devices. The evaluation results showed that 73.3% of the respondents found that the chatbot can help understand several health issues and provide a good conversation. The performance evaluation also showed that the chatbot contributed a low percentage of exit, where less than 37% of users exited the application. The overall assessment showed that the developed chatbot has a significant potential to be used as a conversational agent to increase health literacy, especially among students and young adults. However, more research should be done before the technology can replace humans in a real setting.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Venkatesh, V., Thong, J. Y. L., & Xu, X. (2012) · MIS Quarterly · doi:10.2307/41410412 · Cited by 15,756 · cited 7×
“The last objective was achieved by measuring how the factors that influence new technologies’ perception are often undertaken using various incarnations of the UTAUT2 (Venkatesh et al., 2012).”
BackgroundInfluentialNadarzynski, T., Miles, O., Cowie, A., & Ridge, D. (2019) · DIGITAL HEALTH · doi:10.1177/2055207619871808 · Cited by 810 · cited 1×
“According to a report by Holmes et al. (2018) and Nadarzynski et al. (2019), a health chatbot has the potential to increase access to healthcare information, improve the doctor-patient relationship, enable faster clinic-patient communication, manage the increasing demand for health-care services,…”
BackgroundThe Effectiveness of Artificial Intelligence Conversational Agents in Health Care: Systematic Review
Milne-Ives, M., de Cock, C., Lim, E., Shehadeh, M. H., de Pennington, N., Mole, G., Normando, E., & Meinert, E. (2020) · Journal of Medical Internet Research · doi:10.2196/20346 · Cited by 626 · cited 3×
“However, Milne-Ives et al. (2020) study the effectiveness of 14 chatbots health-related chatbots in making conversation; for health, it showed mixed reviews.”
BackgroundInfluentialA systematic review of the prevalence of limited health literacy in southeast Asian countries
Rajah, R., Hassali, M. A. A., & Murugiah, M. K. (2019) · Public Health · doi:10.1016/j.puhe.2018.09.028 · Cited by 191
Neter, E., & Brainin, E. (2019) · European Psychologist · doi:10.1027/1016-9040/a000350 · Cited by 169
Technical metrics used to evaluate health care chatbots: scoping review
Abd-Alrazaq, A., Safi, Z., Alajlani, M., Warren, J., Househ, M., & Denecke, K. (2020) · Journal of Medical Internet Research · doi:10.2196/18301 · Cited by 150
McGreevey, J. D., Hanson, C. W., & Koppel, R. (2020) · JAMA · doi:10.1001/jama.2020.2724 · Cited by 112 · cited 1×
“However, the experts expressed their caution of using the chatbot technology in health-related activities, as stated by John et al. (2020) in their study.”
Background(2020) · Pacific Asia journal of the Association for Information Systems · doi:10.17705/1pais.12201 · Cited by 26
Cited by
Students’ voices on generative AI: perceptions, benefits, and challenges in higher education
Chan, C. K. Y., & Hu, W. (2023) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-023-00411-8 · Cited by 2,301
“…incorporated open-ended survey questions (e.g., Hew et al., 2023; Jeffrey, 2020) and semi-structured interviews (e.g., Gillissen et al., 2022; Mokmin & Ibrahim, 2021; Park et al., 2020) to gather students’ free responses and to probe their views on the research topic in addition to their…”
BackgroundDave, T., Athaluri, S. A., & Singh, S. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1169595 · Cited by 1,204
Effects of chatbot-assisted in-class debates on students’ argumentation skills and task motivation
Guo, K., Zhong, Y., Li, D., & Chu, S. K. W. (2023) · Computers & Education · doi:10.1016/j.compedu.2023.104862 · Cited by 188
Yusuf, H., Money, A., & Daylamani-Zad, D. (2025) · Educational technology research and development · doi:10.1007/s11423-025-10447-4 · Cited by 112
Students' voices on generative ai: perceptions, benefits, and challenges in higher education
Chan, C. K. Y., & Hu, W. (2023) · arXiv · doi:10.48550/arxiv.2305.00290 · Cited by 2,504
“…incorporated open-ended survey questions (e.g., Hew et al., 2023; Jeffrey, 2020) and semi-structured interviews (e.g., Gillissen et al., 2022; Mokmin & Ibrahim, 2021; Park et al., 2020) to gather students’ free responses and to probe their views on the research topic in addition to their…”
Background
Metadata
- Authors
- Mokmin, N. A. M., & Ibrahim, N. A.
- Venue
- Education and Information Technologies
- Published
- 2021-05-25
- Volume
- 26
- Issue
- 5
- Pages
- 6033-6049
- ISSN
- 1360-2357 (ISSN-L)
- 1573-7608
- OpenAlex
- W3164608364
- Cited by
- 106
- References
- 8
- FWCI
- 3.97
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The evaluation of chatbot as a tool for health literacy education among undergraduate students. https://app.cochat.ai/papers/10.1007/s10639-021-10542-y
- The paper
- Mokmin, N. A. M., & Ibrahim, N. A. (2021). The evaluation of chatbot as a tool for health literacy education among undergraduate students. Education and Information Technologies. https://doi.org/10.1007/s10639-021-10542-y
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.