Is ChatGPT a Good Tool for T&CM Students in Studying Pharmacology?
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Although artificial intelligence (AI) is becoming more and more prevalent in education, yet its patterns, problems with current research, and potential applications are still largely unexplored. ChatGPT is AI based platform, developed by AI research and deployment company, known as OpenAI. Users may submit text instructions into ChatGPT, and it will quickly produce text answers using the information it has gleaned through using machine learning to interact with the internet. The objective of current study is to test ChatGPT by asking student centric medical questions in the field of pharmacology and determine its relevancy in self-studying the subject so that students can use to enhance their learning experience. The questions were asked in the different domain of drug’s pharmacokinetics, mechanism of action, clinical uses, adverse effect, contraindications and drug-drug interactions. The answer given by ChatGPT were relevant and accurate, however the reference or source of answers were not given. The tool can used as quick reference and self-studying instrument for traditional and complementary medicine students (T&CM) who face difficulty in studying pharmacology.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Despite ChatGPT versatility in the context of academic education [79], the content of ChatGPT in research assignments was discouraged, being currently insufficient, biased, or misleading [36,78].”
From ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns (2023) · cites this paper as [78]
Citations
Cites
Vision, challenges, roles and research issues of Artificial Intelligence in Education
Hwang, G.-J., Xie, H., Wah, B. W., & Gašević, D. (2020) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2020.100001 · Cited by 1,435
Celik, I. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107468 · Cited by 1,012
Pavlik, J. V. (2023) · Journalism & Mass Communication Educator · doi:10.1177/10776958221149577 · Cited by 972
OpenAI ChatGPT Generated Literature Review: Digital Twin in Healthcare
Aydın, Ö., & Karaarslan, E. (2022) · doi:10.2139/ssrn.4308687 · Cited by 391
“Possibilities and apprehensions in the landscape of artificial intelligence in education,”
Alam, A. (2021) · 2021 International Conference on Computational Intelligence and Computing Applications (ICCICA) · doi:10.1109/iccica52458.2021.9697272 · Cited by 344
How would Stance Detection Techniques Evolve after the Launch of ChatGPT?
Zhang, B., Ding, D., Jing, L., Dai, G., & Yin, N. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2212.14548 · Cited by 65
A computer-assisted learning program in pharmacology: Integrating scientific and nursing knowledge
Manias, E., Bullock, S., & Bennett, R. (1999) · Contemporary Nurse · doi:10.5172/conu.1999.8.2.23 · Cited by 8
Research works printed but not linked: 4
- R A Harvey, 2011, Pharmacology (Lippincott's Illustrated Reviews Series
- E Manias, 2000, Formative evaluation of a computer-assisted learning program in pharmacology for nursing students -PubMed, Computer Nurse, 18, 265
- S O'connor, 2023, Open artificial intelligence platforms in nursing education: Tools for academic progress or abuse? Nurse Education in Practice, 66
- H Wang, 2022, Pre-Trained Language Models and Their Applications. Engineering
Cited by
Sallam, M. (2023) · Healthcare · doi:10.3390/healthcare11060887 · Cited by 3,126
What Is the Impact of ChatGPT on Education? A Rapid Review of the Literature
Lo, C. K. (2023) · Education Sciences · doi:10.3390/educsci13040410 · Cited by 2,024
“The findings of these studies suggested that, in general, ChatGPT’s performance was not entirely satisfactory in the domain of medical education.”
BackgroundIs ChatGPT Leading Generative AI? What is Beyond Expectations?
AYDIN, Ö., & KARAARSLAN, E. (2023) · Academic Platform Journal of Engineering and Smart Systems · doi:10.21541/apjess.1293702 · Cited by 311
Sallam, M. (2023) · doi:10.1101/2023.02.19.23286155 · Cited by 3,123
“16 Nisar and Aslam [69] SSRN preprint on the assessment of ChatGPT usefulness to study pharmacology Good accuracy Content not sufficient for research purposes Can be a helpful self-learning tool”
BackgroundEducational Applications of the ChatGPT AI System: A Systematic Review Research
İpek, Z. H., Gözüm, A. İ. C., Papadakis, S., & Kallogiannakis, M. (2023) · Educational Process International Journal · doi:10.22521/edupij.2023.123.2 · Cited by 201
“As a result, the program has been subjected to exams in fields such as law, pharmacy, medicine, and language education, and overall has received scores better than that of an average student (Choi et al., 2023; Huh, 2023; Nisar & Aslam, 2023; Qadir, 2022).”
BackgroundMethodInfluentialKar, A. K., Varsha, P. S., & Rajan, S. (2023) · Global Journal of Flexible Systems Management · doi:10.1007/s40171-023-00356-x · Cited by 192
“…platforms, online marketing, retailing, search engine advertising and other digital advertising channels to improve loyalty programmes, enhance customer services, enable fraud detection in online transaction and resolve inventory problems (Marr, 2023b; Nisar & Aslam, 2023; Oviedo et al., 2023).”
BackgroundMaheshwari, G. (2024) · Education and Information Technologies · doi:10.1007/s10639-023-12333-z · Cited by 167
“Several studies have sought to assess ChatGPT’s ability to answer questions in various exam formats within the education system (Gilson et al., 2023; Nisar & Aslam, 2023).”
Wang, M., Wang, M., Xu, X., Yang, L., Cai, D., & Yin, M. (2023) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2023.3324714 · Cited by 218
“Assuming the role of a virtual tutor, ChatGPT assists students in online independent learning by addressing their queries [68], while also bolstering group dynamics through the provision of discussion structures and real-time feedback [69].”
BackgroundKavadella, A., da Silva, M. A. D., Kaklamanos, E. G., Stamatopoulos, V., & Giannakopoulos, K. (2023) · JMIR Medical Education · doi:10.2196/51344 · Cited by 199
Performance of ChatGPT on the pharmacist licensing examination in Taiwan
Wang, Y.-M., Shen, H.-W., & Chen, T.-J. (2023) · Journal of the Chinese Medical Association · doi:10.1097/jcma.0000000000000942 · Cited by 109
The Role of Artificial Intelligence in Higher Education: ChatGPT Assessment for Anatomy Course
TALAN, T., & KALINKARA, Y. (2023) · Uluslararası Yönetim Bilişim Sistemleri ve Bilgisayar Bilimleri Dergisi · doi:10.33461/uybisbbd.1244777 · Cited by 109
Salifu, I., Arthur, F., Arkorful, V., Nortey, S. A., & Osei-Yaw, R. S. (2024) · Cogent Social Sciences · doi:10.1080/23311886.2023.2300177 · Cited by 149
“ChatGPt, as a virtual tutor, assist students in various fields by answering their questions (nisar & aslam, 2023) and enhancing group dynamics by suggesting a discussion structure and providing real-time feedback (Kasneci et al., 2023).”
Naidu, K., & Sevnarayan, K. (2023) · Online Journal of Communication and Media Technologies · doi:10.30935/ojcmt/13291 · Cited by 75
Al-Qaysi, N., Al‐Emran, M., Al-Sharafi, M. A., Iranmanesh, M., Ahmad, A., & Mahmoud, M. A. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2361210 · Cited by 77
“For example, traditional Chinese Medicine students in Malaysia use ChatGPT as a convenient resource and self-learning tool for their pharmacology coursework (Nisar & Aslam, 2023).”
Malik, A., Khan, M. L., Hussain, K., Qadir, J., & Tarhini, A. (2025) · Interactive Learning Environments · doi:10.1080/10494820.2024.2409407 · Cited by 57
“These findings support Nisar and Aslam ’ s (2023) assertions regarding the trustworthiness of information retrieved through ChatGPT.”
Navigating Generative AI (ChatGPT) in Higher Education: Opportunities and Challenges
Wang, T. (2023) · Lecture Notes in Educational Technology · doi:10.1007/978-981-99-5961-7_28 · Cited by 56
Shafik, W. (2023) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3693-0502-7.ch001 · Cited by 56
Choi, W. (2023) · BMC Medical Education · doi:10.1186/s12909-023-04832-x · Cited by 57
Kunitsu, Y. (2023) · JMIR Medical Education · doi:10.2196/48452 · Cited by 43
Data Privacy and Security Safeguarding Customer Information in ChatGPT Systems
Shafik, W. (2024) · Advances in hospitality, tourism and the services industry (AHTSI) book series · doi:10.4018/979-8-3693-1239-1.ch003 · Cited by 42
ChatGPT: A Conceptual Review of Applications and Utility in the Field of Medicine
Rao, S. J., Isath, A., Krishnan, P., Tangsrivimol, J. A., Virk, H. U. H., Wang, Z., Glicksberg, B. S., & Krittanawong, C. (2024) · Journal of Medical Systems · doi:10.1007/s10916-024-02075-x · Cited by 35
Using ChatGPT to Encourage Critical AI Literacy Skills and for Assessment in Higher Education
Huang, C.-W., Coleman, M., Gachago, D., & Van Belle, J.-P. (2024) · Communications in Computer and Information Science · doi:10.1007/978-3-031-48536-7_8 · Cited by 41
ChatGPT, the perfect virtual teaching assistant? Ideological bias in learner-chatbot interactions
Poucke, M. V. (2024) · Computers & composition/Computers and composition · doi:10.1016/j.compcom.2024.102871 · Cited by 48
Annamalai, N. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2024.2371928 · Cited by 37
“…model that has gained attention from various fields, including education (Williams et al., 2023; Tate et al., 2023), engineering (Qadir, 2023), journalism (Pavlik, 2023), medicine (Nisar & Aslam, 2023; O ’ Connor & ChatGPT, 2023), and economics and finance (Alshater, 2022; Terwiesch, 2023).”
Dashkevych, O., & Portnov, B. A. (2024) · Technology in Society · doi:10.1016/j.techsoc.2024.102555 · Cited by 36
Kapsali, M. Z., Livanis, E., Tsalikidis, C., Oikonomou, P., Voultsos, P. P., & Tsaroucha, A. (2024) · Cureus · doi:10.7759/cureus.54759 · Cited by 32
“Pretrained-generated text and algorithm-based answers in scientific questions could lead to a) biased content, b) misleading or inaccurate information, c) the exclusion of results that are not commonly cited or results limited in time prior to 2021, and d) other misleading textual results [7,31,44].”
BackgroundTracking ChatGPT Research: Insights From the Literature and the Web
Mubin, O., Alnajjar, F., Trabelsi, Z., Ali, L., Parambil, M. M. A., & Zou, Z. (2024) · IEEE Access · doi:10.1109/access.2024.3356584 · Cited by 26
“In addition, ChatGPT has been evaluated for its usefulness in providing quick guidance to students on pharmacology topics [18].”
BackgroundMethodA review of ChatGPT in medical education: exploring advantages and limitations
Cheng, Y., & Zhu, L. (2025) · International Journal of Surgery · doi:10.1097/js9.0000000000002505 · Cited by 29
Unveiling the risks of ChatGPT in diagnostic surgical pathology
Guastafierro, V., Corbitt, D. N., Bressan, A., Fernandes, B., Mintemur, Ö., Magnoli, F., Ronchi, S., La Rosa, S., Uccella, S., & Renne, S. L. (2025) · Virchows Archiv · doi:10.1007/s00428-024-03918-1 · Cited by 14
Performance of ChatGPT on the National Korean Occupational Therapy Licensing Examination
Lee, S.-A., Heo, S., & Park, J. (2024) · Digital Health · doi:10.1177/20552076241236635 · Cited by 14
An Experimental Analysis of Greek School Leaders’ Readiness for AI Integration
Anysiadou, M., & Gkliati, A. (2025) · Leadership and Policy in Schools · doi:10.1080/15700763.2024.2439833 · Cited by 22
“Additionally, there is research concerning student’s perceptions of AI systems’ effectiveness in education (Y. Chen et al., 2023; Nisar & Aslam, 2023) and teachers’ perceptions (Celik et al., 2022).”
Romero-Rodríguez, P. (2023) · 593 Digital Publisher CEIT · doi:10.33386/593dp.2023.5.1976 · Cited by 21
Ozturk, N., Yakak, I., Ağ, M. B., & Aksoy, N. (2024) · Currents in Pharmacy Teaching and Learning · doi:10.1016/j.cptl.2024.04.017 · Cited by 15
Performance of GPT-3.5 and GPT-4 on the Korean Pharmacist Licensing Examination: Comparison Study
Jin, H. K., & Kim, E. Y. (2024) · JMIR Medical Education · doi:10.2196/57451 · Cited by 15
“In particular, research on their performance on national pharmacist licensing examinations is limited, with Nisar et al [21] being one of the few relevant studies.”
Prakash, K., & Prakash, R. (2024) · Journal of Dental Education · doi:10.1002/jdd.13560 · Cited by 16
Singh, R. G., & Ngai, C. S. B. (2024) · Discover Education · doi:10.1007/s44217-024-00211-w · Cited by 24
Karafil, B., & Uyar, A. (2025) · Education and Information Technologies · doi:10.1007/s10639-024-13291-w · Cited by 17
“As a result, ChatGPT has been evaluated across various disciplines, including language learning, pharmacy, law, and medicine, consistently yielding results that surpass average student scores (Choi et al., 2023; Huh, 2023; Nisar & Aslam, 2023).”
AŞKUN, V. (2023) · Erciyes Akademi · doi:10.48070/erciyesakademi.1281544 · Cited by 15
The Application of ChatGPT in Language Test Design – The What and How
Nguyễn, T. P. T. (2023) · Proceedings of the AsiaCALL International Conference · doi:10.54855/paic.2348 · Cited by 15
“Consequently, Nisar and Aslam (2023) conclude that ChatGPT can be utilized as a prompt reference and self-studying instrument for learners.”
BackgroundWang, Y.-M., Shen, H.-W., Chen, T., Chiang, S., & Lin, T.-G. (2025) · JMIR Medical Education · doi:10.2196/56850 · Cited by 10
Generative AI: A Case Study of ChatGPT’s Impact on University Students’ Learning PracticesPreprint
Alnaim, N. M. (2024) · Research Square · doi:10.21203/rs.3.rs-4515034/v1 · Cited by 8
ChatGPT in Research and Education: A SWOT Analysis of Its Academic Impact
Miah, A. S. M., Tusher, M. M. R., Hossain, M. M., Hossain, M. M., Rahim, M. A., Hamid, M. E., Islam, M. S., & Shin, J. (2025) · Computer Modeling in Engineering & Sciences · doi:10.32604/cmes.2025.064168 · Cited by 11
Su, H., Tong, Y., Zhang, X., & Fan, Y. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-4442-8_18 · Cited by 11
ChatGPT: Optimizing text generation model for knowledge creation
Sanjay, M. B., Vikas, S., & Dahiwale, P. (2023) · i-manager’s Journal on Software Engineering · doi:10.26634/jse.17.3.19469 · Cited by 8
ChatGPT and Its Role in Revolutionizing Digital Marketing and Enhancing Customer Engagement
Tarabah, N. E. H., & Amin, M. E. S. (2024) · Advances in business information systems and analytics book series · doi:10.4018/979-8-3693-0815-8.ch005 · Cited by 8
Evaluation of ChatGPT's Usefulness and Accuracy in Diagnostic Surgical Pathology.Preprint
Guastafierro, V., Corbitt, D. N., Bressan, A., Fernandes, B., Mintemur, O., Magnoli, F., Ronchi, S., Rosa, S. L., Uccella, S., & Renne, S. (2024) · medRxiv · doi:10.1101/2024.03.12.24304153 · Cited by 2
“…Medical Licensing Exam (USMLE), Ophthalmic Knowledge Assessment Program (OKAP) exam, American Heart Association (AHA), Chinese National Medical Licensing Examination) 14,49,56,60 , written based on university textbooks 59 , reproduced from published case reports 54 or retrieved from social media.”
BackgroundSalimi, E. A., & Hajinia, M. (2024) · Research Square · doi:10.21203/rs.3.rs-5534554/v1 · Cited by 9
Soft Skills in Jeopardy: The Impact of AI on Future Generations of Students
Susilana, R., Setiawan, B., Herlina, H., & Rahayu, S. (2025) · Indonesian Journal Of Educational Research and Review · doi:10.23887/ijerr.v8i1.82875 · Cited by 3
Use of ChatGPT as a supplemental learning tool in mathematics
Sosas, M. R. D., Fat, A. F. G., Dangculos, J. M. M., Anoba, H. R. P., Remiscal, C. G., & Aleguen, J. M. (2026) · Contemporary Mathematics and Science Education · doi:10.30935/conmaths/17989 · Cited by 6
“Furthermore, ChatGPT encourages independent learning and enhances learner engagement (Elkhodr et al., 2023; Kohnke et al., 2023; Ma, 2023; Nisar & Aslam, 2023).”
Atalan, A., Keskin, A., & Özer, S. (2024) · International Journal of Healthcare Management · doi:10.1080/20479700.2024.2444102 · Cited by 4
“ChatGPT plays a vital role in resolving emergencies by instantly answering health-related questions from students or professionals [10].”
Perceptions of Educators on the Use of Text-Generative AI in South African Higher Education
Coleman, M., & Belle, J.-P. V. (2025) · Lecture notes in electrical engineering · doi:10.1007/978-981-97-9045-6_4 · Cited by 3
CHATGPT UNTUK MENDUKUNG PENCARIAN TOPIK SKRIPSI DI FAKULTAS TEKNIK UNIVERSITAS NEGERI MEDAN
Waluyo, B. D., Astrid, E., Mulyana, D. I., & Pakpahan, B. M. T. (2023) · JURNAL TEKNOLOGI INFORMASI & KOMUNIKASI DALAM PENDIDIKAN · doi:10.24114/jtikp.v10i1.46478 · Cited by 5
Exploring Perceptions of Learners Towards Using ChatGPT: A Qualitative Study
Sarkar, P. D. (2025) · Dibon Journal of Education · doi:10.64169/dje.68 · Cited by 1
Motivation from Technology Innovation in Teaching Foreign Languages: A Case Study in Vietnam
Đoàn, T. N. (2023) · Vietnam Academy of Social Sciences s VSSR · doi:10.56794/vssr.2(214).92-104 · Cited by 4
Kiran, G. R., Ramachandran, K. K., Tilak, G., Bharathi, T., Muhammad, K. M. S., & Loganayagi, S. (2024) · Smart innovation, systems and technologies · doi:10.1007/978-981-97-2716-2_27 · Cited by 1
Exploring Supportive Strategies and Teaching Approaches for Statistics Course: Leveraging ChatGPT
Maheshwari, G. (2024) · Digital education and learning · doi:10.1007/978-3-031-61838-3_5 · Cited by 1
About the methods of the students competences analysis in distance and blended learning
Savin, M. A. (2023) · Informatics and Education · doi:10.32517/0234-0453-2023-38-6-59-67
Detecting Large Language Models in Exam Essays
de Giorgio, A., Matrone, G., & Maffei, A. (2025) · IEEE World Engineering Education Conference (EDUNINE) · doi:10.1109/edunine62377.2025.10981412 · Cited by 1
Wright, B. S., Kim, L. J., & Coleman, N. R. (2023) · Annals of Pharmacy Education Safety and Public Health Advocacy · doi:10.51847/hpn7ecjdva
Silwana, A., Nisa', L. A. K., & Widayanti, E. (2026) · Journal of Physics Conference Series · doi:10.1088/1742-6596/3276/1/012027
Lin, H., Juan, S.-J., Duong, N. T., & Lu, Q. (2026) · Information Technology and Management · doi:10.1007/s10799-026-00511-7
Metadata
- Authors
- Nisar, S., & Aslam, M. S.
- Affiliations
- Universiti Teknologi Petronas (MY)
- Xiamen University Malaysia (MY)
- Corresponding author
- Aslam, Muhammad Shahzad
- Venue
- SSRN Electronic Journal
- Publisher
- Elsevier BV
- Published
- 2023
- ISSN
- 1556-5068 (ISSN-L)
- OpenAlex
- W4320014806
- Cited by
- 60
- References
- 7
- Citations by year
- 2026: 3 · 2025: 9 · 2024: 24 · 2023: 24
- Type
- posted content
- Language
- en
- Open access
- green
- doi.org
- Locations
- SSRN Electronic Journal (acceptedVersion)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Education › Artificial Intelligence in Education
- Social Sciences › Education › Innovations in Medical Education
- Keywords
- ChatGPT, artificial intelligence in education, pharmacology education, self-directed learning, pharmacokinetics, mechanism of action, drug-drug interactions, adverse drug reactions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.