Assessing clinical medicine students’ acceptance of large language model: based on technology acceptance model
Open accessThe DOI matches its Crossref record; 91 of the 91 references it cites were found in a registry or an index.
Abstract
While large language models (LLMs) have demonstrated significant potential in medical education, there is limited understanding of medical students' acceptance of LLMs and the factors influencing their use. This study explores medical students' acceptance of LLMs in learning and examines the factors influencing this acceptance through the lens of the Technology Acceptance Model (TAM). A questionnaire survey conducted among Chinese medical students revealed a high willingness to use LLMs in their studies. The findings suggest that attitudes play a crucial role in predicting medical students' behavioral intentions to use LLMs, mediating the effects of perceived usefulness, perceived ease of use, and perceived risk. Additionally, perceived risk and social influence directly impact behavioral intentions. This study provides compelling evidence supporting the applicability of the TAM to the acceptance of LLMs in medical education, highlighting the necessity for medical students to utilize LLMs as an auxiliary tool in their learning process.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The trial survey results aligned with 2 TAM factors: perceived usefulness and perceived ease of use [36].”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Evaluating structural equation models with unobservable variables and measurement error
Fornell, C., & Larcker, D. F. (1981) · Journal of Marketing Research · doi:10.1177/002224378101800104 · Cited by 109,190 · cited 1×
“…of the model constructs were assessed through reliability (Cronbach’s alpha), convergent validity, and discriminant validity, which included factor loadings, composite reliabilities (CRs), average variance extracted (AVE), the square root of AVE, and the correlations for each construct [45–47].”
MethodPerceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483 · cited 5×
“The items related to perceived usefulness and perceived ease of use are adapted from Davis (1989) and Malik Sallam (2023) [14, 24].”
BackgroundMethodInfluentialStructural equation modeling in practice: A review and recommended two-step approach
Anderson, J. C., & Gerbing, D. W. (1988) · Psychological Bulletin · doi:10.1037/0033-2909.103.3.411 · Cited by 41,941
Preacher, K. J., & Hayes, A. F. (2008) · Behavior Research Methods · doi:10.3758/brm.40.3.879 · Cited by 34,117 · cited 1×
“This finding is not surprising, as individuals’ beliefs about new technologies are well-established as significant factors shaping their attitudes toward and usage of these technologies [35, 36].”
BackgroundWhen to Use and How to Report the Results of PLS-SEM
Hair, J. F., Risher, J. J., Sarstedt, M., & Ringle, C. M. (2019) · European Business Review · doi:10.1108/ebr-11-2018-0203 · Cited by 27,541
User Acceptance of Computer Technology: A Comparison of Two Theoretical Models
Davis, F. D., Bagozzi, R. P., & Warshaw, P. R. (1989) · Management Science · doi:10.1287/mnsc.35.8.982 · Cited by 25,709 · cited 3×
“It has a significant influence on attitudes and further causes an increase in behavioral intention [26, 28].”
BackgroundA Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies
Venkatesh, V., & Davis, F. D. (2000) · Management Science · doi:10.1287/mnsc.46.2.186.11926 · Cited by 23,066 · cited 1×
“The items related to social impact are adapted from Venkatesh & Davis (2000) and Malik Sallam (2023) [24, 42].”
MethodIntrinsic and Extrinsic Motivations: Classic Definitions and New Directions
Ryan, R. M., & Deci, E. L. (2000) · Contemporary Educational Psychology · doi:10.1006/ceps.1999.1020 · Cited by 18,666 · cited 1×
“Therefore, positively assessed outcomes and user-friendly management of LLMs can increase users’ affective reactions towards LLMs and strengthen their sense of efficacy, further develop their positive attitude, and boost behavioral intention [65–67].”
BackgroundStructural equation models with unobservable variables and measurement error: Algebra and statistics
Fornell, C., & Larcker, D. F. (1981) · Journal of Marketing Research · doi:10.1177/002224378101800313 · Cited by 13,287 · cited 1×
“…of the model constructs were assessed through reliability (Cronbach’s alpha), convergent validity, and discriminant validity, which included factor loadings, composite reliabilities (CRs), average variance extracted (AVE), the square root of AVE, and the correlations for each construct [45–47].”
MethodExtrinsic and Intrinsic Motivation to Use Computers in the Workplace 1
Davis, F. D., Bagozzi, R. P., & Warshaw, P. R. (1992) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.1992.tb00945.x · Cited by 6,231
Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., Baabdullah, A. M., Koohang, A., Raghavan, V., Ahuja, M., et al. (2023) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2023.102642 · Cited by 4,584
An updated and expanded assessment of PLS-SEM in information systems research
Hair, J., Hollingsworth, C. L., Randolph, A. B., & Chong, A. Y. L. (2017) · Industrial Management & Data Systems · doi:10.1108/imds-04-2016-0130 · Cited by 4,043 · cited 1×
“According to the guidelines evaluating convergent validity, factor loadings, Cronbach’s alpha, and CR are expected to exceed 0.7, while AVE should surpass 0.5 [50–54].”
MethodInfluentialExtending the TAM for a World-Wide-Web context
Moon, J.-W., & Kim, Y.-G. (2001) · Information & Management · doi:10.1016/s0378-7206(00)00061-6 · Cited by 3,802 · cited 1×
“The items related to behavioral intention are adapted from Moon & Kim(2001) [44].”
Texas A&M International University, Kock, N., Lynn, G., & Stevens Institute of Technology (2012) · Journal of the Association for Information Systems · doi:10.17705/1jais.00302 · Cited by 3,783 · cited 1×
“Then the common bias was evaluated with the methodology provided by Kock and Lynn(2012) [48].”
MethodSallam, M. (2023) · Healthcare · doi:10.3390/healthcare11060887 · Cited by 3,126 · cited 7×
“The items related to perceived usefulness and perceived ease of use are adapted from Davis (1989) and Malik Sallam (2023) [14, 24].”
BackgroundMethodInfluentialRay, P. P. (2023) · Internet of Things and Cyber-Physical Systems · doi:10.1016/j.iotcps.2023.04.003 · Cited by 2,463 · cited 1×
“Therefore, positively assessed outcomes and user-friendly management of LLMs can increase users’ affective reactions towards LLMs and strengthen their sense of efficacy, further develop their positive attitude, and boost behavioral intention [65–67].”
BackgroundTechnology acceptance model: a literature review from 1986 to 2013
Marangunić, N., & Granić, A. (2015) · Universal Access in the Information Society · doi:10.1007/s10209-014-0348-1 · Cited by 2,458 · cited 1×
“Furthermore, the TAM framework also incorporates perceived risk and social influence in assessing the acceptance and usage of technology [14, 29].”
BackgroundWhat if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education
Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., Hickey, D. T., Huang, R., & Agyemang, B. (2023) · Smart Learning Environments · doi:10.1186/s40561-023-00237-x · Cited by 2,003 · cited 1×
“Besides, it may also because LLMs are still a new technology and the enjoy-able experience provided by the instruments, in other words, the intrinsic motivation, facilitates the early use [25, 63, 64].”
BackgroundScherer, R., Siddiq, F., & Tondeur, J. (2019) · Computers & Education · doi:10.1016/j.compedu.2018.09.009 · Cited by 1,923 · cited 1×
“In our study, a significant indirect path existed between these psychological factors and behavioral intention, mediated by attitude towards use [28, 57, 60, 61].”
BackgroundChatGPT: five priorities for research
van Dis, E. A. M., Bollen, J., Zuidema, W., van Rooij, R., & Bockting, C. L. (2023) · Nature · doi:10.1038/d41586-023-00288-7 · Cited by 1,842 · cited 1×
“These models can autonomously learn from data and, after being trained on vast volumes of text data, generate advanced, humanlike language [3–5].”
BackgroundAGE DIFFERENCES IN TECHNOLOGY ADOPTION DECISIONS: IMPLICATIONS FOR A CHANGING WORK FORCE
MORRIS, M. G., & VENKATESH, V. (2000) · Personnel Psychology · doi:10.1111/j.1744-6570.2000.tb00206.x · Cited by 1,723
Chatting about ChatGPT: how may AI and GPT impact academia and libraries?
Lund, B. D., & Wang, T. (2023) · Library Hi Tech News · doi:10.1108/lhtn-01-2023-0009 · Cited by 1,355
Technology acceptance model in educational context: A systematic literature review
Granić, A., & Marangunić, N. (2019) · British Journal of Educational Technology · doi:10.1111/bjet.12864 · Cited by 1,204 · cited 1×
“TAM, a management psychology model derived from the theory of reasoned action, is used to investigate potential users’ predispositions toward adopting new technology [15–18].”
BackgroundKizilcec, R. F., Pérez-Sanagustín, M., & Maldonado, J. J. (2017) · Computers & Education · doi:10.1016/j.compedu.2016.10.001 · Cited by 1,003 · cited 1×
“According to the guidelines evaluating convergent validity, factor loadings, Cronbach’s alpha, and CR are expected to exceed 0.7, while AVE should surpass 0.5 [50–54].”
MethodInfluentialStatistical Design and Analysis of Experiments: With Applications to Engineering and Science
Mason, R. L., Gunst, R. F., & Hess, J. L. (2003) · Wiley Series in Probability and Statistics · doi:10.1002/0471458503 · Cited by 999
Eysenbach, G. (2023) · JMIR Medical Education · doi:10.2196/46885 · Cited by 840 · cited 1×
“As a result, the new technology will be a useful tool for medical students, particularly for students preferring student-centered learning [6, 7, 11, 77].”
BackgroundWhat ChatGPT and generative AI mean for science
Stokel-Walker, C., & Van Noorden, R. (2023) · Nature · doi:10.1038/d41586-023-00340-6 · Cited by 828
Algorithmic bias: review, synthesis, and future research directions
Kordzadeh, N., & Ghasemaghaei, M. (2022) · European Journal of Information Systems · doi:10.1080/0960085x.2021.1927212 · Cited by 770 · cited 1×
“Besides, because the underlying training data-set may be biased, or the inherent bias may exist in the algorithms designing process, the bias could remain and lead to biased behaviors, amplifying underlying inequalities and discriminatory outcomes [7, 81, 82].”
BackgroundUsing ChatGPT for second language writing: pitfalls and potentials
Barrot, J. S. (2023) · Assessing Writing · doi:10.1016/j.asw.2023.100745 · Cited by 770 · cited 1×
“Second, as LLMs raise increasing ethical and informational concerns, and as medical students’ experience, knowledge, and skills with LLMs evolve, their attitudes and intentions toward using these tools may change over time [85, 86].”
BackgroundLarge Language Models in Medical Education: Opportunities, Challenges, and Future Directions
Abd-alrazaq, A., AlSaad, R., Alhuwail, D., Ahmed, A., Healy, P. M., Latifi, S., Aziz, S., Damseh, R., Alabed Alrazak, S., & Sheikh, J. (2023) · JMIR Medical Education · doi:10.2196/48291 · Cited by 722 · cited 1×
“In the area lacking educational resources, it’s necessary to focus on how LLMs can bridge the gap and distribute educational opportunities more fairly [10].”
BackgroundImpact of ChatGPT on learners in a L2 writing practicum: an exploratory investigation
Yan, D. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-11742-4 · Cited by 713 · cited 1×
“This may be due to some studies often removing attitudes from TAM regarding its weak role in mediating the effects of perceived usefulness and perceived ease of use on behavioral intention [15, 62].”
BackgroundAbdullah, F., Ward, R., & Ahmed, E. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2016.05.014 · Cited by 693 · cited 1×
“In our study, a significant indirect path existed between these psychological factors and behavioral intention, mediated by attitude towards use [28, 57, 60, 61].”
BackgroundComparison of Model Fit Indices Used in Structural Equation Modeling Under Multivariate Normality
Cangur, S., & Ercan, I. (2015) · Journal of Modern Applied Statistical Methods · doi:10.22237/jmasm/1430453580 · Cited by 626
Tools such as ChatGPT threaten transparent science; here are our ground rules for their use
(2023) · Nature · doi:10.1038/d41586-023-00191-1 · Cited by 605
The rise of ChatGPT : Exploring its potential in medical education
Lee, H. (2024) · Anatomical Sciences Education · doi:10.1002/ase.2270 · Cited by 596 · cited 6×
“Through preliminary investigation, the usage of LLMs in medical students mainly includes helping to complete assignments or preparing examinations, finding research topics, helping to write papers, and assisting clinical decision-making [7, 11].”
BackgroundInfluentialUser acceptance of YouTube for procedural learning: An extension of the Technology Acceptance Model
Lee, D. Y., & Lehto, M. R. (2013) · Computers & Education · doi:10.1016/j.compedu.2012.10.001 · Cited by 565 · cited 3×
“User acceptance refers to the prospective users’ willingness to adopt a technology [15].”
BackgroundCollaborating with ChatGPT in argumentative writing classrooms
Su, Y., Lin, Y., & Lai, C. (2023) · Assessing Writing · doi:10.1016/j.asw.2023.100752 · Cited by 563 · cited 1×
“Second, as LLMs raise increasing ethical and informational concerns, and as medical students’ experience, knowledge, and skills with LLMs evolve, their attitudes and intentions toward using these tools may change over time [85, 86].”
BackgroundKesharwani, A., & Singh Bisht, S. (2012) · International Journal of Bank Marketing · doi:10.1108/02652321211236923 · Cited by 517
A Categorical Archive of ChatGPT Failures
Borji, A. (2023) · doi:10.21203/rs.3.rs-2895792/v1 · Cited by 514
A Categorical Archive of ChatGPT Failures
Borji, A. (2023) · arXiv · doi:10.48550/arxiv.2302.03494 · Cited by 514 · cited 2×
“Risk perception, which is influenced by students’ knowledge, beliefs, and experience, could further affect their attitudes and intentions toward LLMs [8, 23].”
Background“What Can ChatGPT Do?” Analyzing Early Reactions to the Innovative AI Chatbot on Twitter
Taecharungroj, V. (2023) · Big Data and Cognitive Computing · doi:10.3390/bdcc7010035 · Cited by 489 · cited 1×
“Besides, it may also because LLMs are still a new technology and the enjoy-able experience provided by the instruments, in other words, the intrinsic motivation, facilitates the early use [25, 63, 64].”
BackgroundAutomated vehicle acceptance in China: Social influence and initial trust are key determinants
Zhang, T., Tao, D., Qu, X., Zhang, X., Zeng, J., Zhu, H., & Zhu, H. (2020) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2020.01.027 · Cited by 453 · cited 1×
“As peer-to-peer communication is an important way for people to obtain new technology, the adoption of LLMs could be influenced by social impact with network externalities [21, 22].”
BackgroundAlfadda, H. A., & Mahdi, H. S. (2021) · Journal of Psycholinguistic Research · doi:10.1007/s10936-020-09752-1 · Cited by 438 · cited 4×
“The finding is inconsistent with previous studies of new educational technology, but consistent with a study of doctoral students’ acceptance to write using ChatGPT [4, 27, 28].”
BackgroundResultInfluentialRao, A., Pang, M., Kim, J., Kamineni, M., Lie, W., Prasad, A. K., Landman, A., Dreyer, K., & Succi, M. D. (2023) · Journal of Medical Internet Research · doi:10.2196/48659 · Cited by 412
ChatGPT and consumers: Benefits, Pitfalls and Future Research Agenda
Paul, J., Ueno, A., & Dennis, C. (2023) · International Journal of Consumer Studies · doi:10.1111/ijcs.12928 · Cited by 345 · cited 2×
“Additionally, social impact, which encompasses the opinions of peers and the social circle, can significantly affect individuals’ attitudes toward and usage of technology [33, 34].”
BackgroundDrone delivery: Factors affecting the public’s attitude and intention to adopt
Yoo, W., Yu, E., & Jung, J. (2018) · Telematics and Informatics · doi:10.1016/j.tele.2018.04.014 · Cited by 337
Estriegana, R., Medina-Merodio, J.-A., & Barchino, R. (2019) · Computers & Education · doi:10.1016/j.compedu.2019.02.010 · Cited by 334 · cited 2×
“The finding is inconsistent with previous studies of new educational technology, but consistent with a study of doctoral students’ acceptance to write using ChatGPT [4, 27, 28].”
BackgroundResultEdmunds, R., Thorpe, M., & Conole, G. (2012) · British Journal of Educational Technology · doi:10.1111/j.1467-8535.2010.01142.x · Cited by 333 · cited 1×
“The items related to attitude towards use are adapted from Edmunds (2012) [43].”
BackgroundSallam, M., Salim, N., Barakat, M., & Al-Tammemi, A. (2023) · Narra J · doi:10.52225/narra.v3i1.103 · Cited by 331 · cited 2×
“Transparent risk management policies should be made before the application of LLMs in medical education [8, 73, 74].”
BackgroundLee, Y.-F., Hwang, G.-J., & Chen, P.-Y. (2022) · Educational Technology Research and Development · doi:10.1007/s11423-022-10142-8 · Cited by 323 · cited 1×
“Artificial intelligence (AI) has played a significant role in the digital world, serving as a transformative force across various fields [1, 2].”
BackgroundPerceptions and Needs of Artificial Intelligence in Health Care to Increase Adoption: Scoping Review
Chew, H. S. J., & Achananuparp, P. (2022) · Journal of Medical Internet Research · doi:10.2196/32939 · Cited by 243 · cited 1×
“Transparent risk management policies should be made before the application of LLMs in medical education [8, 73, 74].”
BackgroundDahri, N. A., Yahaya, N., Al-Rahmi, W. M., Aldraiweesh, A., Alturki, U., Almutairy, S., Shutaleva, A., & Soomro, R. B. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e29317 · Cited by 239 · cited 1×
“As peer-to-peer communication is an important way for people to obtain new technology, the adoption of LLMs could be influenced by social impact with network externalities [21, 22].”
BackgroundTheodosiou, A. A., & Read, R. C. (2023) · Journal of Infection · doi:10.1016/j.jinf.2023.07.006 · Cited by 237 · cited 1×
“Besides, because the underlying training data-set may be biased, or the inherent bias may exist in the algorithms designing process, the bias could remain and lead to biased behaviors, amplifying underlying inequalities and discriminatory outcomes [7, 81, 82].”
BackgroundAssessing Health Students' Attitudes and Usage of ChatGPT in Jordan: Validation Study
Sallam, M., Salim, N. A., Barakat, M., Al-Mahzoum, K., Al-Tammemi, A. B., Malaeb, D., Hallit, R., & Hallit, S. (2023) · JMIR Medical Education · doi:10.2196/48254 · Cited by 234 · cited 5×
“The items related to perceived usefulness and perceived ease of use are adapted from Davis (1989) and Malik Sallam (2023) [14, 24].”
BackgroundMethodInfluentialThe Role of Large Language Models in Medical Education: Applications and Implications
Safranek, C. W., Sidamon-Eristoff, A. E., Gilson, A., & Chartash, D. (2023) · JMIR Medical Education · doi:10.2196/50945 · Cited by 233 · cited 1×
“These models can autonomously learn from data and, after being trained on vast volumes of text data, generate advanced, humanlike language [3–5].”
BackgroundChoosing between the theory of planned behavior (TPB) and the technology acceptance model (TAM)
Cheng, E. W. L. (2019) · Educational Technology Research and Development · doi:10.1007/s11423-018-9598-6 · Cited by 222
The Advent of Generative Language Models in Medical Education
Karabacak, M., Ozkara, B. B., Margetis, K., Wintermark, M., & Bisdas, S. (2023) · JMIR Medical Education · doi:10.2196/48163 · Cited by 208 · cited 1×
“LLMs have attracted more and more attention in medical education and their transformative implications make their application seemingly inevitable [87–89].”
BackgroundThirunavukarasu, A. J., Hassan, R., Mahmood, S., Sanghera, R., Barzangi, K., El Mukashfi, M., & Shah, S. (2023) · JMIR Medical Education · doi:10.2196/46599 · Cited by 187
Improving IoT Technology Adoption through Improving Consumer Trust
AlHogail, A. (2018) · Technologies · doi:10.3390/technologies6030064 · Cited by 180 · cited 1×
“…towards using LLMs. Perceived usefulness of the new technologies in achieving destination and high user-friendly level, which have been reflected by the general agreement of the participants in this study, could encourage people to have a more positive attitude towards their application [57–59].”
BackgroundWilliams, D. J., & Noyes, J. M. (2007) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220500484419 · Cited by 179 · cited 1×
“Risk perception is often included as an additional variable in the TAM model, affecting students’ attitudes toward and usage of new technology [24, 30–32].”
BackgroundAutomation bias: Empirical results assessing influencing factors
Goddard, K., Roudsari, A., & Wyatt, J. C. (2014) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2014.01.001 · Cited by 163 · cited 1×
“Growing up in the digital age, medical students who have limited background knowledge may have too much reliance on LLMs and cannot identify errors [7, 83, 84].”
BackgroundPerceived risks from drone food delivery services before and after COVID-19
Choe, J. Y., Kim, J. J., & Hwang, J. (2021) · International Journal of Contemporary Hospitality Management · doi:10.1108/ijchm-08-2020-0839 · Cited by 158 · cited 1×
“Additionally, it has been reported that attitude toward use is a significant mediating variable between perceived risk and social impact on one hand, and behavioral intention on the other [38–41].”
BackgroundZou, M., & Huang, L. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1259531 · Cited by 150 · cited 1×
“The finding is inconsistent with previous studies of new educational technology, but consistent with a study of doctoral students’ acceptance to write using ChatGPT [4, 27, 28].”
ResultAssessing the utility of ChatGPT throughout the entire clinical workflow
Rao, A., Pang, M., Kim, J., Kamineni, M., Lie, W., Prasad, A. K., Landman, A., Dreyer, K. J., & Succi, M. D. (2023) · doi:10.1101/2023.02.21.23285886 · Cited by 134 · cited 1×
“LLMs have attracted more and more attention in medical education and their transformative implications make their application seemingly inevitable [87–89].”
BackgroundAlghazi, S. S., Kamsin, A., Almaiah, M. A., Wong, S., & Shuib, L. (2021) · Sustainability · doi:10.3390/su13041856 · Cited by 125
An adapted TPB approach to consumers’ acceptance of service-delivery drones
Ramadan, Z. B., Farah, M. F., & Mrad, M. (2016) · Technology Analysis and Strategic Management · doi:10.1080/09537325.2016.1242720 · Cited by 123
The Pros and Cons of Using ChatGPT in Medical Education: A Scoping Review
Mohammad, B., Supti, T., Alzubaidi, M., Shah, H., Alam, T., Shah, Z., & Househ, M. (2023) · Studies in Health Technology and Informatics · doi:10.3233/shti230580 · Cited by 114 · cited 5×
“Through preliminary investigation, the usage of LLMs in medical students mainly includes helping to complete assignments or preparing examinations, finding research topics, helping to write papers, and assisting clinical decision-making [7, 11].”
BackgroundInfluentialAutomation bias in electronic prescribing
Lyell, D., Magrabi, F., Raban, M. Z., Pont, L. G., Baysari, M. T., Day, R. O., & Coiera, E. (2017) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-017-0425-5 · Cited by 103 · cited 1×
“Growing up in the digital age, medical students who have limited background knowledge may have too much reliance on LLMs and cannot identify errors [7, 83, 84].”
BackgroundMultigenerational Challenges and the Future of Graduate Medical Education.
Boysen, P. G., Daste, L. S., & Northern, T. (2016) · Europe PMC (PubMed Central) · Cited by 96
Students’ adoption towards behavioral intention of digital learning platform
Songkram, N., Chootongchai, S., Osuwan, H., Chuppunnarat, Y., & Songkram, N. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-11637-4 · Cited by 93 · cited 2×
“In our study, a significant indirect path existed between these psychological factors and behavioral intention, mediated by attitude towards use [28, 57, 60, 61].”
BackgroundRestructuring Medical Education to Meet Current and Future Health Care Needs
Pershing, S., & Fuchs, V. R. (2013) · Academic Medicine · doi:10.1097/acm.0000000000000020 · Cited by 78
Sanmarchi, F., Bucci, A., & Golinelli, D. (2023) · doi:10.1101/2023.02.06.23285514 · Cited by 70
Sanmarchi, F., Bucci, A., Nuzzolese, A. G., Carullo, G., Toscano, F., Nante, N., & Golinelli, D. (2024) · Journal of Public Health · doi:10.1007/s10389-023-01936-y · Cited by 70 · cited 1×
“As LLMs depend on huge training datasets lacking transparency, it may generate biased and wrong content, or affect academic integrity, which can lead to severe consequences in clinical work and medical learning [8, 68–72].”
Backgroundde Groot, J. I. M., Schweiger, E. B., & Schubert, I. (2020) · Risk Analysis · doi:10.1111/risa.13457 · Cited by 67 · cited 1×
“…other factors, social impact is the most influential factor in the medical students’ intentions, which is consistent with previous studies, as people’s beliefs about innovative technologies have been established as the vital factor shaping people’s intentions toward new technologies [38, 75, 76].”
ResultMustafa, M. H., Ahmad, M. B., Shaari, Z. H., & Jannat, T. (2021) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2021.102399 · Cited by 63 · cited 1×
“It has been reported that TAM effectively predicts individual behavior by examining the causal relationships among attitudes, intentions, and behaviors [20].”
BackgroundChatGPT and the future of medical education
Feng, S., & Shen, Y. (2023) · Academic Medicine · doi:10.1097/acm.0000000000005242 · Cited by 61 · cited 2×
“As a result, the new technology will be a useful tool for medical students, particularly for students preferring student-centered learning [6, 7, 11, 77].”
BackgroundChatGPT in Medical Education: A Precursor for Automation Bias?
Nguyen, T. (2024) · JMIR Medical Education · doi:10.2196/50174 · Cited by 59 · cited 1×
“What’s more, although LLMs could help supplement medical students’ experience during the clinical phase through augmented reality, interaction with real patients and professionals is still necessary, as their reactions in real time are difficult to predict [80].”
BackgroundEducating medical students in the era of ubiquitous information
Friedman, C. P., Donaldson, K. M., & Vantsevich, A. V. (2016) · Medical Teacher · doi:10.3109/0142159x.2016.1150990 · Cited by 51 · cited 1×
“While numerous reports have discussed the potential goals and directions for the application of LLMs, there has been limited practical investigation into whether and how the next generation plans to use LLMs and the key factors influencing their adoption in medical education [12, 13].”
BackgroundBalaskas, S., Panagiotarou, A., & Rigou, M. (2022) · Administrative Sciences · doi:10.3390/admsci12040129 · Cited by 51
Artificial Intelligence and Groups: Effects of Attitudes and Discretion on Collaboration
Bezrukova, K., Griffith, T. L., Spell, C., Rice, V., & Yang, H. E. (2023) · Group & Organization Management · doi:10.1177/10596011231160574 · Cited by 51 · cited 2×
“Additionally, social impact, which encompasses the opinions of peers and the social circle, can significantly affect individuals’ attitudes toward and usage of technology [33, 34].”
BackgroundPersuading Patients Using Rhetoric to Improve Artificial Intelligence Adoption: Experimental Study
Sebastian, G., George, A., & Jackson Jr, G. (2023) · Journal of Medical Internet Research · doi:10.2196/41430 · Cited by 48 · cited 1×
“Risk perception is often included as an additional variable in the TAM model, affecting students’ attitudes toward and usage of new technology [24, 30–32].”
BackgroundShapira, S., & Cauchard, J. R. (2022) · Frontiers in Public Health · doi:10.3389/fpubh.2022.1019626 · Cited by 43 · cited 1×
“Studies have shown that attitude toward use mediates the relationship between perceived usefulness and perceived ease of use on one hand, and behavioral intention on the other [26, 37].”
BackgroundFinding the Place of ChatGPT in Medical Education
van de Ridder, J. M. M., Shoja, M. M., & Rajput, V. (2023) · Academic Medicine · doi:10.1097/acm.0000000000005254 · Cited by 41 · cited 1×
“For example, when medical students are asked to write a self-reflection or firsthand experiences piece, LLMs are not appropriate [78, 79].”
BackgroundHow Health Humanities Will Save the Life of the Humanities
Klugman, C. M. (2017) · Journal of Medical Humanities · doi:10.1007/s10912-017-9453-5 · Cited by 32 · cited 1×
“For example, when medical students are asked to write a self-reflection or firsthand experiences piece, LLMs are not appropriate [78, 79].”
BackgroundRavi, A., Neinstein, A., & Murray, S. G. (2023) · ATS Scholar · doi:10.34197/ats-scholar.2023-0036ps · Cited by 31 · cited 1×
“…controversy in medical education, previous studies have mostly targeted all student groups, and there is a lack of specific surveys on medical students’ attitudes and willingness to use LLMs and related influencing factors, the specific situation is still unknown, our article fills this gap [56].”
BackgroundTransparency Guidance for ChatGPT Usage in Scientific Writing
Aczel, B., & Wagenmakers, E.-J. (2023) · doi:10.31234/osf.io/b58ex · Cited by 28
Yeshua‐Katz, D., Shapira, S., Aharonson‐Daniel, L., Clarfield, A. M., & Sarid, O. (2021) · Health Communication · doi:10.1080/10410236.2021.1956071 · Cited by 25 · cited 1×
“…other factors, social impact is the most influential factor in the medical students’ intentions, which is consistent with previous studies, as people’s beliefs about innovative technologies have been established as the vital factor shaping people’s intentions toward new technologies [38, 75, 76].”
ResultReally New Services: Perceived Risk and Adoption Intentions
Savas-Hall, S., Koku, P. S., & Mangleburg, T. (2022) · Services Marketing Quarterly · doi:10.1080/15332969.2021.1994193 · Cited by 13
The Role of Large Language Models in Medical Education: Applications and Implications (Preprint)Preprint
Safranek, C. W., Sidamon‐Eristoff, A. E., Gilson, A., & Chartash, D. (2023) · doi:10.2196/preprints.50945 · Cited by 7
A Rubric To Evaluate Standards Based Lesson Plans And Students' Achievement Of The Standards
Carpinelli, J. D., Kimmel, H., Hirsch, L. S., Burr-Alexander, L., Rockland, R. H., & O'Shea, M. R. (2020) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--3703 · Cited by 5
Research works printed but not linked: 1
- Byrne BM. Structural equation modeling with AMOS: basic concepts, applications, and programming (multivariate applications series). N Y Taylor Francis Group. 2010;396:7384.
Cited by
Basil, M., Ahmed, W., Hajeomar, R., Strawbridge, J., Lynch, M. R., & Mukhalalati, B. (2026) · BMC Medical Education · doi:10.1186/s12909-025-08527-3 · Cited by 20
AI chatbots as ‘pocket doctors’: intimate health support for young women in Lebanon
Mina, A., Ghadban, E., Boutros, T., Saade, N., Fayad, L., Karam, M. A., Breidi, S. E., Elias, M., Ghosh, M., Khoury, L. E., et al. (2025) · BMC Public Health · doi:10.1186/s12889-025-25386-1 · Cited by 12
“Using TAM as a lens allows us to make sense of both the drivers, such as convenience and stigma reduction, and the barriers, such as concerns over accuracy, privacy, and the lack of physical examination, that influence how young women view chatbots for intimate health concerns [34, 35].”
Asker, Ö. F., Recai, M. S., Genç, Y. E., Dogan, K. A., Şener, T. E., & Şahin, B. (2025) · British Journal of Urology · doi:10.1111/bju.16873 · Cited by 12
“It has been reported that medical students and urologists across various levels of seniority, ranging from fi rst-year residents to consultants, utilise LLMs as tools for acquiring medical information [2,3].”
Mindfulness and AI adoption: extending the technology acceptance model for Chinese media students
Lan, Y., Liu, S., Chen, H., & Xia, L. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1637502 · Cited by 12
“Liu (2024) argues that, in the context of media education, it is crucial to accurately assess students’ individual characteristics, analyze their behaviors, and address their personal awareness and attitudes.”
Ebihara, H., Kasai, H., Shimizu, I., Shikino, K., Tajima, H., Kimura, Y., & Ito, S. (2025) · JMIR Medical Education · doi:10.2196/76702 · Cited by 10
“The trial survey results aligned with 2 TAM factors: perceived usefulness and perceived ease of use [36].”
Metadata
- Authors
- Liu, F., Chang, X., Zhu, Q., Huang, Y., Li, Y., & Wang, H.
- Affiliations
- Chinese Academy of Medical Sciences & Peking Union Medical College (CN)
- Corresponding author
- Wang, Hai
- Venue
- BMC Medical Education
- Published
- 2024-11-03
- Volume
- 24
- Issue
- 1
- Pages
- 1251-1251
- ISSN
- 1472-6920 (ISSN-L)
- PMC
- PMC11533422
- OpenAlex
- W4404011877
- Cited by
- 35
- References
- 87
- Citations by year
- 2026: 24 · 2025: 11
- FWCI
- 3.27
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc-nd
- creativecommons.org/licenses/by-nc-nd/4.0 (tdm)
- creativecommons.org/licenses/by-nc-nd/4.0 (vor)
- Locations
- BMC Medical Education (publishedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Peking Union Medical College 2023 Central University Education Teaching Reform Special Fund Support Project (2023zlgl016)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Decision Sciences › Information Systems and Management › Technology Adoption and User Behaviour
- Social Sciences › Education › Artificial Intelligence in Education
- Keywords
- large language models, technology acceptance, medical students, medical education, technology acceptance model, perceived usefulness, perceived ease of use, risk perception, social influence, behavioral intention, attitudes toward AI
- MeSH terms
- Adult, China, Education, Medical, Undergraduate, Female, Humans, Language, Male, Surveys and Questionnaires, Students, Medical, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

