Assessing Health Students' Attitudes and Usage of ChatGPT in Jordan: Validation Study
Open accessPublished version of a preprint
The DOI matches its Crossref record; 103 of the 103 references it cites were found in a registry or an index; 27 of the 67 sources its claims cite were checked for support.
Abstract
Background: ChatGPT is a conversational large language model that has the potential to revolutionize knowledge acquisition. However, the impact of this technology on the quality of education is still unknown considering the risks and concerns surrounding ChatGPT use. Therefore, it is necessary to assess the usability and acceptability of this promising tool. As an innovative technology, the intention to use ChatGPT can be studied in the context of the technology acceptance model (TAM). Objective: This study aimed to develop and validate a TAM-based survey instrument called TAME-ChatGPT (Technology Acceptance Model Edited to Assess ChatGPT Adoption) that could be employed to examine the successful integration and use of ChatGPT in health care education. Methods: The survey tool was created based on the TAM framework. It comprised 13 items for participants who heard of ChatGPT but did not use it and 23 items for participants who used ChatGPT. Using a convenient sampling approach, the survey link was circulated electronically among university students between February and March 2023. Exploratory factor analysis (EFA) was used to assess the construct validity of the survey instrument. Results: The final sample comprised 458 respondents, the majority among them undergraduate students (n=442, 96.5%). Only 109 (23.8%) respondents had heard of ChatGPT prior to participation and only 55 (11.3%) self-reported ChatGPT use before the study. EFA analysis on the attitude and usage scales showed significant Bartlett tests of sphericity scores (P<.001) and adequate Kaiser-Meyer-Olkin measures (0.823 for the attitude scale and 0.702 for the usage scale), confirming the factorability of the correlation matrices. The EFA showed that 3 constructs explained a cumulative total of 69.3% variance in the attitude scale, and these subscales represented perceived risks, attitude to technology/social influence, and anxiety. For the ChatGPT usage scale, EFA showed that 4 constructs explained a cumulative total of 72% variance in the data and comprised the perceived usefulness, perceived risks, perceived ease of use, and behavior/cognitive factors. All the ChatGPT attitude and usage subscales showed good reliability with Cronbach α values >.78 for all the deduced subscales. Conclusions: The TAME-ChatGPT demonstrated good reliability, validity, and usefulness in assessing health care students’ attitudes toward ChatGPT. The findings highlighted the importance of considering risk perceptions, usefulness, ease of use, attitudes toward technology, and behavioral factors when adopting ChatGPT as a tool in health care education. This information can aid the stakeholders in creating strategies to support the optimal and ethical use of ChatGPT and to identify the potential challenges hindering its successful implementation. Future research is recommended to guide the effective adoption of ChatGPT in health care education.
Overview
CoChat Summary
TL;DR
This validation study developed TAME-ChatGPT, a TAM-based instrument to assess health care students’ attitudes toward and use of ChatGPT, and tested it among 458 university students in Jordan. It found acceptable factor structure and reliability for attitude (3 factors) and usage (4 factors) scales, though only 109 respondents had heard of ChatGPT and 55 had used it.
Key findings
- Among 458 respondents (96.5% undergraduate), only 109 (23.8%) had heard of ChatGPT before the study and 55 (11.3%) self-reported prior ChatGPT use.
- Attitude scale (13 items, n=109): EFA yielded 3 factors—perceived risk, technology/social influence, and anxiety—explaining 69.3% of variance; KMO was 0.823, Bartlett P<.001, and Cronbach α values were .876, .858, and .827. Mean perceived risk was 12.5 (SD 4.8), technology/social influence 19.3 (SD 4.1), and anxiety 6.6 (SD 2.9).
- Usage scale (14 items, n=55): EFA yielded 4 factors—perceived usefulness, perceived risk, perceived ease of use, and behavior—explaining 72% of variance; KMO was 0.702, Bartlett P<.001, and Cronbach α values were .885, .718, .824, and .781. Mean perceived usefulness was 24.2 (SD 4.9), perceived risk 7.2 (SD 2.8), ease of use 8.9 (SD 1.6), and behavior 9.8 (SD 3.3).
- Older age, male sex, and postgraduate education were associated with higher probability of having heard of ChatGPT before the study (P=.001, <.001, and .002, respectively); no tested variables were significantly associated with prior ChatGPT use.
Methods
- Cross-sectional validation survey using convenience sampling; the survey link was circulated via WhatsApp and Facebook to health school students in Jordan from February 28 to March 31, 2023. Inclusion criteria were age ≥18 years, concurrent enrollment in a Jordanian university, and very good Arabic comprehension; final sample was 458.
- The TAME-ChatGPT instrument was created based on the TAM framework, with 13 items for participants who heard of ChatGPT but did not use it and 23 items for participants who used ChatGPT (total 36 items), scored on a 5-point Likert scale. Domains included perceived usefulness, ease of use, risks, anxiety, attitude toward technology, social influence, and cognitive/behavioral factors.
- Analysis used exploratory factor analysis with principal component analysis and oblimin rotation, Kaiser-Meyer-Olkin and Bartlett tests, Cronbach α for reliability, and descriptive statistics with chi-square and Mann-Whitney U tests; significance was set at P<.05.
Limitations
- Stated: the limited sample size was a major limitation; respondent fatigue from the lengthy scale may have reduced participation; selection bias from convenience sampling should be considered; female predominance may reflect selection bias but aligns with dentistry, pharmacy, and nursing demographics in Jordan; potential bias in the tested constructs despite using TAM.
- Evident from the text: the usage EFA relied on only 55 prior users and the attitude EFA on 109 respondents, so the factor solutions are based on small subsamples; the design was cross-sectional, self-reported, and single-country; no confirmatory factor analysis was conducted, and the authors call for a future multinational project to perform CFA.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
11 Valid · 2 Not valid · 14 Not checked · 51 Own results and interpretations
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“The minimum sample size was estimated to be 360 participants following the established guidelines for survey validation studies, considering 36 items with 10 participants per item [42-44].”
§ Assessing Health Students' Attitudes and Usage of ChatGPT in Jordan: Validation Study > Methods > Inclusion and Exclusion Criteria
What the sources say
- Supportedcites [42] source
In Phase 2, Step 4 (survey administration and sample size), the paper gives a rule of thumb of at least 10 participants per scale item. Applied to the citing study’s 36 items, that yields 360 participants. The paper cautions that no single item-to-respondent ratio works for every survey. (LLM, conf=0.91)
- Not checked yetcites [43] source
- Not checked yetcites [44] source
hedgedn = 360- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Risk perception plays a crucial role in decision-making, including the adoption of novel technologies like ChatGPT [65-68].”
§ Assessing Health Students' Attitudes and Usage of ChatGPT in Jordan: Validation Study > Discussion > Principal Results
What the sources say
- Not checked yetcites [65] source
- Not checked yetcites [66] source
- Not checked yetcites [67] source
- Partly supportedcites [68] sourceExperimental — accuracy not yet measured
The Introduction’s “Trust” section says perceived risks make users skeptical of AI assistants, and its “Privacy Concerns” section says such concerns can hinder technology adoption. The paper addresses health care AI adoption, not ChatGPT specifically or decision-making generally, so those extensions are not established by this source. (LLM, conf=0.84)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“The use of ChatGPT can also be associated with a deterioration in empathy and social skills [9].”
§ Assessing Health Students' Attitudes and Usage of ChatGPT in Jordan: Validation Study > Discussion > Principal Results
What the sources say
- Could not verifycites [9] sourceExperimental — accuracy not yet measured
Section 4.4 discusses ChatGPT’s lack of personal and emotional perspectives, while Section 2.3 lists a risk of declining clinical skills. Neither says that using ChatGPT may deteriorate users’ empathy or social skills; searches for empathy, social skills, and interpersonal-skill decline found no such passage. Page numbers were not available in our copy. (LLM, conf=0.72)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“On the other hand, one of the negative driving factors for ChatGPT use is the potential for dependence or even addiction [95].”
§ Assessing Health Students' Attitudes and Usage of ChatGPT in Jordan: Validation Study > Discussion > Principal Results
What the sources say
- Could not verifycites [95] sourceExperimental — accuracy not yet measured
The Introduction (p. 2) and Summary of Evaluation (p. 10) discuss ChatGPT’s ethical risks, including bias, prompt injection, misinformation, and toxicity, but not dependence on or addiction to ChatGPT. Searches for dependence, addiction, and overreliance found no passage addressing that claim; the addiction example on p. 9 concerns heroin, not ChatGPT use. (LLM, conf=0.74)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“In this exploratory study, we observed a high level of ease of use among the small group of participants who reported using ChatGPT, likely due to its user-friendly nature and free accessibility [17,71,90].”
§ Assessing Health Students' Attitudes and Usage of ChatGPT in Jordan: Validation Study > Discussion > Principal Results
What the sources say
- Not checked yetcites [17] OpenAI: models GPT-3OpenAI2023-04-02https://beta.openai.com/docs/models
- Partly supportedcites [71] sourceExperimental — accuracy not yet measured
Sallam & Malik's systematic review supports only the 'free accessibility' half of the attributed explanation: Section 3.3 (Benefits and Possible Applications) records that 'Being a free package was mentioned as a benefit in two records (3.3%, Figure 3)', and the categorization of benefits lists 'being a freely available package'; the Discussion likewise notes 'providing easily accessible and understandable health information for the general public'. However, no passage in our copy states a high 'ease of use' or a 'user-friendly nature' of ChatGPT as a benefit — the review synthesizes editorials, preprints and commentaries, not participant ratings, and its Conclusions instead invoke the perspective-article title 'AI in the hands of imperfect users' (Kostick-Quenet and Gerke, ref. [83]) to caution about user competence. The ease-of-use portion of the claim is therefore not supported by this source. (LLM, conf=0.72)
- Not checked yetcites [90] source
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
30 more claims · 1 with their cited sources checked
Create a free account to see all 78 claims and to verify the 40 references still open.
- Probably not a substantial claim. 21
- It may state two separate claims as one. 29
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Gonzalo and Enriquez (2023) found that perceived risk significantly and negatively influences students' intention to use ChatGPT-emerging as a stronger predictor than other commonly studied factors such as perceived usefulness and ease of use (Sallam et al., 2023).”
From Chat or cheat? Academic dishonesty, risk perceptions, and ChatGPT usage in higher education students (2025) · cites this paper as Sallam et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“our results are consistent with previous research that showed a link between perceived risk and the intention to use ChatGPT”
From Chat or cheat? Academic dishonesty, risk perceptions, and ChatGPT usage in higher education students (2025) · cites this paper as Sallam et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In higher education, GAI can provide accurate responses, enhance texts, summarize research, create virtual patient scenarios, and explain concepts and key findings [2–4].”
From Generative artificial intelligence in physiotherapy education: great potential amidst challenges- a qualitative interview study (2025) · cites this paper as [4]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These studies involved faculty and mostly medical students, but also other health-related students from countries worldwide, including Europe, the Middle East, northern and sub-Saharan Africa, North America, Asia, Australia, and New Zealand [24–29].”
From Artificial intelligence in undergraduate medical education: an updated scoping review (2025) · cites this paper as [24]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Eight studies examined the knowledge, attitudes, and skills of medical students and educators regarding LLMs, specifically ChatGPT [24, 26–29, 79–81]. Students generally expressed a more positive attitude toward LLMs than practicing physicians, showing optimism about their potential to support learners and educators [81]. Those who were more knowledgeable about LLMs tended to hold a more positive”
From Artificial intelligence in undergraduate medical education: an updated scoping review (2025) · cites this paper as [24]
Experimental — accuracy not yet measured
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“only 55 (11.3%) self-reported ChatGPT use before the study.”
§ Assessing Health Students' Attitudes and Usage of ChatGPT in Jordan: Validation Study > Abstract > Results
Reported 11.3 · recomputed 12.008734
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Assessing Health Students' Attitudes and Usage of ChatGPT in Jordan: Validation Study > Abstract > Results
“All the ChatGPT attitude and usage subscales showed good reliability with Cronbach α values >.78 for all the deduced subscales.”
§ Assessing Health Students' Attitudes and Usage of ChatGPT in Jordan: Validation Study > Results > Factorability of the Correlation Matrix of the Usage Scale
“The 4 factors demonstrated good internal consistency (Cronbach α values of .885, .718, .824, and .781, respectively)”
Citations
Cites
Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483 · cited 4×
“The survey instrument development process involved an extensive literature review and expert validation, followed by item development and pilot testing to ensure clarity [25,26,45-49].”
InfluentialVenkatesh, V., Thong, J. Y. L., & Xu, X. (2012) · MIS Quarterly · doi:10.2307/41410412 · Cited by 15,756 · cited 1×
“To achieve this goal, various frameworks have been developed, such as the technology acceptance model (TAM) [25,26] and the Unified Theory of Acceptance and Use of Technology 2 (UTAUT2) [27-29], among others [30,31].”
ChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · doi:10.35542/osf.io/5er8f · Cited by 7,552
ChatGPT for good? On opportunities and challenges of large language models for education
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102274 · Cited by 7,326 · cited 1×
“…chatbots offer the potential to enhance self-confidence and communication skills, particularly for students facing challenges in social communication, highlighting its value as a conversational interface that simulates human interactions and fosters a sense of companionship among students [93,94].”
Eysenbach, G. (2004) · Journal of Medical Internet Research · doi:10.2196/jmir.6.3.e34 · Cited by 6,480 · cited 1×
“The survey instrument development process involved an extensive literature review and expert validation, followed by item development and pilot testing to ensure clarity [25,26,45-49].”
Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Quiñonez, H. R., & Young, S. L. (2018) · Frontiers in Public Health · doi:10.3389/fpubh.2018.00149 · Cited by 5,925 · cited 1×
“The minimum sample size was estimated to be 360 participants following the established guidelines for survey validation studies, considering 36 items with 10 participants per item [42-44].”
Sample size in factor analysis.
MacCallum, R. C., Widaman, K. F., Zhang, S., & Hong, S. (1999) · Psychological Methods · doi:10.1037/1082-989x.4.1.84 · Cited by 5,497 · cited 1×
“The minimum sample size was estimated to be 360 participants following the established guidelines for survey validation studies, considering 36 items with 10 participants per item [42-44].”
Kung, T. H., Cheatham, M., Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., Maningo, J., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000198 · Cited by 4,115
Kung, T. H., Cheatham, M., ChatGPT, Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., et al. (2022) · doi:10.1101/2022.12.19.22283643 · Cited by 4,115
Gluesing, J. C. (2012) · Leadership in Science and Technology: A Reference Handbook · doi:10.4135/9781412994231.n14 · Cited by 3,210
Research works printed but not linked: 1
- Choi, BCK, 2005, Prev Chronic Dis, 2, A13
Cited by
The Influence of ChatGPT on Student Engagement: A Systematic Review and Future Research Agenda
Lo, C. K., Hew, K. F., & Jong, M. S.-Y. (2024) · Computers & Education · doi:10.1016/j.compedu.2024.105100 · Cited by 392
A multinational study on the factors influencing university students’ attitudes and usage of ChatGPT
Abdaljaleel, M., Barakat, M., Alsanafi, M., Salim, N. A., Abazid, H., Malaeb, D., Mohammed, A. H., Hassan, B. A. R., Wayyes, A. M., Farhan, S. S., et al. (2024) · Scientific Reports · doi:10.1038/s41598-024-52549-8 · Cited by 291
“The cut-off for inclusion of participants in the sample per country was set at a minimum of 125 valid responses based on the number of items in the original TAME-ChatGPT scale (25 items) 51 .”
BackgroundMethodInfluentialSelf-citationGenerative artificial intelligence acceptance scale: A validity and reliability study
Yilmaz, F. G. K., Yilmaz, R., & Ceylan, M. (2024) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2023.2288730 · Cited by 244
Dahri, N. A., Yahaya, N., Al-Rahmi, W. M., Aldraiweesh, A., Alturki, U., Almutairy, S., Shutaleva, A., & Soomro, R. B. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e29317 · Cited by 239
“The term "intention to use ChatGPT" describes a person ’ s desire and resolve to utilize ChatGPT for metacognitive self-regulated learning [87].”
BackgroundResultInfluentialAlmogren, A. S., Al-Rahmi, W. M., & Dahri, N. A. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e31887 · Cited by 190
“The findings indicated that positive attitudes towards ChatGPT were associated with higher levels of acceptance and usage among students, highlighting the importance of fostering favorable attitudes towards the technology [58].”
Result
Metadata
- Authors
- Sallam, M., Salim, N. A., Barakat, M., Al-Mahzoum, K., Al-Tammemi, A. B., Malaeb, D., Hallit, R., & Hallit, S.
- Affiliations
- University of Jordan (JO)
- Applied Science Private University (JO)
- Gulf Medical University (AE)
- Holy Spirit University of Kaslik (LB)
- Corresponding author
- Sallam, Malik
- ORCID
- Venue
- JMIR Medical Education
- Publisher
- JMIR Publications Inc.
- Published
- 2023-09-05
- Volume
- 9
- Pages
- e48254
- ISSN
- 2369-3762 (ISSN-L)
- PMC
- PMC10509747
- OpenAlex
- W4385815999
- Cited by
- 234
- References
- 100
- Citations by year
- 2026: 56 · 2025: 94 · 2024: 77 · 2023: 7
- FWCI
- 9.32
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Medical Education (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Greater South Information System
- Funders
- Applied Science Private University
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Education › Artificial Intelligence in Education
- Social Sciences › Decision Sciences › Information Systems and Management › Technology Adoption and User Behaviour
- Keywords
- ChatGPT, large language models, technology acceptance model, health professions students, student attitudes, scale validation, perceived usefulness, perceived ease of use, risk perception, technology anxiety, healthcare education, artificial intelligence in education, Jordanian university students, construct validity, reliability statistics, factor structure, social influence, cognitive factors, behavior factor
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.