CoChat

Assessing Health Students' Attitudes and Usage of ChatGPT in Jordan: Validation Study

Open access

Published version of a preprint

The DOI matches its Crossref record; 103 of the 103 references it cites were found in a registry or an index; 27 of the 67 sources its claims cite were checked for support.

Abstract

Background: ChatGPT is a conversational large language model that has the potential to revolutionize knowledge acquisition. However, the impact of this technology on the quality of education is still unknown considering the risks and concerns surrounding ChatGPT use. Therefore, it is necessary to assess the usability and acceptability of this promising tool. As an innovative technology, the intention to use ChatGPT can be studied in the context of the technology acceptance model (TAM). Objective: This study aimed to develop and validate a TAM-based survey instrument called TAME-ChatGPT (Technology Acceptance Model Edited to Assess ChatGPT Adoption) that could be employed to examine the successful integration and use of ChatGPT in health care education. Methods: The survey tool was created based on the TAM framework. It comprised 13 items for participants who heard of ChatGPT but did not use it and 23 items for participants who used ChatGPT. Using a convenient sampling approach, the survey link was circulated electronically among university students between February and March 2023. Exploratory factor analysis (EFA) was used to assess the construct validity of the survey instrument. Results: The final sample comprised 458 respondents, the majority among them undergraduate students (n=442, 96.5%). Only 109 (23.8%) respondents had heard of ChatGPT prior to participation and only 55 (11.3%) self-reported ChatGPT use before the study. EFA analysis on the attitude and usage scales showed significant Bartlett tests of sphericity scores (P<.001) and adequate Kaiser-Meyer-Olkin measures (0.823 for the attitude scale and 0.702 for the usage scale), confirming the factorability of the correlation matrices. The EFA showed that 3 constructs explained a cumulative total of 69.3% variance in the attitude scale, and these subscales represented perceived risks, attitude to technology/social influence, and anxiety. For the ChatGPT usage scale, EFA showed that 4 constructs explained a cumulative total of 72% variance in the data and comprised the perceived usefulness, perceived risks, perceived ease of use, and behavior/cognitive factors. All the ChatGPT attitude and usage subscales showed good reliability with Cronbach α values >.78 for all the deduced subscales. Conclusions: The TAME-ChatGPT demonstrated good reliability, validity, and usefulness in assessing health care students’ attitudes toward ChatGPT. The findings highlighted the importance of considering risk perceptions, usefulness, ease of use, attitudes toward technology, and behavioral factors when adopting ChatGPT as a tool in health care education. This information can aid the stakeholders in creating strategies to support the optimal and ethical use of ChatGPT and to identify the potential challenges hindering its successful implementation. Future research is recommended to guide the effective adoption of ChatGPT in health care education.

Overview

CoChat Summary

TL;DR

This validation study developed TAME-ChatGPT, a TAM-based instrument to assess health care students’ attitudes toward and use of ChatGPT, and tested it among 458 university students in Jordan. It found acceptable factor structure and reliability for attitude (3 factors) and usage (4 factors) scales, though only 109 respondents had heard of ChatGPT and 55 had used it.

Key findings

  • Among 458 respondents (96.5% undergraduate), only 109 (23.8%) had heard of ChatGPT before the study and 55 (11.3%) self-reported prior ChatGPT use.
  • Attitude scale (13 items, n=109): EFA yielded 3 factors—perceived risk, technology/social influence, and anxiety—explaining 69.3% of variance; KMO was 0.823, Bartlett P<.001, and Cronbach α values were .876, .858, and .827. Mean perceived risk was 12.5 (SD 4.8), technology/social influence 19.3 (SD 4.1), and anxiety 6.6 (SD 2.9).
  • Usage scale (14 items, n=55): EFA yielded 4 factors—perceived usefulness, perceived risk, perceived ease of use, and behavior—explaining 72% of variance; KMO was 0.702, Bartlett P<.001, and Cronbach α values were .885, .718, .824, and .781. Mean perceived usefulness was 24.2 (SD 4.9), perceived risk 7.2 (SD 2.8), ease of use 8.9 (SD 1.6), and behavior 9.8 (SD 3.3).
  • Older age, male sex, and postgraduate education were associated with higher probability of having heard of ChatGPT before the study (P=.001, <.001, and .002, respectively); no tested variables were significantly associated with prior ChatGPT use.

Methods

  • Cross-sectional validation survey using convenience sampling; the survey link was circulated via WhatsApp and Facebook to health school students in Jordan from February 28 to March 31, 2023. Inclusion criteria were age ≥18 years, concurrent enrollment in a Jordanian university, and very good Arabic comprehension; final sample was 458.
  • The TAME-ChatGPT instrument was created based on the TAM framework, with 13 items for participants who heard of ChatGPT but did not use it and 23 items for participants who used ChatGPT (total 36 items), scored on a 5-point Likert scale. Domains included perceived usefulness, ease of use, risks, anxiety, attitude toward technology, social influence, and cognitive/behavioral factors.
  • Analysis used exploratory factor analysis with principal component analysis and oblimin rotation, Kaiser-Meyer-Olkin and Bartlett tests, Cronbach α for reliability, and descriptive statistics with chi-square and Mann-Whitney U tests; significance was set at P<.05.

Limitations

  • Stated: the limited sample size was a major limitation; respondent fatigue from the lengthy scale may have reduced participation; selection bias from convenience sampling should be considered; female predominance may reflect selection bias but aligns with dentistry, pharmacy, and nursing demographics in Jordan; potential bias in the tested constructs despite using TAM.
  • Evident from the text: the usage EFA relied on only 55 prior users and the attitude EFA on 109 respondents, so the factor solutions are based on small subsamples; the design was cross-sectional, self-reported, and single-country; no confirmatory factor analysis was conducted, and the authors call for a future multinational project to perform CFA.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.2196/48254

Cites

103 of 103 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

11 Valid · 2 Not valid · 14 Not checked · 51 Own results and interpretations

30 more claims · 1 with their cited sources checked

Create a free account to see all 78 claims and to verify the 40 references still open.

See all claims — free account
  • Probably not a substantial claim. 21
  • It may state two separate claims as one. 29
  • The quote only partly states this claim. 1

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

3 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

2 of 2

Citations

Cites

Research works printed but not linked: 1

  1. Choi, BCK, 2005, Prev Chronic Dis, 2, A13

Cited by

See all 234

Metadata

Authors
Sallam, M., Salim, N. A., Barakat, M., Al-Mahzoum, K., Al-Tammemi, A. B., Malaeb, D., Hallit, R., & Hallit, S.
Affiliations
  • University of Jordan (JO)
  • Applied Science Private University (JO)
  • Gulf Medical University (AE)
  • Holy Spirit University of Kaslik (LB)
Corresponding author
Sallam, Malik
Venue
JMIR Medical Education
Published
2023-09-05
Volume
9
Pages
e48254
ISSN
2369-3762 (ISSN-L)
OpenAlex
W4385815999
Cited by
234
References
100
Citations by year
2026: 56 · 2025: 94 · 2024: 77 · 2023: 7
FWCI
9.32
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR Medical Education (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Greater South Information System
Funders
Applied Science Private University
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Social Sciences › Education › Artificial Intelligence in Education
  • Social Sciences › Decision Sciences › Information Systems and Management › Technology Adoption and User Behaviour
Keywords
ChatGPT, large language models, technology acceptance model, health professions students, student attitudes, scale validation, perceived usefulness, perceived ease of use, risk perception, technology anxiety, healthcare education, artificial intelligence in education, Jordanian university students, construct validity, reliability statistics, factor structure, social influence, cognitive factors, behavior factor

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.