Assessing the Benefits of ChatGPT for Business: An Empirical Study on Organizational Performance
Open accessThe DOI matches its Crossref record; 74 of the 74 references it cites were found in a registry or an index.
Abstract
Companies strive to cultivate an innovative and creative organizational culture that bolsters organizational performance. In this context, businesses have started introducing ChatGPT to their users. For this investigation, the DeLone and McLean’s Information Systems Success model (D&M IS) was employed. This study explored the factors that influence user satisfaction and benefits related to the three quality components of ChatGPT: system quality, information quality, and service quality. It also examined whether these components positively impact organizational performance. A total of 361 questionnaires from actual businesses were collected and analyzed using structural equation modeling. The survey revealed that the system quality, information quality, and service quality of ChatGPT have favorable impacts on user satisfaction and benefits. Among these, service quality exerted the most significant impact. However, the moderating effect of a flexible organizational culture was not evident. Our study contributes to the knowledge base regarding how the system, information, and service quality of ChatGPT influence productivity within an organization. As the ChatGPT system is still in its nascent stage, it currently does not have a substantial impact on the flexible organizational culture. However, as it evolves and reaches a specific and higher level in the future, it may play a significant role in enhancing long-term organizational performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“However, there is room for improvement, particularly in the ISACA official cybersecurity fundamentals practice quiz where the model achieved a lower success rate of 72%.”
From HuntGPT: Integrating Machine Learning-Based Anomaly Detection and Explainable AI with Large Language Models (LLMs) (2026) · cites this paper as [43]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Based on the results presented in Table III, GPT-3.5turbo demonstrates substantial proficiency in cybersecurity knowledge, with success rates ranging from 72% to 82.5% across varied and reputable exams.”
From HuntGPT: Integrating Machine Learning-Based Anomaly Detection and Explainable AI with Large Language Models (LLMs) (2026) · cites this paper as [43]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Evaluating Structural Equation Models with Unobservable Variables and Measurement Error
Fornell, C., & Larcker, D. F. (1981) · Journal of Marketing Research · doi:10.2307/3151312 · Cited by 109,314
Evaluating structural equation models with unobservable variables and measurement error
Fornell, C., & Larcker, D. F. (1981) · Journal of Marketing Research · doi:10.1177/002224378101800104 · Cited by 109,190
Organizational culture and leadership
(1993) · Long Range Planning · doi:10.1016/0024-6301(93)90120-5 · Cited by 16,462
The DeLone and McLean Model of Information Systems Success: A Ten-Year Update
(2003) · Journal of Management Information Systems · doi:10.1080/07421222.2003.11045748 · Cited by 11,791 · cited 9×
“Additionally, the revised D&M IS success model suggests that high service quality allows users to respond to an information system with overall satisfaction and meet their needs efficiently [35], [41], [52].”
BackgroundMethodResultInfluentialInformation Systems Success: The Quest for the Dependent Variable
DeLone, W. H., & McLean, E. R. (1992) · Information Systems Research · doi:10.1287/isre.3.1.60 · Cited by 10,697
Understanding Information Systems Continuance: An Expectation-Confirmation Model1
Bhattacherjee, A. (2001) · MIS Quarterly · doi:10.2307/3250921 · Cited by 8,767 · cited 1×
“As users’ system quality demands high standards and changes over time [74], companies need to acquire and update knowledge related to system quality services.”
BackgroundDwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., Baabdullah, A. M., Koohang, A., Raghavan, V., Ahuja, M., et al. (2023) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2023.102642 · Cited by 4,584
E-satisfaction: an initial examination
Szymanski, D. M., & Hise, R. T. (2000) · Journal of Retailing · doi:10.1016/s0022-4359(00)00035-x · Cited by 2,002
Web Site Usability, Design, and Performance Metrics
Palmer, J. W. (2002) · Information Systems Research · doi:10.1287/isre.13.2.151.88 · Cited by 1,640
Trust and Electronic Government Success: An Empirical Study
Teo, T. S. H., Srivastava, S. C., & Jiang, L. (2008) · Journal of Management Information Systems · doi:10.2753/mis0742-1222250303 · Cited by 1,400
Research works printed but not linked: 9
- O. Nov, N. Singh, and D. M. Mann, "Putting ChatGPT's Medical Advice to the (Turing) Test," medRxiv, p. 2023.01. 23.23284735, 2023.
- W. Jiao, W. Wang, J.-t. Huang, X. Wang, and Z. Tu, "Is ChatGPT a good translator? A preliminary study," arXiv preprint arXiv:2301.08745, 2023. · arXiv
- K. Pearlson, "Managing and Using Information System I K.. Pearlson, CS Saunders," Publisher: Wiiey, 2012.
- B. H. Wixom and P. A. Todd, "A theoretical integration of user satisfaction and technology acceptance," Information systems research, vol. 16, no. 1, pp. 85-102, 2005.
- J. C. Roca, C.-M. Chiu, and F. J. Martínez, "Understanding e-learning continuance intention: An extension of the Technology Acceptance Model," International Journal of human-computer studies, vol. 64, no. 8, pp. 683-696, 2006.
- M. Al-Emran, I. Arpaci, and S. A. Salloum, "An empirical examination of continuous intention to use m-learning: An integrated model," Education and information technologies, vol. 25, pp. 2899-2918, 2020.
- H. J. Kang and S. I. Kim, "Evaluation on the usability of chatbot intelligent messenger mobile services-focusing on google (allo) and facebook (M messenger)," Journal of the Korea Convergence Society, vol. 8, no. 9, pp. 271-276, 2017.
- R. E. Quinn and G. M. Spreitzer, The psychometrics of the competing values culture instrument and an analysis of the impact of organizational culture on quality of life. Emerald, 1991.
- R. Payal, S. Ahmed, and R. M. Debnath, "Knowledge management and organizational performance: a study in the context of Indian software companies," IUP Journal of Knowledge Management, vol. 14, no. 4, p. 53, 2016.
Cited by
Assessing the nexus of Generative AI adoption, ethical considerations and organizational performance
Rana, N. P., Pillai, R., Sivathanu, B., & Malik, N. (2024) · Technovation · doi:10.1016/j.technovation.2024.103064 · Cited by 233
Ali, T., Kostakos, P., & Sheikhi, S. (2026) · Telecom · doi:10.3390/telecom7030073 · Cited by 104
Saihi, A., Ben-Daya, M., Hariga, M., & As'ad, R. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100274 · Cited by 75
Generative Artificial Intelligence for Software Engineering - a Research Agenda
NguyenDuc, A., Cabrero-Daniel, B., Arora, C., Przybylek, A., Khanna, D., Herda, T., Rafiq, U., Melegati, J., Guerra, E., Kemell, K.-K., et al. (2023) · doi:10.2139/ssrn.4622517 · Cited by 71
Demystifying ChatGPT: An In-depth Survey of OpenAI’s Robust Large Language Models
Bhattacharya, P., Prasad, V. K., Verma, A., Gupta, D. K., Sapsomboon, A., Viriyasitavat, W., & Dhiman, G. (2024) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-024-10115-5 · Cited by 118
Metadata
- Authors
- Chu, M.-N.
- Affiliations
- Hoseo University (KR)
- Corresponding author
- Chu, Mi-Na
- ORCID
- Chu, Mi-Na
- Venue
- IEEE Access
- Published
- 2023
- Volume
- 11
- Pages
- 76427-76436
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W4385061706
- Cited by
- 69
- References
- 70
- Citations by year
- 2026: 18 · 2025: 28 · 2024: 17 · 2023: 6
- FWCI
- 17.68
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- IEEE Access (publishedVersion, cc-by-nc-nd)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Decision Sciences › Information Systems and Management › Technology Adoption and User Behaviour
- Social Sciences › Business, Management and Accounting › Management Information Systems › Information Systems Theories and Implementation
- Social Sciences › Business, Management and Accounting › Marketing › Customer Service Quality and Loyalty
- Keywords
- ChatGPT, organizational performance, user satisfaction, system quality, information quality, service quality, DeLone and McLean IS success model, organizational productivity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Assessing the Benefits of ChatGPT for Business: An Empirical Study on Organizational Performance. https://app.cochat.ai/papers/10.1109/access.2023.3297447
- The paper
- Chu, M.-N. (2023). Assessing the Benefits of ChatGPT for Business: An Empirical Study on Organizational Performance. IEEE Access. https://doi.org/10.1109/access.2023.3297447
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.


