The DOI matches its Crossref record.
Is it All Hype? ChatGPT’s Performance and Disruptive Potential in the Accounting and Auditing Industries
Open accessAbstract
ChatGPT frequently appears in the media, with many predicting significant disruptions, especially in the fields of accounting and auditing. Yet, prior research has demonstrated relatively poor performance of ChatGPT on student assessment questions. We extend this research to examine whether more recent ChatGPT models and capabilities can pass major accounting certification exams including the CPA, CMA, CIA, and EA (enrolled agent) certification exams. We find that the early released ChatGPT 3.5 model is unable to pass any exam (average score across all assessments of 53.1 percent). However, with additional enhancements, ChatGPT can pass all sections of each tested exam: moving to the ChatGPT 4 model improved scores by an average of 16.5 percent, providing 10-shot training improved scores an additional 6.6 percent, and allowing the model to use reasoning and acting (e.g., allow ChatGPT to use a calculator and other resources) improved scores an additional 8.9 percent. After all these improvements, ChatGPT passed all exams with an average score of 85.1 percent. This high performance indicates that ChatGPT has sufficient capabilities to potentially disrupt the accounting and auditing industries, which we discuss in detail. Lastly, this research provides practical insights for accounting professionals, investors, and stakeholders on how to adapt and mitigate the potential negative consequences of this cutting-edge technology in accounting and auditing firms.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cited by
Using ChatGPT for human–computer interaction research: a primer
Tabone, W., & de Winter, J. (2023) · Royal Society Open Science · doi:10.1098/rsos.231053 · Cited by 162
A scoping review of ChatGPT research in accounting and finance
Dong, M., Stratopoulos, T. C., & Wang, V. X. (2024) · International Journal of Accounting Information Systems · doi:10.1016/j.accinf.2024.100715 · Cited by 239
“Certain studies assessing the ability of ChatGPT to answer domains-specific questions purposely exclude questions with pictures (e.g., Eulerich et al. 2023).”
BackgroundPursnani, V., Sermet, Y., Kurt, M., & Demir, I. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2023.100183 · Cited by 106
Zhao, J., & Wang, X. (2023) · Journal of Corporate Accounting & Finance · doi:10.1002/jcaf.22663 · Cited by 97
Cardon, P. W., Fleischmann, C., Logemann, M., Heidewald, J., Aritz, J., & Swartz, S. (2023) · Business and Professional Communication Quarterly · doi:10.1177/23294906231208166 · Cited by 70
“This raises important questions of how will machine and accountant work together in the future” (Eulerich et al., 2023, p. 14).”
Background
Metadata
- Authors
- Eulerich, M., Sanatizadeh, A., Vakilzadeh, H., & Wood, D. A.
- Affiliations
- University of Duisburg-Essen (DE)
- Northern Illinois University (US)
- University of Wisconsin–Whitewater (US)
- Brigham Young University (US)
- Corresponding author
- Eulerich, Marc
- Venue
- Review of Accounting Studies
- Publisher
- Elsevier BV
- Published
- 2023
- Volume
- 29
- Issue
- 3
- Pages
- 2318-2349
- ISSN
- 1380-6653 (ISSN-L)
- OpenAlex
- W4400091704
- Semantic Scholar
- 385b1a21ac1e8d9758cce1b0bd08af60247b059b
- Cited by
- 162
- References
- 69
- Citations by year
- 2026: 35 · 2025: 51 · 2024: 30 · 2023: 45
- FWCI
- 23.72
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Review of Accounting Studies (publishedVersion, cc-by)
- SSRN Electronic Journal (acceptedVersion)
- Econstor (Econstor) (submittedVersion, cc-by)
- ScholarsArchive (Brigham Young University) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Minerva Access (University of Melbourne) (submittedVersion, cc-by)
- Funders
- Universität Duisburg-Essen
- Topics
- Social Sciences › Business, Management and Accounting › Management Information Systems › Robotic Process Automation Applications
- Social Sciences › Business, Management and Accounting › Accounting › Accounting Education and Careers
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- ChatGPT, large language models, auditing, disruptive technologies, CPA exam, ChatGPT-4, accounting education, future of accounting profession
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.