Student or educator? Sign up with your school email and get 6 months of Pro free.

The DOI matches its Crossref record.

Is it All Hype? ChatGPT’s Performance and Disruptive Potential in the Accounting and Auditing Industries

Open access
Eulerich, Marc, Sanatizadeh, Aida, Vakilzadeh, Hamid, Wood, David A. · 2023 · Review of Accounting Studies

Abstract

ChatGPT frequently appears in the media, with many predicting significant disruptions, especially in the fields of accounting and auditing. Yet, prior research has demonstrated relatively poor performance of ChatGPT on student assessment questions. We extend this research to examine whether more recent ChatGPT models and capabilities can pass major accounting certification exams including the CPA, CMA, CIA, and EA (enrolled agent) certification exams. We find that the early released ChatGPT 3.5 model is unable to pass any exam (average score across all assessments of 53.1 percent). However, with additional enhancements, ChatGPT can pass all sections of each tested exam: moving to the ChatGPT 4 model improved scores by an average of 16.5 percent, providing 10-shot training improved scores an additional 6.6 percent, and allowing the model to use reasoning and acting (e.g., allow ChatGPT to use a calculator and other resources) improved scores an additional 8.9 percent. After all these improvements, ChatGPT passed all exams with an average score of 85.1 percent. This high performance indicates that ChatGPT has sufficient capabilities to potentially disrupt the accounting and auditing industries, which we discuss in detail. Lastly, this research provides practical insights for accounting professionals, investors, and stakeholders on how to adapt and mitigate the potential negative consequences of this cutting-edge technology in accounting and auditing firms.

Overview

Integrity signals

Registry

Crossref · 10.2139/ssrn.4452175

Cites

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Citations

Cited by

See all 162

Metadata

Authors
Eulerich, M., Sanatizadeh, A., Vakilzadeh, H., & Wood, D. A.
Affiliations
  • University of Duisburg-Essen (DE)
  • Northern Illinois University (US)
  • University of Wisconsin–Whitewater (US)
  • Brigham Young University (US)
Corresponding author
Eulerich, Marc
Venue
Review of Accounting Studies
Publisher
Elsevier BV
Published
2023
Volume
29
Issue
3
Pages
2318-2349
ISSN
1380-6653 (ISSN-L)
OpenAlex
W4400091704
Cited by
162
References
69
Citations by year
2026: 35 · 2025: 51 · 2024: 30 · 2023: 45
FWCI
23.72
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Review of Accounting Studies (publishedVersion, cc-by)
  • SSRN Electronic Journal (acceptedVersion)
  • Econstor (Econstor) (submittedVersion, cc-by)
  • ScholarsArchive (Brigham Young University) (submittedVersion)
  • RePEc: Research Papers in Economics (submittedVersion)
  • Minerva Access (University of Melbourne) (submittedVersion, cc-by)
Funders
Universität Duisburg-Essen
Topics
  • Social Sciences › Business, Management and Accounting › Management Information Systems › Robotic Process Automation Applications
  • Social Sciences › Business, Management and Accounting › Accounting › Accounting Education and Careers
  • Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
Keywords
ChatGPT, large language models, auditing, disruptive technologies, CPA exam, ChatGPT-4, accounting education, future of accounting profession

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Is it All Hype? ChatGPT’s Performance and Disruptive Potential in the Accounting and Auditing Industries. https://app.cochat.ai/papers/10.2139/ssrn.4452175
The paper
Eulerich, M., Sanatizadeh, A., Vakilzadeh, H., & Wood, D. A. (2023). Is it All Hype? ChatGPT’s Performance and Disruptive Potential in the Accounting and Auditing Industries. Review of Accounting Studies. https://doi.org/10.2139/ssrn.4452175

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.