Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.

The ChatGPT Artificial Intelligence Chatbot: How Well Does It Answer Accounting Assessment Questions?

Open access
Wood, David A., Achhpilia, Muskan P., Adams, Mollie T., Aghazadeh, Sanaz, Akinyele, Kazeem, Akpan, Mfon, Allee, Kristian D., Allen, Abigail M., Almer, Elizabeth D., Ames, Daniel, Arity, Viktor, Barr-Pulliam, Dereck, Basoglu, K. Asli, Belnap, Andrew, Bentley, Jeremiah W., Berg, Terje, Berglund, Nathan R., Berry, Erica, Bhandari, Avishek, Bhuyan, Md Nazmul Hasan, Black, Paul W., Blondeel, Eva, Bond, David, Bonrath, Annika, Borthick, A. Faye, Boyle, Erik S., Bradford, Marianne, Brandon, Duane M., Brazel, Joseph F., Brockbank, Bryan G., Burger, Marcus, Byzalov, Dmitri, Cannon, James N., Caro, Cecil, Carr, Abraham H., Cathey, Jack, Cating, Ryan, Charron, Kimberly, Chavez, Stacy, Chen, Jason, Chen, Jennifer C., Chen, Jennifer W., Cheng, Christine, Cheng, Xu, Christensen, Brant E., Church, Kimberly Swanson, Cicone, N. J., Constance, Patience, Cooper, Lauren A., Correia, Candice L., Coyne, Joshua, Cram, W. Alec, Curtis, Asher, Daigle, Ronald J., Dannemiller, Steve, Davenport, Stephan A., Dawson, Gregory S., De Meyst, Karen J. L., Dell, Scott, Demirkan, Sebahattin, Denison, Christine A., Desai, Hrishikesh, DeSimone, Steven, Diehl, Leah M., Dimes, Ruth, Dong, Bei, Donnelly, Amy, du Pon, Adam, Duan, Huijue Kelly, Duffey, Ada, Dunn, Ryan T., Durkin, Mary P., Dzuranin, Ann C., Eberle, Rachel M., Ege, Matthew S., El Mahdy, Dina, Esplin, Adam, Eulerich, Marc, Everaert, Patricia, Farah, Nusrat, Farish, Lauren, Favere-Marchesi, Michael, Fayard, Dutch, Filosa, Jessica R., Ford, Melinda, Franz, Diana R., Fulmer, Bachman P., Fulmer, Sarah, Furner, Zhan Z., Gantman, Sonia, Garner, Steve, Garrett, Jace, Geng, Xin, Golden, Joanna, Goldman, William, Gomez, Josue, Gooley, Mark, Granitto, Shawn P., Green, Karen Y., Greenman, Cindy L., Gupta, Gaurav, Guymon, Ronald N., Hale, Kevin, Harper, Christopher J., Hartt, S. Allen, Hawk, Holly, Hawkins, Steven R., Hawkins, Erin M., Hay, David C., Heinzelmann, Rafael, Henderson, Cassy D., Hendricks, Bradley E., Heninger, William G., Hill, Mary S., Holden, Nicole, Holderness, D. Kip, Holt, Travis P., Hoopes, Jeffrey L., Hsieh, Sheng-Feng, Huang, Feiqi, Huang, Hua-Wei, Huang, Ting-Chiao, Huels, Brian W., Hunter, Kara, Hurley, Patrick J., Inger, Kerry, Islam, Sharif, Ison, Isaac, Issa, Hussein, Jackson, Andrew B., Jackson, Scott C., Janvrin, Diane J., Jimenez, Peggy D., Johanson, Daniel, Judd, J. Scott, Kawada, Brett S., Kelton, Andrea Seaton, Kern, Sara, Kerr, Jon N., Keune, Marsha B., Kim, Mindy, Knox, Brian D., Kogan, Gregory, Kotb, Amr, Krane, Ronja, Kremin, Joleen, Krieg, Kimberly S., Kugel, Jonathan, Kulset, Ellen M., Kuruppu, Chamara, LaDuca, Garrison, Lamberton, Barbara A., Lamboy-Ruiz, Melvin A., Lang, Bradley, Larocque, Stephannie A., Larson, Melissa P., Lawson, Bradley P., Lawson, James G., Lee, Lorraine, Lenk, Margarita M., Li-Kuehne, Michelle, Liljegren, Jonathan, Lin, Yi-Hung, Liu, Wu-Po, Liu, Zishang, Lock, Brandon, Long, James H., Loraas, Tina, Lowensohn, Suzanne, Loy, Thomas R., Lyngstadaas, Hakim, Maas, Wim, MacGregor, Jason E., Madsen, Dag Øivind, Malone, Carissa L., Margolin, Maximilian, Marshall, Mary E., Martin, Rachel M., Mpofu, Colleen McClain, McCoy, Chris, McGuigan, Nicholas C., McSwain, Dwayne N., Meckfessel, Michele D., Mellon, Mark J., Melton, Olivia S., Mercado, Julie M., Mitsuda, Steven, Modugu, Kennedy, Moehrle, Stephen, Chaghervand, Amirali Moeini, Moffitt, Kevin, Moon, Joon Seok, Muehlmann, Brigitte, Murray, Johnna, Mwaungulu, Emmanuel S., Myers, Noah, Naegle, J. Conrad, Ndicu, Martin J., Nelson, Aaron S., Nguyen, Anh L., Niederkofler, Thomas, Nikbakht, Ehsan, O'Brien, Ann D., Ogunade, Kehinde M., O'Leary, Daniel, Oler, Mitchell J., Oler, Derek K., Olsen, Kari Joseph, Otalor, John I., Outlaw, Kyle W., Ozlanski, Michael. E., Parlier, Jenny, Paterson, Jeffrey S., Pearson, Christopher A., Petersen, Michael J., Petra, Steven T., Pickard, Matthew D., Pickerd, Jeffrey, Pinsker, Robert, Plante, Catherine, Plečnik, James M., Price, Richard A., Quick, Linda A., Raedy, Jana, Raschke, Robyn, Ravenscraft, Julie, Richardson, Vernon, Rixom, Brett A., Robertson, John F., Rock, Iyad, Romney, Miles A., Rozario, Andrea, Ruff, Michael F., Rupley, Kathleen, Saeedi, Ali, Saiewitz, Aaron, Salzsieder, Leigh W., Sarkar, Sayan, Saulls, Michael, Scanlan, Tialei A., Schaefer, Tammie J., Schaupp, Daniel, Schneider, Gary P., Seebeck, Andreas, Sellers, R. Drew, Seto, Samantha C., Sevel, Romi-Lee, Shan, Yuxin, Sherwood, Matthew G., Singorahardjo, Maggie, Skaftadottir, Hanna Kristin, Skomra, Justyna, Smith, Jason L., Smith, Dallin O., Smith, James, Snow, Mason C., Sommerfeldt, Ryan D., Sorensen, Kate B., Sorensen, Trevor L., Spieler, Andrew C., Stallings, Matthew A., Stallings, Lesya, Stancill, Alan, Stanley, Jonathan D., Stefaniak, Chad M., Stephens, Nathaniel M., Stewart, Bryan W., Stratopoulos, Theophanis C., Street, Daniel A., Subedi, Meena, Summers, Scott L., Sundkvist, Charlotte H., Synn, Christina, Tadesse, Amanuel, Tapis, Gregory P., Tassin, Kerri, Taylor, Samantha, Teal, Mary, Teeter, Ryan, Tharapos, Meredith, Theis, Jochen C., Thomas, Jack, Thompson, Kristen S., Thornock, Todd A., Tietz, Wendy, Travalent, Anthony M., Trinkle, Brad S., Truelson, J. Mike, Turner, Michael C., Vagner, Brandon, Vakilzadeh, Hamid, van der Geest, Jesse, van Pelt, Victor, Vandervelde, Scott D., Vega, Jose, Vera-Muñoz, Sandra, Villanueva, Brigham, Vincent, Nishani Edirisinghe, Wagener, Martin, Walton, Stephanie, Warne, Rick C., Watanabe, Olena V., Watson, David, Watson, Marcia Weidenmier, Weber, Jill, Weirich, Thomas, West, Ashley N., Wilford, Amanda L., Wilson, Aaron B., Winrow, Brian, Winrow, Timothy, Winrow, Tasia S., Wiseman, Denise, Witte, Annie L., Wood, Bryan D., Wood, Jessica, Woolley, Darryl, Wright, Nicole S., Wu, Juan, Xiong, Xiaomei, Yatsenko, Dimitri, Yazzie, Courtney E., Young, Glen M., Zhang, Chanyuan, Zimmerman, Aleksandra B., Zoet, Emily · 2023 · Issues in Accounting Education

Abstract

ChatGPT, a language-learning model chatbot, has garnered considerable attention for its ability to respond to users’ questions. Using data from 14 countries and 186 institutions, we compare ChatGPT and student performance for 28,085 questions from accounting assessments and textbook test banks. As of January 2023, ChatGPT provides correct answers for 56.5 percent of questions and partially correct answers for an additional 9.4 percent of questions. When considering point values for questions, students significantly outperform ChatGPT with a 76.7 percent average on assessments compared to 47.5 percent for ChatGPT if no partial credit is awarded and 56.5 percent if partial credit is awarded. Still, ChatGPT performs better than the student average for 15.8 percent of assessments when we include partial credit. We provide evidence of how ChatGPT performs on different question types, accounting topics, class levels, open/closed assessments, and test bank questions. We also discuss implications for accounting education and research.

Overview

Integrity signals

Registry

Crossref · 10.2308/issues-2023-013

Cites

34 of 34 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

The text we found for this paper looks like another document, so its claims and self-check weren’t run. The registry and citation checks still apply.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The text we found for this paper looks like another document, so the self-check wasn’t run.

Citations

Cites

Show all 34 references

Research works printed but not linked: 9

  1. Bloom, 1956, Taxonomy of Educational Objectives: The Classification of Educational Goals
  2. Dickey, 2019, Machine learning in auditing, The CPA Journal, 89, 16
  3. Haq, 2020, The development of machine learning and its implications for public accounting, The CPA Journal, 90, 6
  4. Harris, 2022, ChatGPT gains 1 million users within 5 days, App Developer Magazine
  5. Maurer, 2021, PwC to spend $12 billion on hiring, expanding expertise in AI, cybersecurity, The Wall Street Journal
  6. McMurtrie, 2022, AI and the future of undergraduate writing. Teaching experts are concerned, but not for the reasons you think, The Chronicle of Higher Education, 36
  7. Meckler, 2022, Teachers are on alert for inevitable cheating after release of ChatGPT, The Washington Post
  8. Shrivastava, 2022, Teachers fear ChatGPT will make cheating even easier than ever, Forbes
  9. Taylor, 2023, ChatGPT maker OpenAI releases ‘not fully reliable’ tool to detect AI generated content, The Guardian

Cited by

See all 175

Metadata

Authors
Wood, D. A., Achhpilia, M. P., Adams, M. T., Aghazadeh, S., Akinyele, K., Akpan, M., Allee, K. D., Allen, A. M., Almer, E. D., Ames, D., Arity, V., Barr-Pulliam, D., Basoglu, K. A., Belnap, A., Bentley, J. W., Berg, T., Berglund, N. R., Berry, E., Bhandari, A., Bhuyan, M. N. H., Black, P. W., Blondeel, E., Bond, D., Bonrath, A., Borthick, A. F., Boyle, E. S., Bradford, M., Brandon, D. M., Brazel, J. F., Brockbank, B. G., Burger, M., Byzalov, D., Cannon, J. N., Caro, C., Carr, A. H., Cathey, J., Cating, R., Charron, K., Chavez, S., Chen, J., Chen, J. C., Chen, J. W., Cheng, C., Cheng, X., Christensen, B. E., Church, K. S., Cicone, N. J., Constance, P., Cooper, L. A., Correia, C. L., Coyne, J., Cram, W. A., Curtis, A., Daigle, R. J., Dannemiller, S., Davenport, S. A., Dawson, G. S., De Meyst, K. J. L., Dell, S., Demirkan, S., Denison, C. A., Desai, H., DeSimone, S., Diehl, L. M., Dimes, R., Dong, B., Donnelly, A., du Pon, A., Duan, H. K., Duffey, A., Dunn, R. T., Durkin, M. P., Dzuranin, A. C., Eberle, R. M., Ege, M. S., El Mahdy, D., Esplin, A., Eulerich, M., Everaert, P., Farah, N., Farish, L., Favere-Marchesi, M., Fayard, D., Filosa, J. R., Ford, M., Franz, D. R., Fulmer, B. P., Fulmer, S., Furner, Z. Z., Gantman, S., Garner, S., Garrett, J., Geng, X., Golden, J., Goldman, W., Gomez, J., Gooley, M., Granitto, S. P., Green, K. Y., Greenman, C. L., Gupta, G., Guymon, R. N., Hale, K., Harper, C. J., Hartt, S. A., Hawk, H., Hawkins, S. R., Hawkins, E. M., Hay, D. C., Heinzelmann, R., Henderson, C. D., Hendricks, B. E., Heninger, W. G., Hill, M. S., Holden, N., Holderness, D. K., Holt, T. P., Hoopes, J. L., Hsieh, S.-F., Huang, F., Huang, H.-W., Huang, T.-C., Huels, B. W., Hunter, K., Hurley, P. J., Inger, K., Islam, S., Ison, I., Issa, H., Jackson, A. B., Jackson, S. C., Janvrin, D. J., Jimenez, P. D., Johanson, D., Judd, J. S., Kawada, B. S., Kelton, A. S., Kern, S., Kerr, J. N., Keune, M. B., Kim, M., Knox, B. D., Kogan, G., Kotb, A., Krane, R., Kremin, J., Krieg, K. S., Kugel, J., Kulset, E. M., Kuruppu, C., LaDuca, G., Lamberton, B. A., Lamboy-Ruiz, M. A., Lang, B., Larocque, S. A., Larson, M. P., Lawson, B. P., Lawson, J. G., Lee, L., Lenk, M. M., Li-Kuehne, M., Liljegren, J., Lin, Y.-H., Liu, W.-P., Liu, Z., Lock, B., Long, J. H., Loraas, T., Lowensohn, S., Loy, T. R., Lyngstadaas, H., Maas, W., MacGregor, J. E., Madsen, D. Ø., Malone, C. L., Margolin, M., Marshall, M. E., Martin, R. M., Mpofu, C. M., McCoy, C., McGuigan, N. C., McSwain, D. N., Meckfessel, M. D., Mellon, M. J., Melton, O. S., Mercado, J. M., Mitsuda, S., Modugu, K., Moehrle, S., Chaghervand, A. M., Moffitt, K., Moon, J. S., Muehlmann, B., Murray, J., Mwaungulu, E. S., Myers, N., Naegle, J. C., Ndicu, M. J., Nelson, A. S., Nguyen, A. L., Niederkofler, T., Nikbakht, E., O'Brien, A. D., Ogunade, K. M., O'Leary, D., Oler, M. J., Oler, D. K., Olsen, K. J., Otalor, J. I., Outlaw, K. W., Ozlanski, M. E., Parlier, J., Paterson, J. S., Pearson, C. A., Petersen, M. J., Petra, S. T., Pickard, M. D., Pickerd, J., Pinsker, R., Plante, C., Plečnik, J. M., Price, R. A., Quick, L. A., Raedy, J., Raschke, R., Ravenscraft, J., Richardson, V., Rixom, B. A., Robertson, J. F., Rock, I., Romney, M. A., Rozario, A., Ruff, M. F., Rupley, K., Saeedi, A., Saiewitz, A., Salzsieder, L. W., Sarkar, S., Saulls, M., Scanlan, T. A., Schaefer, T. J., Schaupp, D., Schneider, G. P., Seebeck, A., Sellers, R. D., Seto, S. C., Sevel, R.-L., Shan, Y., Sherwood, M. G., Singorahardjo, M., Skaftadottir, H. K., Skomra, J., Smith, J. L., Smith, D. O., Smith, J., Snow, M. C., Sommerfeldt, R. D., Sorensen, K. B., Sorensen, T. L., Spieler, A. C., Stallings, M. A., Stallings, L., Stancill, A., Stanley, J. D., Stefaniak, C. M., Stephens, N. M., Stewart, B. W., Stratopoulos, T. C., Street, D. A., Subedi, M., Summers, S. L., Sundkvist, C. H., Synn, C., Tadesse, A., Tapis, G. P., Tassin, K., Taylor, S., Teal, M., Teeter, R., Tharapos, M., Theis, J. C., Thomas, J., Thompson, K. S., Thornock, T. A., Tietz, W., Travalent, A. M., Trinkle, B. S., Truelson, J. M., Turner, M. C., Vagner, B., Vakilzadeh, H., van der Geest, J., van Pelt, V., Vandervelde, S. D., Vega, J., Vera-Muñoz, S., Villanueva, B., Vincent, N. E., Wagener, M., Walton, S., Warne, R. C., Watanabe, O. V., Watson, D., Watson, M. W., Weber, J., Weirich, T., West, A. N., Wilford, A. L., Wilson, A. B., Winrow, B., Winrow, T., Winrow, T. S., Wiseman, D., Witte, A. L., Wood, B. D., Wood, J., Woolley, D., Wright, N. S., Wu, J., Xiong, X., Yatsenko, D., Yazzie, C. E., Young, G. M., Zhang, C., Zimmerman, A. B., & Zoet, E.
Affiliations
  • Brigham Young University (US)
  • Radboud University Nijmegen (NL)
  • Missouri State University (US)
  • Louisiana State University (US)
  • University of Wisconsin–Oshkosh (US)
  • Southern Methodist University (US)
  • University of Arkansas at Fayetteville (US)
  • Portland State University (US)
  • Bryant University (US)
  • RMIT University (AU)
  • University of Louisville (US)
  • University of Delaware (US)
  • The University of Texas at Austin (US)
  • Tilburg University (NL)
  • Norwegian University of Science and Technology (NO)
  • Mississippi State University (US)
  • University of San Diego (US)
  • University of Wisconsin–Whitewater (US)
  • North Carolina Agricultural and Technical State University (US)
  • Auburn University (US)
  • Ghent University (BE)
  • University of Technology Sydney (AU)
  • University of Duisburg-Essen (DE)
  • Georgia State University (US)
  • Idaho State University (US)
  • North Carolina State University (US)
  • Oklahoma State University (US)
  • University of North Carolina at Pembroke (US)
  • Temple University (US)
  • Utah State University (US)
  • Unaffiliated
  • Creighton University (US)
  • University of North Carolina at Charlotte (US)
  • University of Central Arkansas (US)
  • University of Nevada, Las Vegas (US)
  • Loyola University Maryland (US)
  • Brigham Young University–Hawaii (US)
  • University of Mississippi (US)
  • University of Kansas (US)
  • West Virginia University (US)
  • Whitworth University (US)
  • Texas Tech University (US)
  • University of Waterloo (CA)
  • University of Washington (US)
  • Sam Houston State University (US)
  • University of Alabama (US)
  • University of Tennessee at Chattanooga (US)
  • Arizona State University (US)
  • Radboud University
  • Francis Marion University (US)
  • Manhattan University (US)
  • Iowa State University (US)
  • Arkansas State University (US)
  • College of the Holy Cross (US)
  • University of Montana (US)
  • University of Auckland (NZ)
  • University of South Florida St. Petersburg (US)
  • University of Missouri–Kansas City (US)
  • Georgia Southern University
  • Sacred Heart University (US)
  • University of Wisconsin–Stevens Point (US)
  • Northern Illinois University (US)
  • Texas A&M University (US)
  • Morgan State University
  • The University of Texas at El Paso (US)
  • Southern Illinois University Carbondale (US)
  • Baylor University (US)
  • Simon Fraser University
  • Virginia Tech (US)
  • Southern Utah University (US)
  • University of Toledo (US)
  • University of Tampa (US)
  • East Carolina University (US)
  • Bentley University (US)
  • Tennessee Technological University (US)
  • Clemson University (US)
  • Berry College (US)
  • University of Memphis (US)
  • Northeastern University (US)
  • Florida Gulf Coast University (US)
  • Utah Tech University (US)
  • University of North Carolina Wilmington (US)
  • University of Illinois Urbana-Champaign (US)
  • Grand Valley State University (US)
  • Boise State University (US)
  • University of Agder (NO)
  • University of North Carolina at Chapel Hill (US)
  • Kennesaw State University (US)
  • National Taiwan University (TW)
  • Pace University (US)
  • National Cheng Kung University (TW)
  • Monash University (AU)
  • Fairfield University (US)
  • Southern Illinois University Carbondale
  • Truman State University (US)
  • Rutgers, The State University of New Jersey (US)
  • UNSW Sydney (AU)
  • University of South Dakota (US)
  • University of North Texas (US)
  • Norwegian School of Economics (NO)
  • University of Illinois Chicago (US)
  • Woodbury University (US)
  • Middle Tennessee State University (US)
  • Gonzaga University (US)
  • University of Dayton (US)
  • George Mason University (US)
  • Zayed University (AE)
  • Christopher Newport University (US)
  • University of South-Eastern Norway (NO)
  • Samford University (US)
  • University of Hartford (US)
  • Georgia Southern University (US)
  • University of Notre Dame (US)
  • Bucknell University (US)
  • Colorado State University (US)
  • Whitworth University
  • University of Houston - Downtown (US)
  • Baruch College (US)
  • University of Vermont (US)
  • University of Bremen (DE)
  • BI Norwegian Business School (NO)
  • Erasmus University Rotterdam (NL)
  • University of Missouri–St. Louis (US)
  • Florida State University (US)
  • Appalachian State University (US)
  • Augustana University (US)
  • HCT Business School Dubai
  • California State University, Northridge (US)
  • Babson College (US)
  • Palm Beach Atlantic University (US)
  • Utah Valley University (US)
  • Hofstra University (US)
  • University of Wisconsin–Madison (US)
  • University of Southern California
  • University of Wyoming (US)
  • University of Calabar (NG)
  • Susquehanna University (US)
  • North Dakota State University (US)
  • Florida Atlantic University (US)
  • University of New Hampshire (US)
  • Loyola Marymount University (US)
  • University of Oklahoma (US)
  • University of Nevada, Reno (US)
  • Lewis University (US)
  • University of Minnesota Crookston (US)
  • University of Mary Washington (US)
  • WHU – Otto Beisheim School of Management (DE)
  • California State University, Monterey Bay (US)
  • Constructor University (DE)
  • Kent State University (US)
  • Simon Fraser University (CA)
  • York University (CA)
  • University of Wisconsin–Eau Claire (US)
  • University of Massachusetts Amherst (US)
  • The University of Melbourne (AU)
  • Bifrost University
  • Pennsylvania State University (US)
  • University of Lethbridge (CA)
  • West Texas A&M University (US)
  • California State University, Fullerton (US)
  • Washington State University (US)
  • University of South Carolina (US)
  • American University (US)
  • LSU New Orleans (US)
  • Dalhousie University (CA)
  • Emporia State University (US)
  • University of Pittsburgh (US)
  • University of Southern Denmark (DK)
  • University of Nebraska–Lincoln (US)
  • Lone Star College (US)
  • Stephen F. Austin State University (US)
  • University of Notre Dame
  • Trinity University (US)
  • Central Michigan University (US)
  • Kansas State University (US)
  • IE University (ES)
  • Ohio University (US)
  • Minnesota State University, Mankato (US)
  • University of Central Florida (US)
  • University of Idaho (US)
  • James Madison University (US)
  • Texas State University (US)
  • The University of Texas at San Antonio (US)
  • Ferris State University (US)
ORCID
Venue
Issues in Accounting Education
Published
2023-10-26
Volume
38
Issue
4
Pages
81-108
ISSN
  • 0739-3172 (ISSN-L)
  • 1558-7983
OpenAlex
W4366679995
Cited by
166
References
34
Citations by year
2026: 41 · 2025: 53 · 2024: 49 · 2023: 21
FWCI
55.40
Type
journal article
Language
en
Open access
Licence
other-oa
Locations
  • Issues in Accounting Education (publishedVersion)
  • EUR Research Repository (Erasmus University Rotterdam) (publishedVersion, other-oa)
  • University of Southern Denmark Research Portal (University of Southern Denmark) (publishedVersion, other-oa)
  • Open Research Online (The Open University) (acceptedVersion)
  • Radboud Repository (Radboud University) (submittedVersion)
  • BearWorks (Missouri State University) (submittedVersion)
  • Bucknell Digital Commons (Bucknell University) (submittedVersion)
  • PDXScholar (Portland State University) (submittedVersion)
  • ScholarsArchive (Brigham Young University) (submittedVersion)
  • Research portal (Tilburg University) (submittedVersion, other-oa)
  • EUR Research Repository (Erasmus University Rotterdam) (submittedVersion, other-oa)
  • Ghent University Academic Bibliography (Ghent University) (submittedVersion, other-oa)
  • Figshare (submittedVersion)
  • Minerva Access (University of Melbourne) (submittedVersion)
  • OPUS - Open Publications of UTS Scholars (University of Technology Sydney) (submittedVersion)
  • ResearchSpace (University of Auckland) (submittedVersion)
Topics
  • Social Sciences › Business, Management and Accounting › Accounting › Accounting Education and Careers
  • Social Sciences › Education › Artificial Intelligence in Education
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
Keywords
ChatGPT, large language models, chatbots, accounting education, student performance, test bank, partial credit, question types, artificial intelligence in education

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A second model labelled each claim on 2026-11-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The ChatGPT Artificial Intelligence Chatbot: How Well Does It Answer Accounting Assessment Questions? https://app.cochat.ai/papers/10.2308/issues-2023-013
The paper
Wood, D. A., Achhpilia, M. P., Adams, M. T., Aghazadeh, S., Akinyele, K., Akpan, M., Allee, K. D., Allen, A. M., Almer, E. D., Ames, D., Arity, V., Barr-Pulliam, D., Basoglu, K. A., Belnap, A., Bentley, J. W., Berg, T., Berglund, N. R., Berry, E., Bhandari, A., . . . Zoet, E. (2023). The ChatGPT Artificial Intelligence Chatbot: How Well Does It Answer Accounting Assessment Questions? Issues in Accounting Education. https://doi.org/10.2308/issues-2023-013

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.