CoChat

The Benefits and Limitations of ChatGPT in Business Education and Research: A Focus on Management Science, Operations Management and Data Analytics

Cribben, Ivor, Zeinali, Yasser · 2023
PreprintCited by 46

The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.

Abstract

ChatGPT is an artificial-intelligence chatbot developed by OpenAI. It can be used in a variety of applications including content creation, personalized recommendations, copy creation, and for language translation. In business, it can be used for data analysis, provide recommendations, and even process orders. Its benefits have been discussed widely in popular media with several articles focusing on the changes it will bring to the workforce and the way we live and work broadly. In this article, we discuss the benefits and limitations of ChatGPT in business education and research with a particular focus on the areas of management science, operations management and data analytics. We provide a extensive systematic review of it capabilities and hope that both professors and students use it as a helpful guide to return to frequently. For professors, it can design courses, create syllabi and content (including lecture slides and assignments), help with grading, and with student understanding. For students, it can explain complex concepts, create and debug code, and create sample exam questions. Overall, we find that writing and debugging code and grading are the greatest strengths of ChatGPT for educational and research purposes. However, it has limitations including that it often makes errors and requires a deeper or an advanced knowledge of the domain. Finally, the discussion of ChatGPT in business education and research also raises problems regarding bias and plagiarism.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2139/ssrn.4404276

Cites

11 of 11 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 11 references

Research works printed but not linked: 25

  1. sample article generated by ChatGPT regarding its benefits and limitations in management science and operations management education and research: References
  2. S Akter, 2022, Algorithmic bias in machine learning-based marketing models, Journal of Business Research, 144, 201, 10.1016/j.jbusres.2022.01.083 · DOI · Paper page
  3. S Akter, 2021, Algorithmic bias in data-driven
  4. H Alshurafat, 2023, The usefulness and challenges of chatbots for accounting professionals: Application on chatgpt
  5. D Bertsimas, 2020, From predictive to prescriptive analytics, Management Science, 66, 1025, 10.1287/mnsc.2018.3253 · DOI · Paper page
  6. S Downes, 2022, Connectivism. Asian Journal of Distance Education, 17
  7. N Gillani, 2023, Unpacking the "black box, 26, 99
  8. L Iftikhar, 2023, Docgpt: Impact of chatgpt-3 on health services as a virtual doctor, EC Paediatrics, 12, 45
  9. K M Kostick-Quenet, 2022, Mitigating racial bias in machine learning, Medicine & Ethics, 50, 92
  10. H Liang, 2023, Generative pre-trained transformer-based reinforcement learning for testing web application firewalls, IEEE Transactions on Dependable and Secure Computing
  11. H Liu, 2023, Languages are rewards: Hindsight finetuning using human feedback
  12. R W Mcgee, 2023, Annie chan: Three short stories written with chat gpt
  13. D Mhlanga, 2023, Open ai in education, the responsible and ethical use of chatgpt towards lifelong learning. education, the responsible and ethical use of chatgpt towards lifelong learning
  14. S Nemorin, 2023, Ai hyped? a horizon scan of discourse on artificial intelligence in education (aied) and development. Learning, Media and Technology, 48, 38
  15. W Ng, 2015, New digital technology in education, 10.1007/978-3-319-05822-1 · DOI
  16. M Rohmatillah, 2023, Hierarchical reinforcement learning with guidance for multi-domain dialogue policy, IEEE/ACM Transactions on Audio, Speech, and Language Processing
  17. G Siemens, 2004, Connectivism: A learning theory for the digital age, Elearnspace.org
  18. B Singh, 2022, Reinforcement learning in robotic applications: a comprehensive survey, Artificial Intelligence Review, 1
  19. M N Singh, 2021, Inroad of digital technology in education: Age of digital classroom, Higher Education for the Future, 8, 20, 10.1177/2347631120980272 · DOI
  20. N Sultan, 2010, Cloud computing for education: A new dawn?, International Journal of Information Management, 30, 109, 10.1016/j.ijinfomgt.2009.09.004 · DOI · Paper page
  21. C Terwiesch, 2023, Would chat gpt get a wharton mba? a prediction based on its performance in the operations management course
  22. J Utecht, 2019, Becoming relevant again: Applying connectivism learning theory to today's classrooms, Critical Questions in Education, 10, 107
  23. J Wedman, 1984, Concerns of teachers about educational computing, AEDS Journal, 18, 31, 10.1080/00011037.1984.11008383 · doi:10.1080/00011037.1984.11008383
  24. D A Wood, 2023, The chatgpt artificial intelligence chatbot: How well does it answer accounting assessment questions? Issues in Accounting Education, 1
  25. X Xiong, 2022, The state of play of reproducibility in statistics: an empirical analysis, The American Statistician, 1

Cited by

See all 46

Metadata

Authors
Cribben, I., & Zeinali, Y.
Publisher
Elsevier BV
Published
2023
Cited by
46
References
11
Type
Preprint

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The Benefits and Limitations of ChatGPT in Business Education and Research: A Focus on Management Science, Operations Management and Data Analytics. https://app.cochat.ai/papers/10.2139/ssrn.4404276
The paper
Cribben, I., & Zeinali, Y. (2023). The Benefits and Limitations of ChatGPT in Business Education and Research: A Focus on Management Science, Operations Management and Data Analytics. https://doi.org/10.2139/ssrn.4404276

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.