How generative AI models such as ChatGPT can be (mis)used in SPC practice, education, and research? An exploratory study
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Generative Artificial Intelligence (AI) models such as OpenAI’s ChatGPT have the potential to revolutionize Statistical Process Control (SPC) practice, learning, and research. However, these tools are in the early stages of development and can be easily misused or misunderstood. In this paper, we give an overview of the development of Generative AI. Specifically, we explore ChatGPT’s ability to provide code, explain basic concepts, and create knowledge related to SPC practice, learning, and research. By investigating responses to structured prompts, we highlight the benefits and limitations of the results. Our study indicates that the current version of ChatGPT performs well for structured tasks, such as translating code from one language to another and explaining well-known concepts but struggles with more nuanced tasks, such as explaining less widely known terms and creating code from scratch. We find that using new AI tools may help practitioners, educators, and researchers to be more efficient and productive. However, in their current stages of development, some results are misleading and wrong. Overall, the use of generative AI models in SPC must be properly validated and used in conjunction with other methods to ensure accurate results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Survey of Hallucination in Natural Language Generation
Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y. J., Madotto, A., & Fung, P. (2023) · ACM Computing Surveys · doi:10.1145/3571730 · Cited by 5,025 · cited 1×
“This issue is a known limitation of current generative AI models, including ChatGPT (see Ji et al. (2023) for more details on hallucination in natural language generation ).”
BackgroundTraining language models to follow instructions with human feedback
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C. L., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2203.02155 · Cited by 4,208
Gilson, A., Safranek, C. W., Huang, T., Socrates, V., Chi, L., Taylor, R. A., & Chartash, D. (2023) · JMIR Medical Education · doi:10.2196/45312 · Cited by 2,078
ChatGPT is fun, but not an author
Thorp, H. H. (2023) · Science · doi:10.1126/science.adg7879 · Cited by 1,437
Toolformer: Language Models Can Teach Themselves to Use Tools
Schick, T., Dwivedi-Yu, J., Dessì, R., Raileanu, R., Lomeli, M., Zettlemoyer, L., Cancedda, N., & Scialom, T. (2023) · arXiv · doi:10.48550/arxiv.2302.04761 · Cited by 1,150
What ChatGPT and generative AI mean for science
Stokel-Walker, C., & Van Noorden, R. (2023) · Nature · doi:10.1038/d41586-023-00340-6 · Cited by 828 · cited 1×
“…excluding LLM from scientific authorship (Editorial 2023a; Nature 2023; Thorp 2023), discussion on ChatGPT ’ s impact on science (Editorial 2023b; Stokel-Walker and Van Noorden 2023), and how LLM outputs can be watermarked (Kirchenbauer et al. 2023) to prevent the misuse of AI-based output.”
BackgroundTools such as ChatGPT threaten transparent science; here are our ground rules for their use
(2023) · Nature · doi:10.1038/d41586-023-00191-1 · Cited by 605
ChatGPT and the future of medical writing
Biswas, S. (2023) · Radiology · doi:10.1148/radiol.223312 · Cited by 571
Research works printed but not linked: 44
- Agostinelli A. T. I. Denk Z. Borsos J. Engel M. Verzetti A. Caillon Q. Huang A. Jansen A. Roberts M. Tagliasacchi M. Sharifi N. Zeghidour and C. Frank. 2023. MusicLM: Generating music from text. https://arxiv.org/abs/2301.11325. · arXiv
- 10.2307/1391421 · doi:10.2307/1391421
- 10.1145/1414004.1414026 · DOI
- 10.1080/08982112.2012.627003 · DOI
- 10.1080/08982110802445561 · DOI · Paper page
- Chen M. J. Tworek H. Jun Q. Yuan H. P. D. O. Pinto J. Kaplan H. Edwards Y. Burda N. Joseph G. Brockman et al. 2021. Evaluating large language models trained on code. https://arxiv.org/abs/2107.03374. · arXiv
- Choi, K., A. Grover, T. Singh, R. Shu, and S. Ermon. 2020. Fair generative modeling via weak supervision. In Proceedings of the 37th International Conference on Machine Learning, Volume 119 of Proceedings of Machine Learning Research, ed. H. D. III and A. Singh, 1887–98. PMLR, July 13–18.
- 10.1080/00224065.2021.1987806 · DOI
- 10.1080/00401706.1986.10488126 · doi:10.1080/00401706.1986.10488126
- 10.1016/j.frl.2023.103662 · DOI · Paper page
- 10.1038/s42256-023-00613-9 · DOI
- 10.1080/08982112.2015.1083107 · doi:10.1080/08982112.2015.1083107
- 10.1080/00224065.2020.1828008 · DOI
- 10.1080/00224065.2019.1571345 · doi:10.1080/00224065.2019.1571345
- 10.1080/00224065.2014.11917969 · DOI · Paper page
- Karpas E. O. Abend Y. Belinkov B. Lenz O. Lieber N. Ratner Y. Shoham H. Bata Y. Levine K. Leyton-Brown et al. 2022. Mrkl systems: A modular neuro-symbolic architecture that combines large language models external knowledge sources and discrete reasoning. https://arxiv.org/abs/2205.00445. · arXiv
- 10.1080/00224065.2003.11980225 · doi:10.1080/00224065.2003.11980225
- Kirchenbauer J. J. Geiping Y. Wen J. Katz I. Miers and T. Goldstein. 2023. A watermark for large language models. https://arxiv.org/abs/2301.10226. · arXiv
- 10.1080/07474946.2021.1940501 · doi:10.1080/07474946.2021.1940501
- 10.1080/00401706.1990.10484583 · DOI · Paper page
- 10.1016/j.cie.2018.10.008 · DOI
- 10.1017/S0269889706001074 · DOI
- McKee F. and D. Noever. 2022. Chatbots in a botnet world. https://arxiv.org/abs/2212.11126. · arXiv
- 10.1080/08982112.2018.1530358 · DOI
- 10.1007/978-3-319-12355-4_3 · DOI
- 10.1080/00224065.2011.11917848 · DOI
- Montgomery, D. 2020. Introduction to statistical quality control. 8th ed. John Wiley & Sons.
- Nature. 2023. For authors: Initial submission guidelines. Last accessed February 12 2023. https://www.nature.com/nature/for-authors/initial-submission.
- Noorossana, R., A. Saghaei, and A. Amiri. 2013., Statistical analysis of profile monitoring. 1st ed. Hoboken, New Jersey: John Wiley & Sons.
- Ramesh K. S. Sitaram and M. Choudhury. 2023. Fairness in language models beyond English: Gaps and challenges. arXiv preprint arXiv:2302.12578. · DOI
- 10.1080/00224065.2015.11918120 · doi:10.1080/00224065.2015.11918120
- Schwarz, K., A. Liao and, and Geiger, Y. 2021. On the frequency bias of generative models. Advances in Neural Information Processing Systems 34:18126–36.
- Scrucca L. 4. 2004. qcc: An R package for quality control charting and statistical process control. R News Vol. 4/1 July 8. http://www.stat.unipg.it/luca/misc/Rnews_2004-1-pag11-17.pdf.
- 10.1002/j.1538-7305.1948.tb01338.x · DOI · Paper page
- Singer U. S. Sheynin A. Polyak O. Ashual I. Makarov F. Kokkinos N. Goyal A. Vedaldi D. Parikh J. Johnson et al. 2023. Text-To-4D dynamic scene generation. https://arxiv.org/abs/2301.11280. · arXiv
- Vaswani, A., N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. U. Kaiser, and I. Polosukhin. 2017. Attention is all you need. In Advances in Neural Information Processing Systems, Vol. 30, ed. I. Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett. Curran Associates, Inc. https://proceedings.neurips.cc/ paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf.
- 10.1080/00224065.2016.11918148 · DOI
- Wei J. Y. Tay R. Bommasani C. Raffel B. Zoph S. Borgeaud D. Yogatama M. Bosma D. Zhou D. Metzler et al. 2022. Emergent abilities of large language models. In Transactions on Machine Learning Research. Accepted paper. https://openreview.net/forum?id=yzkSU5zdwD.
- Weisz J. D. M. Muller J. He and S. Houde. 2023. Toward general design principles for generative AI applications. https://arxiv.org/abs/2301.05578. · arXiv
- 10.1007/s10845-012-0665-2 · doi:10.1007/s10845-012-0665-2
- 10.1590/S0103-65132007000300002 · doi:10.1590/s0103-65132007000300002
- 10.1002/qre.1304 · doi:10.1002/qre.1304
- Zhao, S., H. Ren, A. Yuan, J. Song, N. Goodman, and S. Ermon. 2018. Bias and generalization in deep generative models: An empirical study. In Advances in Neural Information Processing Systems, Vol. 31.
- Zwetsloot I. M. W. H. Jones-Farmer and and Woodall L. A. 2023. Monitoring univariate processes using control charts: Some practical issues and advice. Submitted for Publication. · DOI
Cited by
What Is the Impact of ChatGPT on Education? A Rapid Review of the Literature
Lo, C. K. (2023) · Education Sciences · doi:10.3390/educsci13040410 · Cited by 2,024
Bahroun, Z., Anane, C., Ahmed, V., & Zacca, A. (2023) · Sustainability · doi:10.3390/su151712983 · Cited by 784
Summary of ChatGPT-Related research and perspective towards the future of large language models
Liu, Y., Han, T., Ma, S., Zhang, J., Yang, Y., Tian, J., He, H., Li, A., He, M., Liu, Z., et al. (2023) · Meta-Radiology · doi:10.1016/j.metrad.2023.100017 · Cited by 855
Unlocking the opportunities through ChatGPT Tool towards ameliorating the education system
Javaid, M., Haleem, A., Singh, R. P., Khan, S., & Khan, I. H. (2023) · BenchCouncil Transactions on Benchmarks, Standards and Evaluations · doi:10.1016/j.tbench.2023.100115 · Cited by 535
A Categorical Archive of ChatGPT Failures
Borji, A. (2023) · arXiv · doi:10.48550/arxiv.2302.03494 · Cited by 514
Metadata
- Authors
- Megahed, F. M., Chen, Y.-J., Ferris, J. A., Knoth, S., & Jones-Farmer, L. A.
- Venue
- Quality Engineering
- Publisher
- Informa UK Limited
- Published
- 2023-06-16
- Volume
- 36
- Issue
- 2
- Pages
- 287-315
- ISSN
- 0898-2112 (ISSN-L)
- 1532-4222
- OpenAlex
- W4380879558
- Cited by
- 190
- References
- 15
- FWCI
- 34.88
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: How generative AI models such as ChatGPT can be (mis)used in SPC practice, education, and research? An exploratory study. https://app.cochat.ai/papers/10.1080/08982112.2023.2206479
- The paper
- Megahed, F. M., Chen, Y.-J., Ferris, J. A., Knoth, S., & Jones-Farmer, L. A. (2024). How generative AI models such as ChatGPT can be (mis)used in SPC practice, education, and research? An exploratory study. Quality Engineering. https://doi.org/10.1080/08982112.2023.2206479
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.