CoChat

How generative AI models such as ChatGPT can be (mis)used in SPC practice, education, and research? An exploratory study

Open access
Megahed, Fadel M., Chen, Ying-Ju, Ferris, Joshua A., Knoth, Sven, Jones-Farmer, L. Allison · 2024 · Quality Engineering
Cited by 190

The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.

Abstract

Generative Artificial Intelligence (AI) models such as OpenAI’s ChatGPT have the potential to revolutionize Statistical Process Control (SPC) practice, learning, and research. However, these tools are in the early stages of development and can be easily misused or misunderstood. In this paper, we give an overview of the development of Generative AI. Specifically, we explore ChatGPT’s ability to provide code, explain basic concepts, and create knowledge related to SPC practice, learning, and research. By investigating responses to structured prompts, we highlight the benefits and limitations of the results. Our study indicates that the current version of ChatGPT performs well for structured tasks, such as translating code from one language to another and explaining well-known concepts but struggles with more nuanced tasks, such as explaining less widely known terms and creating code from scratch. We find that using new AI tools may help practitioners, educators, and researchers to be more efficient and productive. However, in their current stages of development, some results are misleading and wrong. Overall, the use of generative AI models in SPC must be properly validated and used in conjunction with other methods to ensure accurate results.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1080/08982112.2023.2206479

Cites

15 of 15 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 15 references

Research works printed but not linked: 44

  1. Agostinelli A. T. I. Denk Z. Borsos J. Engel M. Verzetti A. Caillon Q. Huang A. Jansen A. Roberts M. Tagliasacchi M. Sharifi N. Zeghidour and C. Frank. 2023. MusicLM: Generating music from text. https://arxiv.org/abs/2301.11325. · arXiv
  2. 10.2307/1391421 · doi:10.2307/1391421
  3. 10.1145/1414004.1414026 · DOI
  4. 10.1080/08982112.2012.627003 · DOI
  5. 10.1080/08982110802445561 · DOI · Paper page
  6. Chen M. J. Tworek H. Jun Q. Yuan H. P. D. O. Pinto J. Kaplan H. Edwards Y. Burda N. Joseph G. Brockman et al. 2021. Evaluating large language models trained on code. https://arxiv.org/abs/2107.03374. · arXiv
  7. Choi, K., A. Grover, T. Singh, R. Shu, and S. Ermon. 2020. Fair generative modeling via weak supervision. In Proceedings of the 37th International Conference on Machine Learning, Volume 119 of Proceedings of Machine Learning Research, ed. H. D. III and A. Singh, 1887–98. PMLR, July 13–18.
  8. 10.1080/00224065.2021.1987806 · DOI
  9. 10.1080/00401706.1986.10488126 · doi:10.1080/00401706.1986.10488126
  10. 10.1016/j.frl.2023.103662 · DOI · Paper page
  11. 10.1038/s42256-023-00613-9 · DOI
  12. 10.1080/08982112.2015.1083107 · doi:10.1080/08982112.2015.1083107
  13. 10.1080/00224065.2020.1828008 · DOI
  14. 10.1080/00224065.2019.1571345 · doi:10.1080/00224065.2019.1571345
  15. 10.1080/00224065.2014.11917969 · DOI · Paper page
  16. Karpas E. O. Abend Y. Belinkov B. Lenz O. Lieber N. Ratner Y. Shoham H. Bata Y. Levine K. Leyton-Brown et al. 2022. Mrkl systems: A modular neuro-symbolic architecture that combines large language models external knowledge sources and discrete reasoning. https://arxiv.org/abs/2205.00445. · arXiv
  17. 10.1080/00224065.2003.11980225 · doi:10.1080/00224065.2003.11980225
  18. Kirchenbauer J. J. Geiping Y. Wen J. Katz I. Miers and T. Goldstein. 2023. A watermark for large language models. https://arxiv.org/abs/2301.10226. · arXiv
  19. 10.1080/07474946.2021.1940501 · doi:10.1080/07474946.2021.1940501
  20. 10.1080/00401706.1990.10484583 · DOI · Paper page
  21. 10.1016/j.cie.2018.10.008 · DOI
  22. 10.1017/S0269889706001074 · DOI
  23. McKee F. and D. Noever. 2022. Chatbots in a botnet world. https://arxiv.org/abs/2212.11126. · arXiv
  24. 10.1080/08982112.2018.1530358 · DOI
  25. 10.1007/978-3-319-12355-4_3 · DOI
  26. 10.1080/00224065.2011.11917848 · DOI
  27. Montgomery, D. 2020. Introduction to statistical quality control. 8th ed. John Wiley & Sons.
  28. Nature. 2023. For authors: Initial submission guidelines. Last accessed February 12 2023. https://www.nature.com/nature/for-authors/initial-submission.
  29. Noorossana, R., A. Saghaei, and A. Amiri. 2013., Statistical analysis of profile monitoring. 1st ed. Hoboken, New Jersey: John Wiley & Sons.
  30. Ramesh K. S. Sitaram and M. Choudhury. 2023. Fairness in language models beyond English: Gaps and challenges. arXiv preprint arXiv:2302.12578. · DOI
  31. 10.1080/00224065.2015.11918120 · doi:10.1080/00224065.2015.11918120
  32. Schwarz, K., A. Liao and, and Geiger, Y. 2021. On the frequency bias of generative models. Advances in Neural Information Processing Systems 34:18126–36.
  33. Scrucca L. 4. 2004. qcc: An R package for quality control charting and statistical process control. R News Vol. 4/1 July 8. http://www.stat.unipg.it/luca/misc/Rnews_2004-1-pag11-17.pdf.
  34. 10.1002/j.1538-7305.1948.tb01338.x · DOI · Paper page
  35. Singer U. S. Sheynin A. Polyak O. Ashual I. Makarov F. Kokkinos N. Goyal A. Vedaldi D. Parikh J. Johnson et al. 2023. Text-To-4D dynamic scene generation. https://arxiv.org/abs/2301.11280. · arXiv
  36. Vaswani, A., N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. U. Kaiser, and I. Polosukhin. 2017. Attention is all you need. In Advances in Neural Information Processing Systems, Vol. 30, ed. I. Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett. Curran Associates, Inc. https://proceedings.neurips.cc/ paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf.
  37. 10.1080/00224065.2016.11918148 · DOI
  38. Wei J. Y. Tay R. Bommasani C. Raffel B. Zoph S. Borgeaud D. Yogatama M. Bosma D. Zhou D. Metzler et al. 2022. Emergent abilities of large language models. In Transactions on Machine Learning Research. Accepted paper. https://openreview.net/forum?id=yzkSU5zdwD.
  39. Weisz J. D. M. Muller J. He and S. Houde. 2023. Toward general design principles for generative AI applications. https://arxiv.org/abs/2301.05578. · arXiv
  40. 10.1007/s10845-012-0665-2 · doi:10.1007/s10845-012-0665-2
  41. 10.1590/S0103-65132007000300002 · doi:10.1590/s0103-65132007000300002
  42. 10.1002/qre.1304 · doi:10.1002/qre.1304
  43. Zhao, S., H. Ren, A. Yuan, J. Song, N. Goodman, and S. Ermon. 2018. Bias and generalization in deep generative models: An empirical study. In Advances in Neural Information Processing Systems, Vol. 31.
  44. Zwetsloot I. M. W. H. Jones-Farmer and and Woodall L. A. 2023. Monitoring univariate processes using control charts: Some practical issues and advice. Submitted for Publication. · DOI

Cited by

See all 190

Metadata

Authors
Megahed, F. M., Chen, Y.-J., Ferris, J. A., Knoth, S., & Jones-Farmer, L. A.
Venue
Quality Engineering
Published
2023-06-16
Volume
36
Issue
2
Pages
287-315
ISSN
  • 0898-2112 (ISSN-L)
  • 1532-4222
OpenAlex
W4380879558
Cited by
190
References
15
FWCI
34.88
Type
journal article
Language
en
Open access
green

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: How generative AI models such as ChatGPT can be (mis)used in SPC practice, education, and research? An exploratory study. https://app.cochat.ai/papers/10.1080/08982112.2023.2206479
The paper
Megahed, F. M., Chen, Y.-J., Ferris, J. A., Knoth, S., & Jones-Farmer, L. A. (2024). How generative AI models such as ChatGPT can be (mis)used in SPC practice, education, and research? An exploratory study. Quality Engineering. https://doi.org/10.1080/08982112.2023.2206479

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.