CoChat
Sign Up
PreprintCited by 167Artificial Intelligence ApplicationsTopic ModelingArtificial Intelligence in Healthcare and Education

Let's have a chat! A Conversation with ChatGPT: Technology, Applications, and Limitations

Open access
Shahriar, Sakib, Hayawi, Kadhim·2023·arXiv
DOI 10.48550/arxiv.2302.13817arXiv 2302.13817
Open this paper in CoChat — free accountOpen PDF

Abstract

The emergence of an AI-powered chatbot that can generate human-like sentences and write coherent essays has caught the world's attention. This paper discusses the historical overview of chatbots and the technology behind Chat Generative Pre-trained Transformer, better known as ChatGPT. Moreover, potential applications of ChatGPT in various domains, including healthcare, education, and research, are highlighted. Despite promising results, there are several privacy and ethical concerns surrounding ChatGPT. In addition, we highlight some of the important limitations of the current version of ChatGPT. We also ask ChatGPT to provide its point of view and present its responses to several questions we attempt to answer.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2302.13817

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Schmälzle & Wilcox highlight the risks of a dual use of LLMs: while they might further equal access to information, malicious actors can and seem to be using LLMs to spread fake information and devise health messages at an unprecedented scale that is harmful to societies.

    “Schmälzle & Wilcox highlight the risks of a dual use of LLMs50. While they might further equal access to information, malicious actors can and seem to be using LLMs to spread fake information and devise health messages at an unprecedented scale that is harmful to societies50,51,75.”

    From The ethics of ChatGPT in medicine and healthcare: a systematic review on large language models (LLMs) (2024) · cites this paper as [51]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The citation lists haven’t been fetched yet

References 69 · Cited by 167

Research works printed but not linked: 63

  1. Aczel, B., & Wagenmakers, E.-J. (2023). Transparency Guidance for ChatGPT Usage in Scientific Writing. PsyArXiv. https://doi.org/10.31234/osf.io/b58ex · DOI · Paper page
  2. Adamopoulou, E., & Moussiades, L. (2020). An Overview of Chatbot Technology. In I. Maglogiannis, L. Iliadis, & E. Pimenidis (Eds.), Artificial Intelligence Applications and Innovations (pp. 373-383). Springer International Publishing. https://doi.org/10.1007/978-3-030-49186-4\_31 · DOI
  3. Alkaissi, H., & McFarlane, S. I. (2023). Artificial Hallucinations in ChatGPT: Implications in Scientific Writing. Cureus, 15(2), e35179. https://doi.org/10.7759/cureus.35179 · DOI · Paper page
  4. Antaki, F., Touma, S., Milad, D., El-Khoury, J., & Duval, R. (2023). Evaluating the Performance of ChatGPT in Ophthalmology: An Analysis of its Successes and Shortcomings (p. 2023.01.22.23284882). medRxiv. https://doi.org/10.1101/2023.01.22.23284882 · DOI · Paper page
  5. Aydın, Ö., & Karaarslan, E. (2022). OpenAI ChatGPT Generated Literature Review: Digital Twin in Healthcare (SSRN Scholarly Paper No. 4308687). https://doi.org/10.2139/ssrn.4308687 · DOI · Paper page
  6. Bang, Y., Cahyawijaya, S., Lee, N., Dai, W., Su, D., Wilie, B., Lovenia, H., Ji, Z., Yu, T., Chung, W., Do, Q. V., Xu, Y., & Fung, P. (2023). A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity (arXiv:2302.04023). arXiv. https://doi.org/10.48550/arXiv.2302.04023 · DOI · Paper page
  7. Basic, Z., Banovac, A., Kruzic, I., & Jerkovic, I. (2023). Better by you, better than me, chatgpt3 as writing assistance in students essays (arXiv:2302.04536). arXiv. https://doi.org/10.48550/arXiv.2302.04536 · DOI
  8. Bordt, S., & von Luxburg, U. (2023). ChatGPT Participates in a Computer Science Exam (arXiv:2303.09461). arXiv. https://doi.org/10.48550/arXiv.2303.09461 · DOI
  9. Borji, A. (2023). A Categorical Archive of ChatGPT Failures (arXiv:2302.03494). arXiv. https://doi.org/10.48550/arXiv.2302.03494 · DOI · Paper page
  10. Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J. D., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., Agarwal, S., Herbert-Voss, A., Krueger, G., Henighan, T., Child, R., Ramesh, A., Ziegler, D., Wu, J., Winter, C., … Amodei, D. (2020). Language models are few-shot learners. In H. Larochelle, M. Ranzato, R. Hadsell, M. F. Balcan, & H. Lin (Eds.), Advances in neural information processing systems (Vol. 33, pp. 1877-1901). Curran Associates, Inc. https://proceedings.neurips.cc/paper/2020/file/1457c0d6bfcb4967418bfb8ac142f64a-Paper.pdf
  11. Carlini, N., Tramer, F., Wallace, E., Jagielski, M., Herbert-Voss, A., Lee, K., Roberts, A., Brown, T. B., Song, D., Erlingsson, U., & others. (2021). Extracting Training Data from Large Language Models. USENIX Security Symposium, 6.
  12. Chen, T.-J. (n.d.). ChatGPT and other artificial intelligence applications speed up scientific writing. Journal of the Chinese Medical Association, https://doi.org/10.1097/JCMA.0000000000000900 · DOI · Paper page
  13. Choi, J. H., Hickman, K. E., Monahan, A., & Schwarcz, D. (2023). ChatGPT Goes to Law School (SSRN Scholarly Paper No. 4335905). https://doi.org/10.2139/ssrn.4335905 · DOI
  14. De Angelis, L., Baglivo, F., Arzilli, G., Privitera, G. P., Ferragina, P., Tozzi, A. E., & Rizzo, C. (2023). ChatGPT and the Rise of Large Language Models: The New AI-Driven Infodemic Threat in Public Health (SSRN Scholarly Paper No. 4352931). https://doi.org/10.2139/ssrn.4352931 · DOI · Paper page
  15. de Winter, J. (2023). Can ChatGPT pass high school exams on English Language Comprehension? https://www.researchgate.net/publication/366659237\_Can\_ChatGPT\_pass\_high\_school\_exams\_on\_English\_Language \_Comprehension
  16. Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of deep bidirectional transformers for language understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), 4171-4186.
  17. Dowling, M., & Lucey, B. (2023). ChatGPT for (Finance) research: The Bananarama Conjecture. Finance Research Letters, 103662. https://doi.org/10.1016/j.frl.2023.103662 · DOI
  18. Else, H. (2023). Abstracts written by ChatGPT fool scientists. Nature, 613(7944), 423-423. https://doi.org/10.1038/d41586-02300056-7 · DOI
  19. Fijačko, N., Gosak, L., Štiglic, G., Picard, C. T., & Douma, M. J. (2023). Can ChatGPT pass the life support exams without entering the American heart association course? Resuscitation, 0(0). https://doi.org/10.1016/j.resuscitation.2023.109732 · DOI · Paper page
  20. Følstad, A., & Brandtzaeg, P. B. (2020). Users' experiences with chatbots: Findings from a questionnaire study. Quality and User Experience, 5(1), 3. https://doi.org/10.1007/s41233-020-00033-2 · DOI
  21. Frieder, S., Pinchetti, L., Griffiths, R.-R., Salvatori, T., Lukasiewicz, T., Petersen, P. C., Chevalier, A., & Berner, J. (2023). Mathematical Capabilities of ChatGPT (arXiv:2301.13867). arXiv. https://doi.org/10.48550/arXiv.2301.13867 · DOI · Paper page
  22. Gabrielson, A. T., Odisho, A. Y., & Canes, D. (2023). Harnessing Generative AI to Improve Efficiency Among Urologists: Welcome ChatGPT. Journal of Urology, 0(0), 10.1097/JU.0000000000003383. https://doi.org/10.1097/JU.0000000000003383 · DOI · Paper page
  23. Gilson, A., Safranek, C., Huang, T., Socrates, V., Chi, L., Taylor, R. A., & Chartash, D. (2022). How does ChatGPT perform on the medical licensing exams? The implications of large language models for medical education and knowledge assessment. MedRxiv : The Preprint Server for Health Sciences. https://doi.org/10.1101/2022.12.23.22283901. · DOI · Paper page
  24. Guo, B., Zhang, X., Wang, Z., Jiang, M., Nie, J., Ding, Y., Yue, J., & Wu, Y. (2023). How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detection (arXiv:2301.07597). arXiv. https://doi.org/10.48550/arXiv.2301.07597 · DOI · Paper page
  25. Gü zeldere, G., & Franchi, S. (1995). Dialogues with colorful 'personalities' of early AI. Stanford Humanities Review, 4(2), 161169.
  26. Hayawi, K., Shahriar, S., Serhani, M. A., Taleb, I., & Mathew, S. S. (2022). ANTi-Vax: A novel Twitter dataset for COVID-19 vaccine misinformation detection. Public Health, 203, 23-30. https://doi.org/10.1016/j.puhe.2021.11.022 · DOI
  27. Huang, S., Dong, L., Wang, W., Hao, Y., Singhal, S., Ma, S., Lv, T., Cui, L., Mohammed, O. K., Patra, B., Liu, Q., Aggarwal, K., Chi, Z., Bjorck, J., Chaudhary, V., Som, S., Song, X., & Wei, F. (2023). Language Is Not All You Need: Aligning Perception with Language Models (arXiv:2302.14045). arXiv. https://doi.org/10.48550/arXiv.2302.14045 · DOI · Paper page
  28. Hulman, A., Dollerup, O. L., Mortensen, J. F., Fenech, M., Norman, K., Stø vring, H., & Hansen, T. K. (2023). ChatGPT- versus human-generated answers to frequently asked questions about diabetes: A Turing test-inspired survey among employees of a Danish diabetes center (p. 2023.02.13.23285745). medRxiv. https://doi.org/10.1101/2023.02.13.23285745 · DOI
  29. Jalil, S., Rafi, S., LaToza, T. D., Moran, K., & Lam, W. (2023). ChatGPT and Software Testing Education: Promises & Perils (arXiv:2302.03287). arXiv. https://doi.org/10.48550/arXiv.2302.03287 · DOI
  30. Jiao, W., Wang, W., Huang, J., Wang, X., & Tu, Z. (2023). Is ChatGPT A Good Translator? A Preliminary Study (arXiv:2301.08745). arXiv. https://doi.org/10.48550/arXiv.2301.08745 · DOI · Paper page
  31. Kasneci, E., Seß ler, K., Kü chemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Gü nnemann, S., Hü llermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeffer, J., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., … Kasneci, G. (2023). ChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education. EdArXiv. https://doi.org/10.35542/osf.io/5er8f · DOI · Paper page
  32. Khalil, M., & Er, E. (2023). Will ChatGPT get you caught? Rethinking of Plagiarism Detection (arXiv:2302.04335). arXiv. https://doi.org/10.48550/arXiv.2302.04335 · DOI
  33. Khan, R. A., Jawaid, M., Khan, A. R., & Sajjad, M. (2023). ChatGPT - Reshaping medical education and clinical management. Pakistan Journal of Medical Sciences, 39(2). https://doi.org/10.12669/pjms.39.2.7653 · DOI · Paper page
  34. Korinek, A. (2023). Language Models and Cognitive Automation for Economic Research (Working Paper No. 30957). National Bureau of Economic Research. https://doi.org/10.3386/w30957 · DOI · Paper page
  35. Kung, T. H., Cheatham, M., Medenilla, A., Sillos, C., De Leon, L., Elepañ o, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., Maningo, J., & Tseng, V. (2023). Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models. PLOS Digital Health, 2(2), e0000198. https://doi.org/10.1371/journal.pdig.0000198 · DOI · Paper page
  36. Lee, J. Y. (2023). Can an artificial intelligence chatbot be the author of a scholarly article? Science Editing, 10(1), 7-12. https://doi.org/10.6087/kcse.292 · DOI
  37. Lin, Z. (2023). Why and how to embrace AI such as ChatGPT in your academic life. PsyArXiv. https://doi.org/10.31234/osf.io/sdx3j · DOI · Paper page
  38. Liu, V., & Chilton, L. B. (2022). Design guidelines for prompt engineering text-to-image generative models. Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3491102.3501825 · DOI · Paper page
  39. Lund, B. D., & Wang, T. (2023). Chatting about ChatGPT: How may AI and GPT impact academia and libraries? Library Hi Tech News, ahead-of-print(ahead-of-print). https://doi.org/10.1108/LHTN-01-2023-0009 · DOI · Paper page
  40. Luo, B., Lau, R. Y. K., Li, C., & Si, Y.-W. (2022). A critical review of state-of-the-art chatbot designs and applications. WIREs Data Mining and Knowledge Discovery, 12(1), e1434. https://doi.org/10.1002/widm.1434 · DOI
  41. Mbakwe, A. B., Lourentzou, I., Celi, L. A., Mechanic, O. J., & Dagan, A. (2023). ChatGPT passing USMLE shines a spotlight on the flaws of medical education. PLOS Digital Health, 2(2), e0000205. https://doi.org/10.1371/journal.pdig.0000205 · DOI · Paper page
  42. Mhlanga, D. (2023). Open AI in Education, the Responsible and Ethical Use of ChatGPT Towards Lifelong Learning (SSRN Scholarly Paper No. 4354422). https://doi.org/10.2139/ssrn.4354422 · DOI · Paper page
  43. Pardos, Z. A., & Bhandari, S. (2023). Learning gain differences between ChatGPT and human tutor generated algebra hints (arXiv:2302.06871). arXiv. https://doi.org/10.48550/arXiv.2302.06871 · DOI · Paper page
  44. Park, S. H. (2023). Authorship Policy of the Korean Journal of Radiology Regarding Artificial Intelligence Large Language Models Such as ChatGTP. Korean Journal of Radiology, 24(3), 171-172. https://doi.org/10.3348/kjr.2023.0112 · DOI
  45. Pinar Saygin, A., Cicekli, I., & Akman, V. (2000). Turing Test: 50 Years Later. Minds and Machines, 10(4), 463-518. https://doi.org/10.1023/A:1011288000451 · DOI · Paper page
  46. Polesie, S., & Larkö , O. (2023). Use of Large Language Models: Editorial Comments. Acta Dermato-Venereologica, 103, adv00874. https://doi.org/10.2340/actadv.v103.9593 · DOI
  47. Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., Sutskever, I., & others. (2019). Language models are unsupervised multitask learners. OpenAI Blog, 1(8), 9.
  48. Rahman, A. M., Mamun, A. A., & Islam, A. (2017). Programming challenges of chatbot: Current and future prospective. 2017 IEEE Region 10 Humanitarian Technology Conference (R10-HTC), 75-78. https://doi.org/10.1109/R10HTC.2017.8288910 · DOI
  49. Ranoliya, B. R., Raghuwanshi, N., & Singh, S. (2017). Chatbot for university related FAQs. 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI), 1525-1530. https://doi.org/10.1109/ICACCI.2017.8126057 · DOI · Paper page
  50. Rao, A., Kim, J., Kamineni, M., Pang, M., Lie, W., & Succi, M. D. (2023). Evaluating ChatGPT as an Adjunct for Radiologic Decision-Making (p. 2023.02.02.23285399). medRxiv. https://doi.org/10.1101/2023.02.02.23285399 · DOI · Paper page
  51. Rudolph, J., Tan, S., & Tan, S. (2023). ChatGPT: Bullshit spewer or the end of traditional assessments in higher education? Journal of Applied Learning and Teaching, 6(1), Article 1. https://doi.org/10.37074/jalt.2023.6.1.9 · DOI · Paper page
  52. Sallam, M., Salim, N. A., Al-Tammemi, A. B., Barakat, M., Fayyad, D., Hallit, S., Harapan, H., Hallit, R., & Mahafzah, A. (2023). ChatGPT Output Regarding Compulsory Vaccination and COVID-19 Vaccine Conspiracy: A Descriptive Study at the Outset of a Paradigm Shift in Online Search for Information. Cureus, 15(2), e35029. https://doi.org/10.7759/cureus.35029 · DOI · Paper page
  53. Shahriar, S., Ramesh, J., Towheed, M., Ameen, T., Sagahyroon, A., & Al-Ali, A. R. (2022). Narrative Integrated Career Exploration Platform. Frontiers in Education, 7. https://www.frontiersin.org/articles/10.3389/feduc.2022.798950 · DOI
  54. Shen, Y., Heacock, L., Elias, J., Hentel, K. D., Reig, B., Shih, G., & Moy, L. (2023). ChatGPT and Other Large Language Models Are Double-edged Swords. Radiology, 230163. https://doi.org/10.1148/radiol.230163 · DOI · Paper page
  55. Stokel-Walker, C. (2023). ChatGPT listed as author on research papers: Many scientists disapprove. Nature, 613(7945), 620-621. https://doi.org/10.1038/d41586-023-00107-z · DOI · Paper page
  56. Stokel-Walker, C., & Van Noorden, R. (2023). What ChatGPT and generative AI mean for science. Nature, 614(7947), 214-216. https://doi.org/10.1038/d41586-023-00340-6 · DOI · Paper page
  57. Susnjak, T. (2022). ChatGPT: The End of Online Exam Integrity? (arXiv:2212.09292). arXiv. https://doi.org/10.48550/arXiv.2212.09292 · DOI · Paper page
  58. Tang, G. (2023). Letter to editor: Academic journals should clarify the proportion of NLP-generated content in papers. Accountability in Research, 0(0), 1-2. https://doi.org/10.1080/08989621.2023.2180359 · DOI
  59. Thornton, J., D'Souza, R., & Tandon, R. (2023). Artificial intelligence and psychiatry research and practice. Asian Journal of Psychiatry, 103509. https://doi.org/10.1016/j.ajp.2023.103509 · DOI
  60. Thorp, H. H. (2023). ChatGPT is fun, but not an author. Science, 379(6630), 313-313. https://doi.org/10.1126/science.adg7879 · DOI · Paper page
  61. TURING, A. M. (1950). I.-COMPUTING MACHINERY AND INTELLIGENCE. Mind, LIX(236), 433-460. https://doi.org/10.1093/mind/LIX.236.433 · DOI · Paper page
  62. Uludag, K. (2023). Testing Creativity of ChatGPT in Psychology: Interview with ChatGPT (SSRN Scholarly Paper No. 4390872). https://doi.org/10.2139/ssrn.4390872 · DOI
  63. Wang, X., Gong, Z., Wang, G., Jia, J., Xu, Y., Zhao, J., Fan, Q., Wu, S., Hu, W., & Li, X. (2023). ChatGPT Performs on the Chinese National Medical Licensing Examinatio. https://doi.org/10.21203/rs.3.rs-2584079/v1 Weizenbaum, J. (1966). ELIZA-a computer program for the study of natural language communication between man and machine. Communications of the ACM, 9(1), 36-45. Yang, X., Li, Y., Zhang, X., Chen, H., & Cheng, W. (2023). Exploring the Limits of ChatGPT for Query or Aspect-based Text Summarization (arXiv:2302.08081). arXiv. https://doi.org/10.48550/arXiv.2302.08081 Zhou, L., Gao, J., Li, D., & Shum, H.-Y. (2020). The Design and Implementation of XiaoIce, an Empathetic Social Chatbot. Computational Linguistics, 46(1), 53-93. https://doi.org/10.1162/coli\_a\_00368 Zhu, Y., Han, D., Chen, S., Zeng, F., & Wang, C. (2023). How Can ChatGPT Benefit Pharmacy: A Case Report on Review Writing (No. 2023020324). Preprints. https://doi.org/10.20944/preprints202302.0324.v1 Zhuo, T. Y., Huang, Y., Chen, C., & Xing, Z. (2023). Exploring AI Ethics of ChatGPT: A Diagnostic Analysis · DOI

Authors
Shahriar, S., & Hayawi, K.
Affiliations
  • University of Guelph (CA)
  • Zayed University (AE)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2023
Volume
2
Issue
1
Pages
11-20
ISSN
2811-0854 (ISSN-L)
DOI
10.48550/arxiv.2302.13817
arXiv
2302.13817
OpenAlex
W4379410101
Cited by
167
References
69
Citations by year
2026: 8 · 2025: 29 · 2024: 69 · 2023: 61
FWCI
15.72
Type
journal article
Language
en
Open access
Licence
Locations
  • Artificial Intelligence and Applications (publishedVersion, cc-by)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
Keywords
ChatGPT, large language models, chatbots, generative AI, history of chatbots, medical applications, educational software, research applications, ethical considerations, privacy concerns, AI limitations, AI self-assessment

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review