CoChat
Sign Up
PreprintCited by 15

Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Models

Liu, Yiheng, Han, Tianle, Ma, Siyuan, Zhang, Jiayue, Yang, Yuanyuan, Tian, Jiaming, He, Hao, Li, Antong +10 more·2023·arXiv
DOI 10.48550/arxiv.2304.01852arXiv 2304.01852
Open this paper in CoChat — free account

Abstract

This paper presents a comprehensive survey of ChatGPT-related (GPT-3.5 and GPT-4) research, state-of-the-art large language models (LLM) from the GPT series, and their prospective applications across diverse domains. Indeed, key innovations such as large-scale pre-training that captures knowledge across the entire world wide web, instruction fine-tuning and Reinforcement Learning from Human Feedback (RLHF) have played significant roles in enhancing LLMs' adaptability and performance. We performed an in-depth analysis of 194 relevant papers on arXiv, encompassing trend analysis, word cloud representation, and distribution analysis across various application domains. The findings reveal a significant and increasing interest in ChatGPT-related research, predominantly centered on direct natural language processing applications, while also demonstrating considerable potential in areas ranging from education and history to mathematics, medicine, and physics. This study endeavors to furnish insights into ChatGPT's capabilities, potential implications, ethical concerns, and offer direction for future advancements in this field.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2304.01852

Cites

5 of 5 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • LLMs have limitations in incorporating real-time or dynamic information, making them less suitable for tasks requiring up-to-date knowledge or rapid adaptation.

    “LLMs have limitations in incorporating real-time or dynamic information [127], making them less suitable for tasks that require up-to-date knowledge or rapid adaptation to changing contexts.”

    From A Survey on Evaluation of Large Language Models (2024) · cites this paper as [127]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 99

  1. Ahmad, A., Waseem, M., Liang, P., Fehmideh, M., Aktar, M.S., Mikkonen, T.: Towards human-bot collaborative software architecting with chatgpt. arXiv preprint arXiv:2302.14600 (2023) · arXiv
  2. Amin, M.M., Cambria, E., Schuller, B.W.: Will affective computing emerge from foundation models and general ai? a first evaluation on chatgpt. arXiv preprint arXiv:2303.03186 (2023) · arXiv
  3. Basic, Z., Banovac, A., Kruzic, I., Jerkovic, I.: Better by you, better than me, chatgpt3 as writing assistance in students essays. arXiv preprint arXiv:2302.04536 (2023) · arXiv
  4. Belouadi, J., Eger, S.: Bygpt5: End-to-end style-conditioned poetry generation with token-free language models. arXiv preprint arXiv:2212.10474 (2022) · arXiv
  5. Blanco-Gonzalez, A., Cabezon, A., Seco-Gonzalez, A., Conde-Torres, D., Antelo-Riveiro, P., Pineiro, A., Garcia-Fandino, R.: The role of ai in drug discovery: Challenges, opportunities, and strategies. arXiv preprint arXiv:2212.08104 (2022) · arXiv
  6. Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J.D., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al.: Language models are few-shot learners. Advances in neural information processing systems 33, 1877-1901 (2020)
  7. Chen, N., Wang, Y., Jiang, H., Cai, D., Chen, Z., Li, J.: What would harry say? building dialogue agents for characters in a story. arXiv preprint arXiv:2211.06869 (2022) · arXiv
  8. Chen, Y., Eger, S.: Transformers go for the lols: Generating (humourous) titles from scientific abstracts end-to-end. arXiv preprint arXiv:2212.10522 (2022) · arXiv
  9. Christiano, P.F., Leike, J., Brown, T., Martic, M., Legg, S., Amodei, D.: Deep reinforcement learning from human preferences. Advances in neural information processing systems 30 (2017)
  10. Dai, H., Li, Y., Liu, Z., Zhao, L., Wu, Z., Song, S., Shen, Y., Zhu, D., Li, X., Li, S., et al.: Ad-autogpt: An autonomous gpt for alzheimer's disease infodemiology. arXiv preprint arXiv:2306.10095 (2023) · arXiv
  11. Dai, H., Liu, Z., Liao, W., Huang, X., Wu, Z., Zhao, L., Liu, W., Liu, N., Li, S., Zhu, D., et al.: Chataug: Leveraging chatgpt for text data augmentation. arXiv preprint arXiv:2302.13007 (2023) · arXiv
  12. Du, X., Cardie, C.: Event extraction by answering (almost) natural questions. arXiv preprint arXiv:2004.13625 (2020) · arXiv
  13. Freitag, M., Rei, R., Mathur, N., Lo, C.k., Stewart, C., Avramidis, E., Kocmi, T., Foster, G., Lavie, A., Martins, A.F.: Results of wmt22 metrics shared task: Stop using bleu-neural metrics are better and more robust. In: Proceedings of the Seventh Conference on Machine Translation (WMT). pp. 46-68 (2022)
  14. Freitag, M., Rei, R., Mathur, N., Lo, C.k., Stewart, C., Avramidis, E., Kocmi, T., Foster, G., Lavie, A., Martins, A.F.: Results of wmt22 metrics shared task: Stop using bleu-neural metrics are better and more robust. In: Proceedings of the Seventh Conference on Machine Translation (WMT). pp. 46-68 (2022)
  15. Frieder, S., Pinchetti, L., Griffiths, R.R., Salvatori, T., Lukasiewicz, T., Petersen, P.C., Chevalier, A., Berner, J.: Mathematical capabilities of chatgpt. arXiv preprint arXiv:2301.13867 (2023) · arXiv
  16. Fu, Q., Teng, Z., Georgaklis, M., White, J., Schmidt, D.C.: Nl2cmd: An updated workflow for natural language to bash commands translation. arXiv preprint arXiv:2302.07845 (2023) · arXiv
  17. Gao, J., Zhao, H., Yu, C., Xu, R.: Exploring the feasibility of chatgpt for event extraction. arXiv preprint arXiv:2303.03836 (2023) · arXiv
  18. Glymour, C., Zhang, K., Spirtes, P.: Review of causal discovery methods based on graphical models. Frontiers in Genetics (2019)
  19. Gormley, M.R., Yu, M., Dredze, M.: Improved relation extraction with feature-rich compositional embedding models. arXiv preprint arXiv:1505.02419 (2015) · arXiv
  20. Guo, S., Wang, Y., Li, S., Saeed, N.: Semantic communications with ordered importance using chatgpt. arXiv preprint arXiv:2302.07142 (2023) · arXiv
  21. Hacker, P.: The european ai liability directives-critique of a half-hearted approach and lessons for the future. arXiv preprint arXiv:2211.13960 (2022) · arXiv
  22. Haque, M.U., Dharmadasa, I., Sworna, Z.T., Rajapakse, R.N., Ahmad, H.: " i think this is the most disruptive technology": Exploring sentiments of chatgpt early adopters using twitter data. arXiv preprint arXiv:2212.05856 (2022) · arXiv
  23. Hartmann, J., Schwenzow, J., Witte, M.: The political ideology of conversational ai: Converging evidence on chatgpt's pro-environmental, left-libertarian orientation. arXiv preprint arXiv:2301.01768 (2023) · arXiv
  24. He, J., Wang, L., Hu, Y., Liu, N., Liu, H., Xu, X., Shen, H.T.: Icl-d3ie: In-context learning with diverse demonstrations updating for document information extraction. arXiv preprint arXiv:2303.05063 (2023) · arXiv
  25. Hermann, K.M., Kocisky, T., Grefenstette, E., Espeholt, L., Kay, W., Suleyman, M., Blunsom, P.: Teaching machines to read and comprehend. Advances in neural information processing systems 28 (2015)
  26. Hoffmann, R., Zhang, C., Ling, X., Zettlemoyer, L., Weld, D.S.: Knowledge-based weak supervision for information extraction of overlapping relations. In: Proceedings of the 49th annual meeting of the association for computational linguistics: human language technologies. pp. 541-550 (2011)
  27. Hu, M., Pan, S., Li, Y., Yang, X.: Advancing medical imaging with language models: A journey from n-grams to chatgpt. arXiv preprint arXiv:2304.04920 (2023) · arXiv
  28. Huang, F., Kwak, H., An, J.: Is chatgpt better than human annotators? potential and limitations of chatgpt in explaining implicit hate speech. arXiv preprint arXiv:2302.07736 (2023) · arXiv
  29. Huang, L.K., Huang, J., Rong, Y., Yang, Q., Wei, Y.: Frustratingly easy transferability estimation pp. 9201-9225 (2022)
  30. Huang, Z., Chen, K., He, J., Bai, X., Karatzas, D., Lu, S., Jawahar, C.: Icdar2019 competition on scanned receipt ocr and information extraction. In: 2019 International Conference on Document Analysis and Recognition (ICDAR). pp. 1516-1520. IEEE (2019)
  31. Jaume, G., Ekenel, H.K., Thiran, J.P.: Funsd: A dataset for form understanding in noisy scanned documents. In: 2019 International Conference on Document Analysis and Recognition Workshops (ICDARW). vol. 2, pp. 1-6. IEEE (2019)
  32. Jeblick, K., Schachtner, B., Dexl, J., Mittermeier, A., Stüber, A.T., Topalis, J., Weber, T., Wesp, P., Sabel, B., Ricke, J., et al.: Chatgpt makes medicine easy to swallow: An exploratory case study on simplified radiology reports. arXiv preprint arXiv:2212.14882 (2022) · arXiv
  33. Khalil, M., Er, E.: Will chatgpt get you caught? rethinking of plagiarism detection. arXiv preprint arXiv:2302.04335 (2023) · arXiv
  34. Kirk, H.R., Vidgen, B., Röttger, P., Hale, S.A.: Personalisation within bounds: A risk taxonomy and policy framework for the alignment of large language models with personalised feedback. arXiv preprint arXiv:2303.05453 (2023) · arXiv
  35. Kocmi, T., Federmann, C.: Large language models are state-of-the-art evaluators of translation quality. arXiv preprint arXiv:2302.14520 (2023) · arXiv
  36. Kocmi, T., Federmann, C., Grundkiewicz, R., Junczys-Dowmunt, M., Matsushita, H., Menezes, A.: To ship or not to ship: An extensive evaluation of automatic metrics for machine translation. arXiv preprint arXiv:2107.10821 (2021) · arXiv
  37. Kortemeyer, G.: Could an artificial-intelligence agent pass an introductory physics course? arXiv preprint arXiv:2301.12127 (2023) · arXiv
  38. Krügel, S., Ostermaier, A., Uhl, M.: The moral authority of chatgpt. arXiv preprint arXiv:2301.07098 (2023) · arXiv
  39. Kuzman, T., Mozetic, I., Ljubešic, N.: Chatgpt: Beginning of an end of manual linguistic data annotation? use case of automatic genre identification. arXiv e-prints pp. arXiv-2303 (2023)
  40. Lanzi, P.L., Loiacono, D.: Chatgpt and other large language models as evolutionary engines for online interactive collaborative game design. arXiv preprint arXiv:2303.02155 (2023) · arXiv
  41. Lehnert, K.: Ai insights into theoretical physics and the swampland program: A journey through the cosmos with chatgpt. arXiv preprint arXiv:2301.08155 (2023) · arXiv
  42. Levow, G.A.: The third international chinese language processing bakeoff: Word segmentation and named entity recognition. In: Proceedings of the Fifth SIGHAN workshop on Chinese language processing. pp. 108-117 (2006)
  43. Li, S., He, W., Shi, Y., Jiang, W., Liang, H., Jiang, Y., Zhang, Y., Lyu, Y., Zhu, Y.: Duie: A large-scale chinese dataset for information extraction. In: Natural Language Processing and Chinese Computing: 8th CCF International Conference, NLPCC 2019, Dunhuang, China, October 9-14, 2019, Proceedings, Part II 8. pp. 791-800. Springer (2019)
  44. Li, X., Li, F., Pan, L., Chen, Y., Peng, W., Wang, Q., Lyu, Y., Zhu, Y.: Duee: a large-scale dataset for chinese event extraction in real-world scenarios. In: Natural Language Processing and Chinese Computing: 9th CCF International Conference, NLPCC 2020, Zhengzhou, China, October 14-18, 2020, Proceedings, Part II 9. pp. 534-545. Springer (2020)
  45. Liao, W., Liu, Z., Dai, H., Xu, S., Wu, Z., Zhang, Y., Huang, X., Zhu, D., Cai, H., Liu, T., et al.: Differentiate chatgpt-generated and human- written medical texts. arXiv preprint arXiv:2304.11567 (2023) · arXiv
  46. Liu, C., Han, Y., Jiang, R., Yuan, X.: Advisor: Automatic visualization answer for natural-language question on tabular data. In: 2021 IEEE 14th Pacific Visualization Symposium (PacificVis). pp. 11-20. IEEE (2021)
  47. Liu, D., Chen, Y., Wu, Z.: Digital twin (dt)-cyclegan: Enabling zero-shot sim-to-real transfer of visual grasping models. IEEE Robotics and Automation Letters (2023)
  48. Liu, Z., Yu, X., Zhang, L., Wu, Z., Cao, C., Dai, H., Zhao, L., Liu, W., Shen, D., Li, Q., et al.: Deid-gpt: Zero-shot medical text de-identification by gpt-4. arXiv preprint arXiv:2303.11032 (2023) · arXiv
  49. Liu, Z., Zhong, A., Li, Y., Yang, L., Ju, C., Wu, Z., Ma, C., Shu, P., Chen, C., Kim, S., et al.: Radiology-gpt: A large language model for radiology. arXiv preprint arXiv:2306.08666 (2023) · arXiv
  50. Lu, Y., Lin, H., Xu, J., Han, X., Tang, J., Li, A., Sun, L., Liao, M., Chen, S.: Text2event: Controllable sequence-to-structure generation for end-to-end event extraction. arXiv preprint arXiv:2106.09232 (2021) · arXiv
  51. Luan, L., Lin, X., Li, W.: Exploring the cognitive dynamics of artificial intelligence in the post-covid-19 and learning 3.0 era: A case study of chatgpt. arXiv preprint arXiv:2302.04818 (2023) · arXiv
  52. Luo, Y., Tang, J., Li, G.: nvbench: A large-scale synthesized dataset for cross-domain natural language to visualization task. arXiv preprint arXiv:2112.12926 (2021) · arXiv
  53. Ma, C., Wu, Z., Wang, J., Xu, S., Wei, Y., Liu, Z., Guo, L., Cai, X., Zhang, S., Zhang, T., et al.: Impressiongpt: an iterative optimizing framework for radiology report summarization with chatgpt. arXiv preprint arXiv:2304.08448 (2023) · arXiv
  54. Maddigan, P., Susnjak, T.: Chat2vis: Generating data visualisations via natural language using chatgpt, codex and gpt-3 large language models. arXiv preprint arXiv:2302.02094 (2023) · arXiv
  55. McKee, F., Noever, D.: Chatbots in a botnet world. arXiv preprint arXiv:2212.11126 (2022) · arXiv
  56. McKee, F., Noever, D.: Chatbots in a honeypot world. arXiv preprint arXiv:2301.03771 (2023) · arXiv
  57. Megahed, F.M., Chen, Y.J., Ferris, J.A., Knoth, S., Jones-Farmer, L.A.: How generative ai models such as chatgpt can be (mis) used in spc practice, education, and research? an exploratory study. arXiv preprint arXiv:2302.10916 (2023) · arXiv
  58. Michail, A., Konstantinou, S., Clematide, S.: Uzh_clyp at semeval-2023 task 9: Head-first fine-tuning and chatgpt data generation for cross- lingual learning in tweet intimacy prediction. arXiv preprint arXiv:2303.01194 (2023) · arXiv
  59. Mukaka, M.M.: A guide to appropriate use of correlation coefficient in medical research. Malawi medical journal 24(3), 69-71 (2012)
  60. Narechania, A., Srinivasan, A., Stasko, J.: Nl4dv: A toolkit for generating analytic specifications for data visualization from natural language queries. IEEE Transactions on Visualization and Computer Graphics 27(2), 369-379 (2020)
  61. Noever, D., Ciolino, M.: The turing deception. arXiv preprint arXiv:2212.06721 (2022) · arXiv
  62. Noever, D., McKee, F.: Numeracy from literacy: Data science as an emergent skill from large language models. arXiv preprint arXiv:2301.13382 (2023) · arXiv
  63. Nov, O., Singh, N., Mann, D.M.: Putting chatgpt's medical advice to the (turing) test. medRxiv (2023)
  64. Ortega-Martín, M., García-Sierra, Ó., Ardoiz, A., Álvarez, J., Armenteros, J.C., Alonso, A.: Linguistic ambiguity analysis in chatgpt. arXiv preprint arXiv:2302.06426 (2023) · arXiv
  65. Pardos, Z.A., Bhandari, S.: Learning gain differences between chatgpt and human tutor generated algebra hints. arXiv preprint arXiv:2302.06871 (2023) · arXiv
  66. Park, S., Shin, S., Lee, B., Lee, J., Surh, J., Seo, M., Lee, H.: Cord: a consolidated receipt dataset for post-ocr parsing. In: Workshop on Document Intelligence at NeurIPS 2019 (2019)
  67. Polak, M.P., Morgan, D.: Extracting accurate materials data from research papers with conversational language models and prompt engineering-example of chatgpt. arXiv preprint arXiv:2303.05352 (2023) · arXiv
  68. Prieto, S.A., Mengiste, E.T., de Soto, B.G.: Investigating the use of ChatGPT for the scheduling of construction projects. Buildings 13(4), 857 (mar 2023). https://doi.org/10.3390/buildings13040857, https://doi.org/10.3390%2Fbuildings13040857 · DOI · Paper page
  69. Qin, C., Zhang, A., Zhang, Z., Chen, J., Yasunaga, M., Yang, D.: Is chatgpt a general-purpose natural language processing task solver? arXiv preprint arXiv:2302.06476 (2023) · arXiv
  70. Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., Sutskever, I., et al.: Language models are unsupervised multitask learners. OpenAI blog 1(8), 9 (2019)
  71. Shakarian, P., Koyyalamudi, A., Ngu, N., Mareedu, L.: An independent evaluation of chatgpt on mathematical word problems (mwp). arXiv preprint arXiv:2302.13814 (2023) · arXiv
  72. Sobania, D., Briesch, M., Hanna, C., Petke, J.: An analysis of the automatic bug fixing performance of chatgpt. arXiv preprint arXiv:2301.08653 (2023) · arXiv
  73. Subhash, V.: Can large language models change user preference adversarially? arXiv preprint arXiv:2302.10291 (2023) · arXiv
  74. Susnjak, T.: Chatgpt: The end of online exam integrity? arXiv preprint arXiv:2212.09292 (2022) · arXiv
  75. Susnjak, T.: Applying bert and chatgpt for sentiment analysis of lyme disease in scientific literature. arXiv preprint arXiv:2302.06474 (2023) · arXiv
  76. Takanobu, R., Zhang, T., Liu, J., Huang, M.: A hierarchical framework for relation extraction with reinforcement learning. In: Proceedings of the AAAI conference on artificial intelligence. vol. 33, pp. 7072-7079 (2019)
  77. Tang, R., Han, X., Jiang, X., Hu, X.: Does synthetic data generation of llms help clinical text mining? arXiv preprint arXiv:2303.04360 (2023) · arXiv
  78. Tang, Z., Kejriwal, M.: A pilot evaluation of chatgpt and dall-e 2 on decision making and spatial reasoning. arXiv preprint arXiv:2302.09068 (2023) · arXiv
  79. Treude, C.: Navigating complexity in software engineering: A prototype for comparing gpt-n solutions. arXiv preprint arXiv:2301.12169 (2023) · arXiv
  80. Tu, R., Ma, C., Zhang, C.: Causal-discovery performance of chatgpt in the context of neuropathic pain diagnosis. arXiv preprint arXiv:2301.13819 (2023) · arXiv
  81. Wang, J., Liang, Y., Meng, F., Li, Z., Qu, J., Zhou, J.: Cross-lingual summarization via chatgpt. arXiv preprint arXiv:2302.14229 (2023) · arXiv
  82. Wang, J., Liang, Y., Meng, F., Shi, H., Li, Z., Xu, J., Qu, J., Zhou, J.: Is chatgpt a good nlg evaluator? a preliminary study. arXiv preprint arXiv:2303.04048 (2023) · arXiv
  83. Wang, S., Zhao, Z., Ouyang, X., Wang, Q., Shen, D.: Chatcad: Interactive computer-aided diagnosis on medical image using large language models. arXiv preprint arXiv:2302.07257 (2023) · arXiv
  84. Wang, S., Scells, H., Koopman, B., Zuccon, G.: Can chatgpt write a good boolean query for systematic review literature search? arXiv preprint arXiv:2302.03495 (2023) · arXiv
  85. Wang, Z., Shang, J., Liu, L., Lu, L., Liu, J., Han, J.: Crossweigh: Training named entity tagger from imperfect annotations. arXiv preprint arXiv:1909.01441 (2019) · arXiv
  86. Wei, X., Cui, X., Cheng, N., Wang, X., Zhang, X., Huang, S., Xie, P., Xu, J., Chen, Y., Zhang, M., et al.: Zero-shot information extraction via chatting with chatgpt. arXiv preprint arXiv:2302.10205 (2023) · arXiv
  87. West, C.G.: Ai and the fci: Can chatgpt project an understanding of introductory physics? arXiv preprint arXiv:2303.01067 (2023) · arXiv
  88. White, J., Fu, Q., Hays, S., Sandborn, M., Olea, C., Gilbert, H., Elnashar, A., Spencer-Smith, J., Schmidt, D.C.: A prompt pattern catalog to enhance prompt engineering with chatgpt. arXiv preprint arXiv:2302.11382 (2023) · arXiv
  89. Wu, C., Yin, S., Qi, W., Wang, X., Tang, Z., Duan, N.: Visual chatgpt: Talking, drawing and editing with visual foundation models. arXiv preprint arXiv:2303.04671 (2023) · arXiv
  90. Xia, C.S., Zhang, L.: Conversational automated program repair. arXiv preprint arXiv:2301.13246 (2023) · arXiv
  91. Yang, X., Li, Y., Zhang, X., Chen, H., Cheng, W.: Exploring the limits of chatgpt for query or aspect-based text summarization. arXiv preprint arXiv:2302.08081 (2023) · arXiv
  92. Yeadon, W., Inyang, O.O., Mizouri, A., Peach, A., Testrow, C.: The death of the short-form physics essay in the coming ai revolution. arXiv preprint arXiv:2212.11661 (2022) · arXiv
  93. Zhang, B., Ding, D., Jing, L.: How would stance detection techniques evolve after the launch of chatgpt? arXiv preprint arXiv:2212.14548 (2022) · arXiv
  94. Zhang, X., Chowdhury, R.R., Hong, D., Gupta, R.K., Shang, J.: Modeling label semantics improves activity recognition. arXiv preprint arXiv:2301.03462 (2023) · arXiv
  95. Zhao, L., Zhang, L., Wu, Z., Chen, Y., Dai, H., Yu, X., Liu, Z., Zhang, T., Hu, X., Jiang, X., et al.: When brain-inspired ai meets agi. arXiv preprint arXiv:2303.15935 (2023) · arXiv
  96. Zheng, O., Abdel-Aty, M., Wang, D., Wang, Z., Ding, S.: Chatgpt is on the horizon: Could a large language model be all we need for intelligent transportation? arXiv preprint arXiv:2303.05382 (2023) · arXiv
  97. Zhong, Q., Ding, L., Liu, J., Du, B., Tao, D.: Can chatgpt understand too? a comparative study on chatgpt and fine-tuned bert. arXiv preprint arXiv:2302.10198 (2023) · arXiv
  98. Zhou, C., Qiu, C., Acuna, D.E.: Paraphrase identification with deep learning: A review of datasets and methods. arXiv preprint arXiv:2212.06933 (2022) · arXiv
  99. Zhuo, T.Y., Huang, Y., Chen, C., Xing, Z.: Exploring ai ethics of chatgpt: A diagnostic analysis. arXiv preprint arXiv:2301.12867 (2023) · arXiv

Cited by

Sorted by citations

Authors
Liu, Y., Han, T., Ma, S., Zhang, J., Yang, Y., Tian, J., He, H., Li, A., He, M., Liu, Z., Wu, Z., Zhao, L., Zhu, D., Li, X., Qiang, N., Shen, D., Liu, T., & Ge, B.
Venue
arXiv
Publisher
arXiv
Published
2023
DOI
10.48550/arxiv.2304.01852
arXiv
2304.01852
References
5
Type
Preprint
Licence
creativecommons.org/licenses/by/4.0/legalcode

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review