The DOI matches its Crossref record; 161 of the 161 references it cites were found in a registry or an index.
GPT (Generative Pre-Trained Transformer)— A Comprehensive Review on Enabling Technologies, Potential Applications, Emerging Challenges, and Future Directions
Open accessAbstract
The Generative Pre-trained Transformer (GPT) represents a notable breakthrough in the domain of natural language processing, which is propelling us toward the development of machines that can understand and communicate using language in a manner that closely resembles that of humans. GPT is based on the transformer architecture, a deep neural network designed for natural language processing tasks. Due to their impressive performance on natural language processing tasks and ability to effectively converse, GPT have gained significant popularity among researchers and industrial communities, making them one of the most widely used and effective models in natural language processing and related fields, which motivated to conduct this review. This review provides a detailed overview of the GPT, including its architecture, working process, training procedures, enabling technologies, and its impact on various applications. In this review, we also explored the potential challenges and limitations of a GPT. Furthermore, we discuss potential solutions and future directions. Overall, this paper aims to provide a comprehensive understanding of GPT, its enabling technologies, their impact on various applications, emerging challenges, and potential solutions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Zhang, J., Pu, J., Xue, J., Yang, M. Z., Xu, X., Wang, X., & Wang, F. (2023) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2023.3256982 · Cited by 78
RetractedExploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
ChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · doi:10.35542/osf.io/5er8f · Cited by 7,552
ChatGPT for good? On opportunities and challenges of large language models for education
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102274 · Cited by 7,326
Deep Learning with Differential Privacy
Abadi, M., Chu, A., Goodfellow, I., McMahan, H. B., Mironov, I., Talwar, K., & Zhang, L. (2016) · Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2976749.2978318 · Cited by 6,578
A Survey on Bias and Fairness in Machine Learning
Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., & Galstyan, A. (2022) · ACM Computing Surveys · doi:10.1145/3457607 · Cited by 5,812
Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., Baabdullah, A. M., Koohang, A., Raghavan, V., Ahuja, M., et al. (2023) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2023.102642 · Cited by 4,584
BAİDOO-ANU, D., & OWUSU ANSAH, L. (2023) · Journal of AI · doi:10.61969/jai.1337500 · Cited by 3,939
Applications of machine learning in drug discovery and development
Vamathevan, J., Clark, D., Czodrowski, P., Dunham, I., Ferran, E., Lee, G., Li, B., Madabhushi, A., Shah, P., Spitzer, M., et al. (2019) · Nature Reviews Drug Discovery · doi:10.1038/s41573-019-0024-5 · Cited by 3,228
Baidoo-Anu, D., & Owusu Ansah, L. (2023) · doi:10.2139/ssrn.4337484 · Cited by 3,004 · cited 2×
“GPT models generally rely on statistical patterns in the data and provide answers, but they are unable to give students a full comprehension of the concepts they are learning [87].”
BackgroundOn the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676
Self-citationGPT-3: Its Nature, Scope, Limits, and Consequences
Floridi, L., & Chiriatti, M. (2020) · Minds and Machines · doi:10.1007/s11023-020-09548-1 · Cited by 2,519
Ray, P. P. (2023) · Internet of Things and Cyber-Physical Systems · doi:10.1016/j.iotcps.2023.04.003 · Cited by 2,463 · cited 1×
“GPTs can support the identification of potentially fraudulent actions by examining past transaction data, user behaviour patterns, and recognized fraudulent tendencies [140].”
BackgroundGPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Models
Eloundou, T., Manning, S., Mishkin, P., & Rock, D. (2023) · arXiv · doi:10.48550/arxiv.2303.10130 · Cited by 2,330
The rise of deep learning in drug discovery
Chen, H., Engkvist, O., Wang, Y., Olivecrona, M., & Blaschke, T. (2018) · Drug Discovery Today · doi:10.1016/j.drudis.2018.01.039 · Cited by 1,770
Pre-trained models for natural language processing: A survey
Qiu, X., Sun, T., Xu, Y., Shao, Y., Dai, N., & Huang, X. (2020) · Science China Technological Sciences · doi:10.1007/s11431-020-1647-3 · Cited by 1,591 · cited 2×
“Qiu et al. [6] presented an exhaustive survey of various types of GPT models by detailing their working architecture.”
BackgroundGenerating Focused Molecule Libraries for Drug Discovery with Recurrent Neural Networks
Segler, M. H. S., Kogej, T., Tyrchan, C., & Waller, M. P. (2018) · ACS Central Science · doi:10.1021/acscentsci.7b00512 · Cited by 1,537
Sparks of Artificial General Intelligence: Early experiments with GPT-4
Bubeck, S., Chandrasekaran, V., Eldan, R., Gehrke, J., Horvitz, E., Kamar, E., Lee, P., Lee, Y. T., Li, Y., Lundberg, S., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.12712 · Cited by 1,526
ChatGPT is fun, but not an author
Thorp, H. H. (2023) · Science · doi:10.1126/science.adg7879 · Cited by 1,437
Chatting about ChatGPT: how may AI and GPT impact academia and libraries?
Lund, B. D., & Wang, T. (2023) · Library Hi Tech News · doi:10.1108/lhtn-01-2023-0009 · Cited by 1,355
Speech-Transformer: A No-Recurrence Sequence-to-Sequence Model for Speech Recognition
Dong, L., Xu, S., & Xu, B. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8462506 · Cited by 1,100
Pre-trained models: Past, present and future
Han, X., Zhang, Z., Ding, N., Gu, Y., Liu, X., Huo, Y., Qiu, J., Yao, Y., Zhang, A., Zhang, L., et al. (2021) · AI Open · doi:10.1016/j.aiopen.2021.08.002 · Cited by 994
Bryant, J. (2013) · Routledge eBooks · doi:10.4324/9780203873694 · Cited by 992
Lund, B. D., Wang, T., Mannuru, N. R., Nie, B., Shimray, S., & Wang, Z. (2023) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24750 · Cited by 919
Liu, X., Zheng, Y., Du, Z., Ding, M., Qian, Y., Yang, Z., & Tang, J. (2021) · arXiv · doi:10.48550/arxiv.2103.10385 · Cited by 908
A Survey on the Role of IoT in Agriculture for the Implementation of Smart Farming
Farooq, M. S., Riaz, S., Abid, A., Abid, K., & Naeem, M. A. (2019) · IEEE Access · doi:10.1109/access.2019.2949703 · Cited by 896
Summary of ChatGPT-Related research and perspective towards the future of large language models
Liu, Y., Han, T., Ma, S., Zhang, J., Yang, Y., Tian, J., He, H., Li, A., He, M., Liu, Z., et al. (2023) · Meta-Radiology · doi:10.1016/j.metrad.2023.100017 · Cited by 855
Pesapane, F., Codari, M., & Sardanelli, F. (2018) · European Radiology Experimental · doi:10.1186/s41747-018-0061-6 · Cited by 833
Zheng, T., Ardolino, M., Bacchetti, A., & Perona, M. (2021) · International Journal of Production Research · doi:10.1080/00207543.2020.1824085 · Cited by 728
Deep Learning in Drug Discovery
Gawehn, E., Hiss, J. A., & Schneider, G. (2016) · Molecular Informatics · doi:10.1002/minf.201501008 · Cited by 723 · cited 1×
“Drug Discovery: Recent AI and machine learning techniques [87], [88] are having the potential to contribute to the growth and development of drug discovery.”
BackgroundHaleem, A., Javaid, M., & Singh, R. P. (2022) · BenchCouncil Transactions on Benchmarks, Standards and Evaluations · doi:10.1016/j.tbench.2023.100089 · Cited by 694
Role of Chat GPT in public health
Biswas, S. S. (2023) · Annals of Biomedical Engineering · doi:10.1007/s10439-023-03172-7 · Cited by 673 · cited 1×
“…Free GPT applications for maintaining a balanced diet, helping the individual with a weight loss diet plan, followed by a brief list of meal plans, required shopping lists, physical activity plans targeting particular body parts [157], motivational messages, and personalized sleeping patterns.”
BackgroundYeo, Y. H., Samaan, J. S., Ng, W. H., Ting, P.-S., Trivedi, H., Vipani, A., Ayoub, W., Yang, J. D., Liran, O., Spiegel, B., et al. (2023) · doi:10.1101/2023.02.06.23285449 · Cited by 666
Yeo, Y. H., Samaan, J. S., Ng, W. H., Ting, P.-S., Trivedi, H., Vipani, A., Ayoub, W., Yang, J. D., Liran, O., Spiegel, B., et al. (2023) · Clinical and Molecular Hepatology · doi:10.3350/cmh.2023.0089 · Cited by 662
Towards a Human-like Open-Domain Chatbot
Adiwardana, D., Luong, M.-T., So, D. R., Hall, J., Fiedel, N., Thoppilan, R., Yang, Z., Kulshreshtha, A., Nemade, G., Lu, Y., et al. (2020) · arXiv · doi:10.48550/arxiv.2001.09977 · Cited by 614 · cited 1×
“Google’s Meena project was developed by Google Research Team in 2020 for providing personalized product recommendations [187].”
MethodShafahi, A., Najibi, M., Ghiasi, A., Xu, Z., Dickerson, J., Studer, C., Davis, L. S., Taylor, G., & Goldstein, T. (2019) · ETH Zurich · doi:10.3929/ethz-b-000460345 · Cited by 580
What Makes Good In-Context Examples for GPT-3?
Liu, J., Shen, D., Zhang, Y., Dolan, B., Carin, L., & Chen, W. (2022) · Proceedings of Deep Learning Inside Out (DeeLIO 2022): The 3rd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures · doi:10.18653/v1/2022.deelio-1.10 · Cited by 563
Edge Computing with Artificial Intelligence: A Machine Learning Perspective
Hua, H., Li, Y., Wang, T., Dong, N., Li, W., & Cao, J. (2023) · ACM Computing Surveys · doi:10.1145/3555802 · Cited by 563
Cowls, J., Tsamados, A., Taddeo, M., & Floridi, L. (2021) · doi:10.2139/ssrn.3804983 · Cited by 552
Cowls, J., Tsamados, A., Taddeo, M., & Floridi, L. (2023) · AI & SOCIETY · doi:10.1007/s00146-021-01294-x · Cited by 552 · cited 1×
“The models can optimize supply chains for decreased carbon emissions, minimized waste, and improved resource efficiency by assessing elements including transportation routes, packaging materials, and supplier practises [110].”
BackgroundPereira, V., Hadjielias, E., Christofi, M., & Vrontis, D. (2023) · Human Resource Management Review · doi:10.1016/j.hrmr.2021.100857 · Cited by 537
Capabilities of GPT-4 on Medical Challenge Problems
Nori, H., King, N., McKinney, S. M., Carignan, D., & Horvitz, E. (2023) · arXiv · doi:10.48550/arxiv.2303.13375 · Cited by 509
ChatGPT for tourism: applications, benefits and risks
Carvalho, I., & Ivanov, S. (2024) · Tourism Review · doi:10.1108/tr-02-2023-0088 · Cited by 507
Recent Advances in Adversarial Training for Adversarial Robustness
Bai, T., Luo, J., Zhao, J., Wen, B., & Wang, Q. (2021) · arXiv · doi:10.48550/arxiv.2102.01356 · Cited by 490
Recent Advances in Adversarial Training for Adversarial Robustness
Bai, T., Luo, J., Zhao, J., Wen, B., & Wang, Q. (2021) · Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/591 · Cited by 490
“What Can ChatGPT Do?” Analyzing Early Reactions to the Innovative AI Chatbot on Twitter
Taecharungroj, V. (2023) · Big Data and Cognitive Computing · doi:10.3390/bdcc7010035 · Cited by 489
Is this time different? How digitalization influences job creation and destruction
Balsmeier, B., & Woerter, M. (2019) · Research Policy · doi:10.1016/j.respol.2019.03.010 · Cited by 465
Bouschery, S. G., Blazevic, V., & Piller, F. T. (2023) · Journal of Product Innovation Management · doi:10.1111/jpim.12656 · Cited by 444
A Review of ChatGPT AI's Impact on Several Business Sectors
George, A. S., George, A. S. H., & Martin, A. S. G. (2023) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.7644358 · Cited by 436
ChatGPT for healthcare services: An emerging stage for an innovative perspective
Javaid, M., Haleem, A., & Singh, R. P. (2023) · BenchCouncil Transactions on Benchmarks, Standards and Evaluations · doi:10.1016/j.tbench.2023.100105 · Cited by 429 · cited 1×
“Segmenting consumers based on preferences, behaviours, or past purchases can be aided by GPT models [139].”
MethodKatz, D. M., Bommarito, M. J., Gao, S., & Arredondo, P. (2024) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2023.0254 · Cited by 420
Artificial Intelligence as Augmenting Automation: Implications for Employment
Tschang, F. T., & Almirall, E. (2021) · Academy of Management Perspectives · doi:10.5465/amp.2019.0062 · Cited by 409
Lecler, A., Duron, L., & Soyer, P. (2023) · Diagnostic and Interventional Imaging · doi:10.1016/j.diii.2023.02.003 · Cited by 385 · cited 1×
“They can help with the article’s structure, writing the introduction, arranging the results, and discussing the conclusions [90].”
BackgroundSocio-economic status, health and lifestyle
Contoyannis, P., & Jones, A. M. (2004) · Journal of Health Economics · doi:10.1016/j.jhealeco.2004.02.001 · Cited by 380
A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?Preprint
Zhang, C., Zhang, C., Zheng, S., Qiao, Y., Li, C., Zhang, M., Dam, S. K., Thwal, C. M., Tun, Y. L., HUY, L. L., et al. (2023) · arXiv (Cornell University) · doi:10.13140/rg.2.2.29980.16001 · Cited by 375
Deep learning in drug discovery: opportunities, challenges and future prospects
Lavecchia, A. (2019) · Drug Discovery Today · doi:10.1016/j.drudis.2019.07.006 · Cited by 353
Artificial Intelligence in Organizations: Current State and Future Opportunities
Benbya, H., Davenport, T. H., & Pachidi, S. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3741983 · Cited by 350
Dual use of artificial-intelligence-powered drug discovery
Urbina, F., Lentzos, F., Invernizzi, C., & Ekins, S. (2022) · Nature Machine Intelligence · doi:10.1038/s42256-022-00465-9 · Cited by 346
Evaluating large language models in theory of mind tasks
Kosinski, M. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2405460121 · Cited by 339
Evaluating Large Language Models in Theory of Mind Tasks
Kosinski, M. (2023) · arXiv · doi:10.48550/arxiv.2302.02083 · Cited by 339
DeID-GPT: Zero-shot Medical Text De-Identification by GPT-4Preprint
Liu, Z., Huang, Y., Yu, X., Zhang, L., Wu, Z., Cao, C., Dai, H., Zhao, L., Li, Y., Shu, P., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2303.11032 · Cited by 321
Creating and detecting fake reviews of online products
Salminen, J., Kandpal, C., Kamel, A. M., Jung, S.-G., & Jansen, B. J. (2022) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2021.102771 · Cited by 306
Plagiarism in the age of massive generative pre-trained transformers (GPT-3)
Dehouche, N. (2021) · Ethics in Science and Environmental Politics · doi:10.3354/esep00195 · Cited by 296
Benbya, H., Deakin University, M., Pachidi, S., Cambridge JudgeBusiness School, U. O. C., Jarvenpaa, S. L., & McCombs School of Business, U. O. T. A. A. (2021) · Journal of the Association for Information Systems · doi:10.17705/1jais.00662 · Cited by 296
Healthy Lifestyle Characteristics Among Adults in the United States, 2000
Reeves, M. J., & Rafferty, A. P. (2005) · Archives of Internal Medicine · doi:10.1001/archinte.165.8.854 · Cited by 293
Potential Use of Chat GPT in Global Warming
Biswas, S. S. (2023) · Annals of Biomedical Engineering · doi:10.1007/s10439-023-03171-8 · Cited by 287
Real-time supply chain—A blockchain architecture for project deliveries
Helo, P., & Shamsuzzoha, A. H. M. (2020) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2019.101909 · Cited by 280
AMMU: A survey of transformer-based biomedical pretrained language models
Kalyan, K. S., Rajasekharan, A., & Sangeetha, S. (2022) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2021.103982 · Cited by 278
Evaluating Large Language Models in Generating Synthetic HCI Research Data: a Case Study
Hämäläinen, P., Tavast, M., & Kunnari, A. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580688 · Cited by 248
Maddigan, P., & Susnjak, T. (2023) · IEEE Access · doi:10.1109/access.2023.3274199 · Cited by 242
AI model GPT-3 (dis)informs us better than humans
Spitale, G., Biller-Andorno, N., & Germani, F. (2023) · Science Advances · doi:10.1126/sciadv.adh1850 · Cited by 241
Edge-Cloud Polarization and Collaboration: A Comprehensive Survey for AI
Yao, J., Zhang, S., Yao, Y., Wang, F., Ma, J., Zhang, J., Chu, Y., Ji, L., Jia, K., Shen, T., et al. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3178211 · Cited by 229
5G URLLC: Design Challenges and System Concepts
Li, Z., Uusitalo, M. A., Shariatmadari, H., & Singh, B. (2018) · 2018 15th International Symposium on Wireless Communication Systems (ISWCS) · doi:10.1109/iswcs.2018.8491078 · Cited by 213
A commentary of GPT-3 in MIT Technology Review 2021
Zhang, M., & Li, J. (2021) · Fundamental Research · doi:10.1016/j.fmre.2021.11.011 · Cited by 208
Haque, M. U., Dharmadasa, I., Sworna, Z. T., Rajapakse, R. N., & Ahmad, H. (2022) · arXiv · doi:10.48550/arxiv.2212.05856 · Cited by 203
How Good Are GPT Models at Machine Translation? A Comprehensive Evaluation
Hendy, A., Abdelrehim, M., Sharaf, A., Raunak, V., Gabr, M., Matsushita, H., Kim, Y. J., Afify, M., & Awadalla, H. H. (2023) · arXiv · doi:10.48550/arxiv.2302.09210 · Cited by 202
On the Explainability of Natural Language Processing Deep Models
Zini, J. E., & Awad, M. (2022) · ACM Computing Surveys · doi:10.1145/3529755 · Cited by 202
AI as the next GPT: a Political-Economy Perspective
Trajtenberg, M. (2018) · National Bureau of Economic Research · doi:10.3386/w24245 · Cited by 200
Levine, D. M., Tuwani, R., Kompa, B., Varma, A., Finlayson, S. G., Mehrotra, A., & Beam, A. (2024) · The Lancet Digital Health · doi:10.1016/s2589-7500(24)00097-9 · Cited by 199
On the Predictive Power of Neural Language Models for Human Real-Time Comprehension BehaviorPreprint
Wilcox, E., Gauthier, J., Hu, J., Qian, P., & Lévy, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.01912 · Cited by 193
Unpacking the "Black Box" of AI in EducationPreprint
Gillani, N., Eynon, R., Chiabaut, C., & Finkel, K. (2023) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.30191/ets.202301_26(1).0008 · Cited by 192
Marketing with ChatGPT: Navigating the Ethical Terrain of GPT-Based Chatbot Technology
Rivas, P., & Zhao, L. (2023) · AI · doi:10.3390/ai4020019 · Cited by 191
An Overview of Electronic Commerce (e-Commerce)
(2021) · Journal of Contemporary Issues in Business and Government · doi:10.47750/cibg.2021.27.03.090 · Cited by 185
Bommarito, M. J., & Katz, D. M. (2022) · doi:10.2139/ssrn.4314839 · Cited by 181
A Comprehensive Capability Analysis of GPT-3 and GPT-3.5 Series Models
Ye, J., Chen, X., Xu, N., Zu, C., Shao, Z., Liu, S., Cui, Y., Zhou, Z., Gong, C., Shen, Y., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2303.10420 · Cited by 180
Artificial Intelligence and Ten Societal Megatrends: An Exploratory Study Using GPT-3
Haluza, D., & Jungwirth, D. (2023) · Systems · doi:10.3390/systems11030120 · Cited by 178
Impact of Artificial Intelligence in Travel, Tourism, and Hospitality
Bulchand‐Gidumal, J. (2022) · Springer eBooks · doi:10.1007/978-3-030-48652-5_110 · Cited by 169
Pre-trained Language Models in Biomedical Domain: A Systematic Survey
Wang, B., Xie, Q., Pei, J., Chen, Z., Tiwari, P., Li, Z., & Fu, J. (2024) · ACM Computing Surveys · doi:10.1145/3611651 · Cited by 169
Let's have a chat! A Conversation with ChatGPT: Technology, Applications, and Limitations
Shahriar, S., & Hayawi, K. (2023) · arXiv · doi:10.48550/arxiv.2302.13817 · Cited by 167
AI-based language models powering drug discovery and development
Liu, Z., Roberts, R. A., Lal-Nag, M., Chen, X., Huang, R., & Tong, W. (2021) · Drug Discovery Today · doi:10.1016/j.drudis.2021.06.009 · Cited by 167
Let’s Have a Chat! A Conversation with ChatGPT: Technology, Applications, and Limitations
Shahriar, S., & Hayawi, K. (2023) · Artificial Intelligence and Applications · doi:10.47852/bonviewaia3202939 · Cited by 167
End-to-end Generative Pretraining for Multimodal Video Captioning
Seo, P. H., Nagrani, A., Arnab, A., & Schmid, C. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01743 · Cited by 164
End-to-End Transformer-Based Models in Textual-Based NLP
Rahali, A., & Akhloufi, M. A. (2023) · AI · doi:10.3390/ai4010004 · Cited by 164
The concept of lifestyle: a review
Veal, A. J. (1993) · Leisure Studies · doi:10.1080/02614369300390231 · Cited by 160
Chan, A. (2023) · AI and Ethics · doi:10.1007/s43681-022-00148-6 · Cited by 155
Platform-independent and curriculum-oriented intelligent assistant for higher education
Sajja, R., Sermet, Y., Cwiertny, D., & Demir, I. (2023) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-023-00412-7 · Cited by 153
The digital scribe in clinical practice: a scoping review and research agenda
van Buchem, M. M., Boosman, H., Bauer, M. P., Kant, I. M. J., Cammel, S. A., & Steyerberg, E. W. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00432-5 · Cited by 152
Softermax: Hardware/Software Co-Design of an Efficient Softmax for Transformers
Stevens, J. R., Venkatesan, R., Dai, S., Khailany, B., & Raghunathan, A. (2021) · 2021 58th ACM/IEEE Design Automation Conference (DAC) · doi:10.1109/dac18074.2021.9586134 · Cited by 148
Gradient-based Adversarial Attacks against Text Transformers
Guo, C., Sablayrolles, A., Jeǵou, H., & Kiela, D. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.464 · Cited by 141
(2021) · doi:10.1145/3510003.3510203 · Cited by 139
Exploring the Potential of Chat GPT in Personalized Obesity Treatment
Arslan, S. (2023) · Annals of Biomedical Engineering · doi:10.1007/s10439-023-03227-9 · Cited by 134
ChatGPT: Unlocking the future of NLP in finance
Zaremba, A., & Demir, E. (2023) · Modern Finance · doi:10.61351/mf.v1i1.43 · Cited by 132
Generative Pre-Trained Transformer for Design Concept Generation: An Exploration
Zhu, Q., & Luo, J. (2022) · Proceedings of the Design Society · doi:10.1017/pds.2022.185 · Cited by 130
Pre-trained language model representations for language generation
Edunov, S., Baevski, A., & Auli, M. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1409 · Cited by 122
Generating Role-Playing Game Quests With GPT Language Models
Värtinen, S., Hämäläinen, P., & Guckelsberger, C. (2022) · IEEE Transactions on Games · doi:10.1109/tg.2022.3228480 · Cited by 121
Attention Mechanism, Transformers, BERT, and GPT: Tutorial and SurveyPreprint
Ghojogh, B., & Ghodsi, A. (2020) · HAL · doi:10.31219/osf.io/m6gcn · Cited by 120
The Diagnostic and Triage Accuracy of the GPT-3 Artificial Intelligence Model
Levine, D. M., Tuwani, R., Kompa, B., Varma, A., Finlayson, S. G., Mehrotra, A., & Beam, A. (2023) · doi:10.1101/2023.01.30.23285067 · Cited by 106
Opal: Multimodal Image Generation for News Illustration
Liu, V., Qiao, H., & Chilton, L. (2022) · Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3526113.3545621 · Cited by 104
Large Language Models (GPT) Struggle to Answer Multiple-Choice Questions About Code
Šavelka, J., Agarwal, A., Bogart, C., & Sakr, M. F. (2023) · International Conference on Computer Supported Education · doi:10.5220/0011996900003470 · Cited by 97
Encyclopedia of Data Science and Machine Learning
(2023) · IGI Global eBooks · doi:10.4018/978-1-7998-9220-5 · Cited by 93
Trust in 5G and Beyond Networks
Benzaïd, C., Taleb, T., & Farooqi, M. Z. (2021) · IEEE Network · doi:10.1109/mnet.011.2000508 · Cited by 92
Jensen, M. (2007) · Environmental Sciences · doi:10.1080/15693430701472747 · Cited by 91
ChatGPT: the new panacea of the academic world
Quintans‐Júnior, L. J., Gurgel, R. Q., Araújo, A. A. D. S., Correia, D., & Martins‐Filho, P. R. (2023) · Revista da Sociedade Brasileira de Medicina Tropical · doi:10.1590/0037-8682-0060-2023 · Cited by 88
Democratizing Financial Knowledge with ChatGPT by OpenAI: Unleashing the Power of TechnologyPreprint
Yue, T., Au, D., Au, C. C., & Iu, K. Y. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4346152 · Cited by 86
Machine Learning guided early drug discovery of small molecules
Pillai, N., Dasgupta, A., Sudsakorn, S., Fretland, J., & Mavroudis, P. D. (2022) · Drug Discovery Today · doi:10.1016/j.drudis.2022.03.017 · Cited by 85
A Short Survey of Pre-trained Language Models for Conversational AI-A New Age in NLP
Zaib, M., Sheng, Q. Z., & Zhang, W. E. (2020) · Australasian Computer Science Week Multiconference (ACSW) · doi:10.1145/3373017.3373028 · Cited by 83
Improving short text classification with augmented data using GPT-3
Balkus, S. V., & Yan, D. (2023) · Natural Language Engineering · doi:10.1017/s1351324923000438 · Cited by 83
Voice Assistant Integrated with Chat GPT
Shafeeg, A., Shazhaev, I., Mihaylov, D., Tularov, A., & Shazhaev, I. (2023) · Indonesian Journal of Computer Science · doi:10.33022/ijcs.v12i1.3146 · Cited by 80
Thinking Fast and Slow in Large Language ModelsPreprint
Hagendorff, T., Fabi, S., & Kosiński, M. (2022) · PubMed Central · doi:10.48550/arxiv.2212.05206 · Cited by 78
A pre-trained BERT for Korean medical natural language processing
Kim, Y., Kim, J.-H., Lee, J. M., Jang, M. J., Yum, Y., Kim, S., Shin, U., Kim, Y.-M., Joo, H. J., & Song, S. (2022) · Scientific Reports · doi:10.1038/s41598-022-17806-8 · Cited by 77
Toward Green Metaverse Networking: Technologies, Advancements, and Future Directions
Zhang, S., Lim, W. Y. B., Ng, W. C., Xiong, Z., Niyato, D. T., Shen, X., & Miao, C. (2023) · IEEE Network · doi:10.1109/mnet.130.2200510 · Cited by 72
Sweidan, A. H., El-Bendary, N., & Al-Feel, H. (2021) · IEEE Access · doi:10.1109/access.2021.3091394 · Cited by 71
Benchmarking large language models for genomic knowledge with GeneTuring
Shang, X., Liao, X., Ji, Z., & Hou, W. (2025) · Briefings in Bioinformatics · doi:10.1093/bib/bbaf492 · Cited by 71
Sentiment Analysis for Personalized Chatbots in E-Commerce Applications
El-Ansari, A., & Beni‐Hssane, A. (2023) · Wireless Personal Communications · doi:10.1007/s11277-023-10199-5 · Cited by 70
Thus Spoke GPT-3: Interviewing a Large-Language Model on Climate Finance
Leippold, M. (2022) · Finance research letters · doi:10.1016/j.frl.2022.103617 · Cited by 69
Fine-tuning GPT-2 on annotated RPG quests for NPC dialogue generation
van Stegeren, J., & Myśliwiec, J. (2021) · International Conference on the Foundations of Digital Games (FDG) · doi:10.1145/3472538.3472595 · Cited by 64
Digital Transformation 4.0: Integration of Artificial Intelligence & Metaverse in Marketing
Rathore, B. (2023) · Eduzone International peer reviewed/refereed academic multidisciplinary journal · doi:10.56614/eiprmj.v12i1y23.248 · Cited by 63
Large Language Models (GPT) Struggle to Answer Multiple-Choice Questions about Code
Savelka, J., Agarwal, A., Bogart, C., & Sakr, M. (2023) · arXiv · doi:10.48550/arxiv.2303.08033 · Cited by 56
Is Artificial Intelligence a World Changer? A Case Study of OpenAI’s Chat GPT
Mathew, A. (2023) · Book Publisher International (a part of SCIENCEDOMAIN International) · doi:10.9734/bpi/rpst/v5/18240d · Cited by 55
Procedural Generation of Interactive Stories using Language Models
Freiknecht, J., & Wolfgang Effelsberg, A. (2020) · International Conference on the Foundations of Digital Games (FDG) · doi:10.1145/3402942.3409599 · Cited by 52
Importance of chat GPT in Agriculture: According to chat GPTPreprint
Biswas, S. S. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4405391 · Cited by 46
The Security Issues and challenges in Cloud Computing: Hussain Akbar
Akbar, H., Zubair, M. F., & Malik, M. S. (2023) · International Journal for Electronic Crime Investigation · doi:10.54692/ijeci.2023.0701125 · Cited by 45
Explaining Toxic Text via Knowledge Enhanced Text Generation
Sridhar, R., & Yang, D. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.59 · Cited by 43
Beerbaum, D. O. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4385025 · Cited by 39
The AI teacher test: Measuring the pedagogical ability of blender and GPT-3 in educational dialogues
Tack, A., & Piech, C. (2022) · arXiv · doi:10.48550/arxiv.2205.07540 · Cited by 36
Possibilities and Challenges of Compounding Artificial Intelligence in India’s Educational LandscapePreprint
Alam, A. (2020) · SSRN Electronic Journal · Cited by 35
ChatGPT and Big Data: Enhancing Text-to-Speech Conversion
Dida, H. A., Chakravarthy, D. S. K., & Rabbi, F. (2023) · Mesopotamian Journal of Big Data · doi:10.58496/mjbd/2023/005 · Cited by 31
Plato Dialogue System: A Flexible Conversational AI Research PlatformPreprint
Papangelis, A., Namazifar, M., Khatri, C., Wang, Y., Molino, P., & Tür, G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.06463 · Cited by 30
Brand, N., Odom, W., & Barnett, S. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581336 · Cited by 27
Sentiment Analysis Using Autoregressive Language Modeling and Broad Learning System
Gong, X., Jin, J., & Zhang, T. (2019) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm47256.2019.8983025 · Cited by 25
Variational Latent-State GPT for Semi-Supervised Task-Oriented Dialog Systems
Liu, H., Cai, Y., Lin, Z., Ou, Z., Huang, Y., & Feng, J. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3240661 · Cited by 25
Zhang, X., Jiang, Y., Shang, Y., Cheng, Z., Zhang, C., Fan, X., Xiao, Y., & Long, B. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3463037 · Cited by 24
An Ensemble-Learning-Based Technique for Bimodal Sentiment Analysis
Shah, S., Ghomeshi, H., Vakaj, E., Cooper, E., & Mohammad, R. (2023) · Big Data and Cognitive Computing · doi:10.3390/bdcc7020085 · Cited by 21
Wang, H., Wu, H., Zhu, H., Miao, Y., Wang, Q., Qiao, S., Zhao, H., Chen, C., & Zhang, J. (2022) · Agriculture · doi:10.3390/agriculture12060813 · Cited by 20
The theology of GPT‐2: Religion and artificial intelligence
Reed, R. (2021) · Religion Compass · doi:10.1111/rec3.12422 · Cited by 18
A Review of Generative AI from Historical PerspectivesPreprint
Dasgupta, D., Venugopal, D., & Gupta, K. D. (2023) · doi:10.36227/techrxiv.22097942 · Cited by 17
Williams, N., Ivanov, S. H., & Buhalis, D. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2303.07304 · Cited by 16
The Potential of GPT-4 as a Personalized Virtual Assistant for Bariatric Surgery Patients
Ali, H. (2023) · Obesity Surgery · doi:10.1007/s11695-023-06576-5 · Cited by 16
UbiNN: A Communication Efficient Framework for Distributed Machine Learning in Edge Computing
Li, K., Chen, K., Luo, S., Zhang, H., & Fan, P. (2023) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2023.3260566 · Cited by 15
Understanding Emails and Drafting Responses -- An Approach Using GPT-3
Thiergart, J., Huber, S., & Übellacker, T. (2021) · arXiv · doi:10.48550/arxiv.2102.03062 · Cited by 14 · cited 1×
“The authors in [167] have used GPT-3 model for automated drafting of responses for incoming mails.”
MethodProbing Pre-Trained Language Models for Disease Knowledge
Alghanmi, I., Espinosa-Anke, L., & Schockaert, S. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.266 · Cited by 13
Yamaoka, K., Watanabe, K., Kise, K., Dengel, A. R., & Ishimaru, S. (2022) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3544793.3560382 · Cited by 13
10 Security and Privacy Problems in Large Foundation Models
Jia, J., Liu, H., & Gong, N. Z. (2023) · Springer eBooks · doi:10.1007/978-3-031-42637-7_8 · Cited by 12
Revolutionizing Business Communication: Exploring the Potential of GPT-4 in Corporate Settings
George, D. A. S., George, A. S. H., Dr.T.Baskar, & Martin, A. S. G. (2023) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.7775899 · Cited by 10
From ChatGPT-3 to GPT-4: A Significant Leap in AI-Driven NLP ToolsPreprint
Ahsan, M. M. T., Rahaman, M. S., & Anjum, N. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4404397 · Cited by 8
CGEMs: A Metric Model for Automatic Code Generation using GPT-3Preprint
Narasimhan, A., Rao, K. P. A. V., & Veena, M. B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.10168 · Cited by 6
Generating Product Description with Generative Pre-trained Transformer 2
Nguyen, M.-T., Nguyen, P.-T., Nguyen, V.-V., & Nguyen, Q.-M. (2021) · International Conference on Innovative Technologies in Intelligent Systems and Industrial Applications (CITISIA) · doi:10.1109/citisia53721.2021.9719940 · Cited by 6
A Joint Domain-Specific Pre-Training Method Based on Data Enhancement
Gan, Y., Lu, G., Su, Z., Lei, W., Zhou, J., Jiang, J., & Chen, D. (2023) · Applied Sciences · doi:10.3390/app13074115 · Cited by 6
Vulturar, D.-M., Neag, M. A., Vesa, Ș. C., Maierean, A.-D., Gherman, D., Buzoianu, A. D., Orasan, O. H., & Todea, D. A. (2022) · International Journal of Molecular Sciences · doi:10.3390/ijms232214462 · Cited by 5
An Interpretable Word Sense Classifier for Human Explainable Chatbot
Yadav, R. K., Jiao, L., Granmo, O., & Goodwin, M. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-10161-8_13 · Cited by 2
Tackling Attribute Fine-grainedness in Cross-modal Fashion Search with Multi-level Features
Goei, K., Hendriksen, M., & de Rijke, M. (2021) · UvA-DARE (University of Amsterdam) · Cited by 1
Cited by
A Comprehensive Review of Deep Learning: Architectures, Recent Advances, and Applications
Mienye, I. D., & Swart, T. G. (2024) · Information · doi:10.3390/info15120755 · Cited by 330
The Potential and Concerns of Using AI in Scientific Research: ChatGPT Performance Evaluation
Khlaif, Z. N., Mousa, A., Hattab, M. K., Itmazi, J., Hassan, A. A., Sanmugam, M., & Ayyoub, A. (2023) · JMIR Medical Education · doi:10.2196/47049 · Cited by 205
ChatGPT: A Case Study on Copyright Challenges for Generative Artificial Intelligence Systems
Lucchi, N. (2024) · European Journal of Risk Regulation · doi:10.1017/err.2023.59 · Cited by 173
Generative AI for Consumer Behavior Prediction: Techniques and Applications
Madanchian, M. (2024) · Sustainability · doi:10.3390/su16229963 · Cited by 60
Mishra, L. N., & Senapati, B. (2025) · IEEE Access · doi:10.1109/access.2025.3552592 · Cited by 35
“The recent advancement in agentic AI backed by Large Language Models (LLMs) has made it possible to analyze and correlate numerous interdependent elements of the retail industry [9].”
Metadata
- Authors
- Yenduri, G., Ramalingam, M., Selvi, G. C., Supriya, Y., Srivastava, G., Maddikunta, P. K. R., Raj, G. D., Jhaveri, R. H., Prabadevi, B., Wang, W., Vasilakos, A. V., & Gadekallu, T. R.
- Venue
- IEEE Access
- Published
- 2024
- Volume
- 12
- Pages
- 54608-54649
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W4394828356
- Cited by
- 596
- References
- 161
- FWCI
- 87.95
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.