An analysis of large language models: their impact and potential applications
The DOI matches its Crossref record; 45 of the 47 references it cites were found in a registry or an index, and 1 are not checked yet.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The addition of large language models (LLM) into healthcare operations, including electronic health record (EHR) systems represents a transformative level of adoption and integration, changing how enterprise systems interact with algorithms; permitting the largely unconsented collection and utilization of previously unmined private data originating from the care of patients1,2.”
From Preventing unrestricted and unmonitored AI experimentation in healthcare through transparency and accountability (2025) · cites this paper as [1]
Citations
Cites
ChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · doi:10.35542/osf.io/5er8f · Cited by 7,552
ChatGPT for good? On opportunities and challenges of large language models for education
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102274 · Cited by 7,326
Recurrent neural network based language model
Mikolov, T., Karafiát, M., Burget, L., Černocký, J., & Khudanpur, S. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-343 · Cited by 5,390 · cited 1×
“However, unless equipped with powerful artificial intelligence (AI) algorithms, machines cannot naturally grasp the abilities of understanding and communicating in the form of human language [2].”
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
Wu, Y., Schuster, M., Chen, Z., Le, Q. V., Norouzi, M., Macherey, W., Krikun, M., Cao, Y., Gao, Q., Macherey, K., et al. (2016) · arXiv · doi:10.48550/arxiv.1609.08144 · Cited by 5,319 · cited 1×
“With careful deployment and continuous research, LLMs have the ability to increase efficiency and productivity while also addressing issues of misuse and prejudice [62, 63].”
LLaMA: Open and Efficient Foundation Language Models
Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.-A., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., Azhar, F., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.13971 · Cited by 4,602
Large language models in medicine
Thirunavukarasu, A. J., Ting, D. S. J., Elangovan, K., Gutierrez, L., Tan, T. F., & Ting, D. S. W. (2023) · Nature Medicine · doi:10.1038/s41591-023-02448-8 · Cited by 3,944
Sallam, M. (2023) · Healthcare · doi:10.3390/healthcare11060887 · Cited by 3,126
Sallam, M. (2023) · doi:10.1101/2023.02.19.23286155 · Cited by 3,123 · cited 1×
“Concerning ChatGPT and similar LLMs’ potential to improve clinical operations, healthcare professionals have expressed cautious optimism [35].”
GPT-3: Its Nature, Scope, Limits, and Consequences
Floridi, L., & Chiriatti, M. (2020) · Minds and Machines · doi:10.1007/s11023-020-09548-1 · Cited by 2,519
Large Language Models are Zero-Shot Reasoners
Kojima, T., Gu, S. S., Reid, M., Matsuo, Y., & Iwasawa, Y. (2022) · arXiv · doi:10.48550/arxiv.2205.11916 · Cited by 2,013 · cited 1×
“These strategies collectively help enhance model performance, generalizability, and reliability while reducing the risks associated with biased, toxic, or inaccurate content [58].”
Sparks of Artificial General Intelligence: Early experiments with GPT-4
Bubeck, S., Chandrasekaran, V., Eldan, R., Gehrke, J., Horvitz, E., Kamar, E., Lee, P., Lee, Y. T., Li, Y., Lundberg, S., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.12712 · Cited by 1,526
Practical and ethical challenges of large language models in education: A systematic scoping review
Yan, L., Sha, L., Zhao, L., Li, Y., Martinez‐Maldonado, R., Chen, G., Li, X., Jin, Y., & Gašević, D. (2024) · British Journal of Educational Technology · doi:10.1111/bjet.13370 · Cited by 1,435
A Comprehensive Overview of Large Language Models
Naveed, H., Khan, A. U., Qiu, S., Saqib, M., Anwar, S., Usman, M., Akhtar, N., Barnes, N., & Mian, A. (2023) · arXiv · doi:10.48550/arxiv.2307.06435 · Cited by 1,259 · cited 1×
“Thisinnovationunderpinnedthedevelopmentofprominentmodels suchasGPT-1andBERTin2018,which,afterpre-trainingonextensivetextualdata,set newbenchmarksforNLPtasks[14].”
Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Models
Liu, Y., Han, T., Ma, S., Zhang, J., Yang, Y., Tian, J., He, H., Li, A., He, M., Liu, Z., et al. (2023) · arXiv · doi:10.48550/arxiv.2304.01852 · Cited by 1,172 · cited 2×
“In light of this, Liu et al. [38, 39] redirect attention to ChatGPT’s potentiality in the larger medical field, particularly its viability for patient–doctor communication.”
Cascella, M., Montomoli, J., Bellini, V., & Bignami, E. (2023) · Journal of Medical Systems · doi:10.1007/s10916-023-01925-4 · Cited by 1,120
The imperative for regulatory oversight of large language models (or generative AI) in healthcare
Meskó, B., & Topol, E. J. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00873-0 · Cited by 1,047
Neural Machine Translation of Rare Words with Subword Units
Sennrich, R., Haddow, B., & Birch, A. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1162 · Cited by 974 · cited 1×
“Bytepairencoding(BPE)isaprominentsubwordtokenizationtechniquethatiteratively mergesfrequentpairsofcharactersorsymbolstoformsubwords,reducingvocabularysize andimprovingmodelperformancewithrarewords[9].”
Neural Machine Translation of Rare Words with Subword Units
Sennrich, R., Haddow, B., & Birch, A. (2015) · arXiv · doi:10.48550/arxiv.1508.07909 · Cited by 950 · cited 1×
“Bytepairencoding(BPE)isaprominentsubwordtokenizationtechniquethatiteratively mergesfrequentpairsofcharactersorsymbolstoformsubwords,reducingvocabularysize andimprovingmodelperformancewithrarewords[9].”
Summary of ChatGPT-Related research and perspective towards the future of large language models
Liu, Y., Han, T., Ma, S., Zhang, J., Yang, Y., Tian, J., He, H., Li, A., He, M., Liu, Z., et al. (2023) · Meta-Radiology · doi:10.1016/j.metrad.2023.100017 · Cited by 855 · cited 2×
“In light of this, Liu et al. [38, 39] redirect attention to ChatGPT’s potentiality in the larger medical field, particularly its viability for patient–doctor communication.”
Large Language Models in Medical Education: Opportunities, Challenges, and Future Directions
Abd-alrazaq, A., AlSaad, R., Alhuwail, D., Ahmed, A., Healy, P. M., Latifi, S., Aziz, S., Damseh, R., Alabed Alrazak, S., & Sheikh, J. (2023) · JMIR Medical Education · doi:10.2196/48291 · Cited by 722 · cited 2×
“Abd-Alrazaq et al. [24] investigated the significance of huge language models like GPT in transforming medical education.”
ChatGPT and the rise of large language models: the new AI-driven infodemic threat in public health
De Angelis, L., Baglivo, F., Arzilli, G., Privitera, G. P., Ferragina, P., Tozzi, A. E., & Rizzo, C. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1166120 · Cited by 708
Advances in Automatic Text Summarization
Liddy, E. (2001) · Information Retrieval · doi:10.1023/a:1011476409104 · Cited by 685 · cited 1×
“Large language models (LLMs) have significantly advanced natural language processing [59], unlocking new frontiers in text generation and comprehension.”
ChatGPT and large language models in academia: opportunities and challenges
Meyer, J. G., Urbanowicz, R. J., Martin, P. C. N., O’Connor, K., Li, R., Peng, P.-C., Bright, T. J., Tatonetti, N., Won, K. J., Gonzalez-Hernandez, G., et al. (2023) · BioData Mining · doi:10.1186/s13040-023-00339-9 · Cited by 569
FinGPT: Open-Source Financial Large Language Models
Yang, H., Liu, X.-Y., & Wang, C. D. (2023) · doi:10.2139/ssrn.4489826 · Cited by 475
Towards Reasoning in Large Language Models: A Survey
Huang, J., & Chang, K. C.-C. (2023) · Findings of the Association for Computational Linguistics: ACL 2023 · doi:10.18653/v1/2023.findings-acl.67 · Cited by 428
Towards Reasoning in Large Language Models: A Survey
Huang, J., & Chang, K. C.-C. (2022) · arXiv · doi:10.48550/arxiv.2212.10403 · Cited by 428
FinGPT: Open-Source Financial Large Language Models
Yang, H., Liu, X.-Y., & Wang, C. D. (2023) · arXiv · doi:10.48550/arxiv.2306.06031 · Cited by 326
ChatGPT for shaping the future of dentistry: the potential of multi-modal large language model
Huang, H., Zheng, O., Wang, D., Yin, J., Wang, Z., Ding, S., Yin, H., Xu, C., Yang, R., Zheng, Q., et al. (2023) · International Journal of Oral Science · doi:10.1038/s41368-023-00239-y · Cited by 324
Large Language Models in Finance: A Survey
Li, Y., Wang, S., Ding, H., & Chen, H. (2023) · 4th ACM International Conference on AI in Finance · doi:10.1145/3604237.3626869 · Cited by 274
HuatuoGPT, Towards Taming Language Model to Be a Doctor
Zhang, H., Chen, J., Jiang, F., Yu, F., Chen, Z., Chen, G., Li, J., Wu, X., Zhiyi, Z., Xiao, Q., et al. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023 · doi:10.18653/v1/2023.findings-emnlp.725 · Cited by 206
Large language models challenge the future of higher education
Milano, S., McGrane, J. A., & Leonelli, S. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00644-2 · Cited by 166
ChatGPT in Dentistry: A Comprehensive Review
Alhaidry, H. M., Fatani, B., Alrayes, J. O., Almana, A. M., & Alfhaed, N. K. (2023) · Cureus · doi:10.7759/cureus.38317 · Cited by 126 · cited 1×
“Alhaidry et al. [37] examine the applications of LLMs in the particular field of dentistry, highlighting the model’s potential in clinical decision support, administrative positions, dental telemedicine, and dental education.”
Ethical Dilemmas, Mental Health, Artificial Intelligence, and LLM-Based Chatbots
Cabrera-Medina, J., Loyola, M. S., Magaña, I., & Rojas, R. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-34960-7_22 · Cited by 123
Zhou, S., Wang, N., Wang, L., Liu, H., & Zhang, R. (2022) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocac040 · Cited by 119
Statistical language modeling for information retrieval
Liu, X., & Croft, W. B. (2005) · Annual Review of Information Science and Technology · doi:10.1002/aris.1440390108 · Cited by 106
Reddy, S. (2023) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2023.101304 · Cited by 99 · cited 1×
“By highlighting the application of LLMs in processing electronic health records (EHR) to predict diagnoses, suggest treatments, and assist in decision support, Reddy [34] demonstrates the significant improvements in healthcare delivery that result from the symbiotic integration of AI.”
Transfer Learning in Natural Language Processing
Yang, Q., Zhang, Y., Dai, W., & Pan, S. J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781139061773.020 · Cited by 95
Bewersdorff, A., Seßler, K., Baur, A., Kasneci, E., & Nerdel, C. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2023.100177 · Cited by 76
Text Summarization for Big Data Analytics: A Comprehensive Review of GPT 2 and BERT Approaches
Mohan, G. B., Kumar, R. P., Parathasarathy, S., Aravind, S., Hanish, K. B., & Pavithria, G. (2023) · Internet of things · doi:10.1007/978-3-031-33808-3_14 · Cited by 49
Brameier, D. T., Alnasser, A. A., Carnino, J. M., Bhashyam, A. R., von Keudell, A. G., & Weaver, M. J. (2023) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.23.00473 · Cited by 46 · cited 1×
“The rise in natural language processing with LLMs in medicine, especially orthopedic surgery, is covered by [41].”
Survey of Text Document Summarization Based on Ensemble Topic Vector Clustering Model
Mohan, G. B., & Kumar, R. P. (2022) · Lecture notes in networks and systems · doi:10.1007/978-981-19-5845-8_60 · Cited by 36
Artificial scholarship: LLMs in health professions education research
Ellaway, R. H., & Tolsgaard, M. (2023) · Advances in Health Sciences Education · doi:10.1007/s10459-023-10257-4 · Cited by 36
GatorTron: A Large Language Model for Clinical Natural Language Processing
Yang, X., PourNejatian, N., Shin, H. C., Smith, K. E., Parisien, C., Compas, C., Martin, C., Flores, M. G., Zhang, Y., Magoc, T., et al. (2022) · doi:10.1101/2022.02.27.22271257 · Cited by 33
The Utility of Large Language Models and Generative AI for Education ResearchPreprint
Katz, A., Shakir, U., & Chambers, B. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.18125 · Cited by 27
Bidirectional LSTM Networks for Abstractive Text Summarization
Kovačević, A., & Кеčo, D. (2021) · Lecture notes in networks and systems · doi:10.1007/978-3-030-90055-7_21 · Cited by 17
Forsyth, D. A. (2019) · Springer eBooks · doi:10.1007/978-3-030-18114-7_13 · Cited by 3
Research works printed but not linked: 22
- Arisoy E, Sainath TN, Kingsbury B, Ramabhadran B (2012) Deep neural network language models. In: Proceedings of the NAACL-HLT 2012 workshop: Will we ever really replace the n-gram model? On the Future of Language Modeling for HLT, pp 20–28
- Liu Y, Ott M, Goyal N, Du J, Joshi M, Chen D, Levy O, Lewis M, Zettlemoyer L, Stoyanov V (2019) Roberta: a robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692 · arXiv
- Yu Y, Zhuang Y, Zhang J, Meng Y, Ratner A, Krishna R, Shen J, Zhang C (2023) Large language model as attributed training data generator: a tale of diversity and bias. arXiv preprint arXiv:2306.15895 · arXiv
- Devlin J, Chang MW, Lee K, Toutanova K (2018) Bert: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 · arXiv
- Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Polosukhin I et al. (2017) Attention Is All You Need. In: 31st Conference on neural information processing systems (NIPS 2017), Long Beach, CA, pp 5998–6008
- Zhao WX, Zhou K, Li J, Tang T, Wang X, Hou Y, Min Y, Zhang B, Zhang J, Dong Z, Du Y (2023) A survey of large language models. arXiv preprint arXiv:2303.18223 · arXiv
- Sutskever I, Vinyals O, Le QV (2014) Sequence to sequence learning with neural networks. In: Advances in neural information processing systems, vol 27.
- Yang Z, Dai Z, Yang Y, Carbonell JG (2019) Ruslan Salakhutdinov, Quoc V. Le: XLNet: Generalized autoregressive pretraining for language understanding. NeurIPS 2019, pp 5754–5764.
- Radford A, Wu J, Child R, Luan D, Amodei D, Sutskever I (2019) Language models are unsupervised multitask learners. OpenAI Blog 1(8):9
- Brown T, Mann B, Ryder N, Subbiah M, Kaplan JD, Dhariwal P, Neelakantan A, Shyam P, Sastry G, Askell A, Agarwal S (2020) Language models are few-shot learners. Adv Neural Inf Process Syst 33:1877–1901
- Aher GV, Arriaga RI, Kalai AT (2023) Using large language models to simulate multiple humans and replicate human subject studies. In: International conference on machine learning. PMLR, pp 337–371
- Bawden R, Yvon F (2023) Investigating the translation performance of a large multilingual language model: the case of bloom. arXiv preprint arXiv:2303.01911 · arXiv
- Zhu D, Chen J, Shen X, Li X, Elhoseiny M (2023) Minigpt-4: enhancing vision-language understanding with advanced large language models. arXiv preprint arXiv:2304.10592 · arXiv
- Gu Y, Zhang S, Usuyama N, Woldesenbet Y, Wong C, Sanapathi P, Wei M, Valluri N, Strandberg E, Naumann T, Poon H (2023) Distilling large language models for biomedical knowledge extraction: A case study on adverse drug events. arXiv preprint arXiv:2307.06439 · arXiv
- Sharaf S, Anoop VS (2023) An analysis on large language models in healthcare: a case study of BioBERT. arXiv preprint arXiv:2310.07282 · arXiv
- Santos T, Tariq A, Das S, Vayalpati K, Smith GH, Trivedi H, Banerjee I (2022) PathologyBERT-Pre-trained vs a new transformer language model for pathology domain. In: AMIA annual symposium proceedings, vol 2022. American Medical Informatics Association, p 962
- Yang Y, Tang Y, Tam KY (2023) InvestLM: a large language model for investment using financial domain instruction tuning. arXiv preprint arXiv:2309.13064 · arXiv
- Nourbakhsh A, Bang G (2019) A framework for anomaly detection using language modeling, and its applications to finance. arXiv preprint arXiv:1908.09156 · arXiv
- Wu S, Irsoy O, Lu S, Dabravolski V, Dredze M, Gehrmann S, Kambadur P, Rosenberg D, Mann G (2023) Bloomberggpt: a large language model for finance. arXiv preprint arXiv:2303.17564 · arXiv
- Yang Y, Uy MCS, Huang A (2020) Finbert: a pretrained language model for financial communications. arXiv preprint arXiv:2006.08097 · arXiv
- Xie Q, Han W, Zhang X, Lai Y, Peng M, Lopez-Lira A, Huang J (2023) PIXIU: a large language model, instruction data and evaluation benchmark for finance. arXiv preprint arXiv:2306.05443 · arXiv
- Shi W, Ajith A, Xia M, Huang Y, Liu D, Blevins T, Chen D, Zettlemoyer L (2023) Detecting pretraining data from large language models. arXiv preprint arXiv:2310.16789 · arXiv
Cited by
Integrating LLMs With ITS: Recent Advances, Potentials, Challenges, and Future Directions
Mahmud, D., Hajmohamed, H., Almentheri, S., Alqaydi, S., Aldhaheri, L., Khalil, R. A., & Saeed, N. (2025) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2025.3528116 · Cited by 141
“Scaling LLMs across a diverse range of devices in ITS requires sophisticated distributed computing techniques and adaptive algorithms to manage the heterogeneity of network environments [293].”
Application of Transformers in Cheminformatics
Luong, K.-D., & Singh, A. K. (2024) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.3c02070 · Cited by 85
Shang, F., Zhao, F., Zhang, M., Sun, U., & Shi, J. (2024) · International Journal of Innovative Research in Engineering & Management · doi:10.55524/ijirem.2024.11.4.6 · Cited by 58
Wahidur, R. S. M., Kim, S., Choi, H., Bhatti, D. S., & Lee, H.-N. (2025) · IEEE Access · doi:10.1109/access.2025.3542125 · Cited by 57
Examining the responsible use of zero-shot AI approaches to scoring essays
Johnson, M., & Zhang, M. (2024) · Scientific Reports · doi:10.1038/s41598-024-79208-2 · Cited by 52
Metadata
- Authors
- Bharathi Mohan, G., Prasanna Kumar, R., Vishal Krishh, P., Keerthinathan, A., Lavanya, G., Meghana, M. K. U., Sulthana, S., & Doss, S.
- Affiliations
- Amrita Vishwa Vidyapeetham (IN)
- Botho University (BW)
- Venue
- Knowledge and Information Systems
- Published
- 2024-05-11
- Volume
- 66
- Issue
- 9
- Pages
- 5047-5070
- ISSN
- 0219-1377 (ISSN-L)
- 0219-3116
- OpenAlex
- W4396835373
- Cited by
- 99
- References
- 47
- Citations by year
- 2026: 28 · 2025: 57 · 2024: 14
- FWCI
- 14.61
- Type
- journal article
- Language
- en
- Update notices
- correction (2024-07-16)
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Knowledge and Information Systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- large language models, transformer models, natural language processing, AI ethics, societal impact of AI
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.