A Comprehensive Overview of Large Language Models

Naveed, Humza, Khan, Asad Ullah, Qiu, Shi, Saqib, Muhammad, Anwar, Saeed, Usman, Muhammad, Akhtar, Naveed, Barnes, Nick +1 more·2025·ACM Transactions on Intelligent Systems and Technology
DOI 10.1145/3744746

Cites (245)

Items 201–258 of 258

  1. Outlier Suppression+: Accurate quantization of large language models by equivalent and effective shifting and scaling
    Xiuying Wei, Yuncheng Zhang, Yuhang Li, Xiangguo Zhang, Ruihao Gong, Jinyang Guo, Xianglong Liu · 2023 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  2. Enhancing the quality of teaching and learning through ChatGPT and similar large language models: Challenges, future prospects, and ethical considerations in education
    Nitin Rane · 2024 · TESOL and Technology Studies
  3. Long Time No See! Open-Domain Conversation with Long-Term Persona Memory
    Xiaoyun Xu, Zhibin Gou, Wenquan Wu, Zheng-Yu Niu, Hua Wu, Haifeng Wang, Shihang Wang · 2022 · Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
  4. Chinese Medical Question Answer Matching Using End-to-End Character-Level Multi-Scale CNNs
    Sheng Zhang, Xin Zhang, Hui Wang, Jiajun Cheng, Pei Li, Zhaoyun Ding · 2017 · Applied Sciences
  5. CPM-2: Large-scale cost-effective pre-trained language models
    Zhengyan Zhang, Yuxian Gu, Xu Han, Shengqi Chen, Chaojun Xiao, Zhenbo Sun, Yuan Yao, Fanchao Qi, Jian Guan, Pei Ke et al. · 2021 · AI Open
  6. Optimal Brain Compression: A Framework for Accurate Post-Training Quantization and Pruning
    Elias Frantar, Dan Alistarh · 2022 · neural information processing systems
  7. TidyBot: Personalized Robot Assistance with Large Language Models
    Jimmy Wu, Rika Antonova, Adam Kan, Marion Lepert, Andy Zeng, Shuran Song, Jeannette Bohg, Szymon M. Rusinkiewicz, Thomas A. Funkhouser · 2023 · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
  8. Proceedings of the 50th Annual International Symposium on Computer Architecture
    2023
  9. Towards Next-Generation Intelligent Assistants Leveraging LLM Techniques
    Xin Luna Dong, Seungwhan Moon, Yifan Ethan Xu, Kshitiz Malik, Zhou Yu · 2023 · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD)
  10. AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning
    Wang, Yaqing, Agarwal, Sahaj, Mukherjee, Subhabrata, Liu, Xiaodong, Gao, Jing, Awadallah, Ahmed Hassan, Gao, Jianfeng · 2022 · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
  11. On Second Thought, Let’s Not Think Step by Step! Bias and Toxicity in Zero-Shot Reasoning
    Shaikh, Omar, Zhang, Hongxin, Held, William, Bernstein, Michael, Yang, Diyi · 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
  12. Data Decentralisation of LLM-Based Chatbot Systems in Chronic Disease Self-Management
    Montagna, Sara, Ferretti, Stefano, Klopfenstein, Lorenz Cuno, Florio, Antonio, Pengo, Martino Francesco · 2023 · Proceedings of the 2023 ACM Conference on Information Technology for Social Good
  13. On Second Thought, Let’s Not Think Step by Step! Bias and Toxicity in Zero-Shot Reasoning
    Shaikh, Omar, Zhang, Hongxin, Held, William, Bernstein, Michael, Yang, Diyi · 2022 · arXiv
  14. DetGPT: Detect What You Need via Reasoning
    Renjie Pi, Jiahui Gao, Shizhe Diao, Rui Pan, Hanze Dong, Jipeng Zhang, Lewei Yao, Jianhua Han, Hang Xu, Lingpeng Kong et al. · 2023 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  15. Multi-Scale Attentive Interaction Networks for Chinese Medical Question Answer Selection
    Sheng Zhang, Xin Zhang, Hui Wang, Lixiang Guo, Shanshan Liu · 2018 · IEEE Access
  16. Emergent autonomous scientific research capabilities of large language models
    Boiko, Daniil A., MacKnight, Robert, Gomes, Gabe · 2023 · arXiv
  17. Matching Article Pairs with Graphical Decomposition and Convolutions
    Bang Liu, Di Niu, Haojie Wei, Jinghong Lin, Yancheng He, Kunfeng Lai, Yu Xu · 2019 · Proceedings of the conference - Association for Computational Linguistics. Meeting
  18. The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning
    Seungone Kim, Se Joo, Doyoung Kim, Joel Jang, Seonghyeon Ye, Jamin Shin, Minjoon Seo · 2023 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  19. Alexa Teacher Model: Pretraining and Distilling Multi-Billion-Parameter Encoders for Natural Language Understanding Systems
    FitzGerald, Jack, Ananthakrishnan, Shankar, Arkoudas, Konstantine, Bernardi, Davide, Bhagia, Abhishek, Delli Bovi, Claudio, Cao, Jin, Chada, Rakesh, Chauhan, Amit, Chen, Luoxin et al. · 2022 · Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining
  20. WuDaoCorpora: A super large-scale Chinese corpora for pre-training language models
    Yuan, Sha, Zhao, Hanyu, Du, Zhengxiao, Ding, Ming, Liu, Xiao, Cen, Yukuo, Zou, Xu, Yang, Zhilin, Tang, Jie · 2021 · AI Open
  21. The impending impacts of large language models on medical education
    Sangzin Ahn · 2023 · Korean journal of medical education
  22. The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset
    Laurençon, Hugo, Saulnier, Lucile, Wang, Thomas, Akiki, Christopher, del Moral, Albert Villanova, Scao, Teven Le, Von Werra, Leandro, Mou, Chenghao, Ponferrada, Eduardo González, Nguyen, Huu et al. · 2023 · arXiv
  23. Revisiting Parameter-Efficient Tuning: Are We Really There Yet?
    Chen, Guanzheng, Liu, Fangyu, Meng, Zaiqiao, Liang, Shangsong · 2022 · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
  24. MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning
    Zhiyang Xu, Ying Shen, Lifu Huang · 2023 · Proceedings of the conference - Association for Computational Linguistics. Meeting
  25. Fine-tuned Language Models are Continual Learners
    Thomas Scialom, Tuhin Chakrabarty, Smaranda Muresan · 2022 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  26. IdealGPT: Iteratively Decomposing Vision and Language Reasoning via Large Language Models
    Haoxuan You, Rui Sun, Zhecan Wang, Long Chen, Gengyu Wang, Hammad Ayyubi, Kai-Wei Chang, Shih‐Fu Chang · 2023 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
  27. FiD-Light: Efficient and Effective Retrieval-Augmented Text Generation
    Hofstätter, Sebastian, Chen, Jiecao, Raman, Karthik, Zamani, Hamed · 2023 · Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval
  28. Extending Context Window of Large Language Models via Positional Interpolation
    Chen, Shouyuan, Wong, Sherman, Chen, Liangjian, Tian, Yuandong · 2023 · arXiv
  29. Contribution and performance of ChatGPT and other Large Language Models (LLM) for scientific and research advancements: a double-edged sword
    2023 · International Research Journal of Modernization in Engineering Technology and Science
  30. Compression of Generative Pre-trained Language Models via Quantization
    Chaofan Tao, Lu Hou, Wei Zhang, Lifeng Shang, Xin Jiang, Qun Liu, Ping Luo, Ngai Wong · 2022 · Proceedings of the conference - Association for Computational Linguistics. Meeting
  31. Memorisation versus Generalisation in Pre-trained Language Models
    Michael Tänzer, Sebastian Ruder, Marek Rei · 2022 · Proceedings of the conference - Association for Computational Linguistics. Meeting
  32. Survey of Vulnerabilities in Large Language Models Revealed by Adversarial Attacks
    Erfan Shayegani, Mamun, Md Abdullah Al, Fu, Yu, Pedram Zaree, Yue Dong, Nael Abu‐Ghazaleh · 2023 · arXiv (Cornell University)
  33. Transcending Scaling Laws with 0.1% Extra Compute
    Yi Tay, Jason Wei, Hyung Won Chung, Vinh Tran, David R. So, Siamak Shakeri, Xavier Garcia, Steven Zheng, Jinfeng Rao, Aakanksha Chowdhery et al. · 2023 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  34. CoLT5: Faster Long-Range Transformers with Conditional Computation
    Joshua Ainslie, Tao Lei, Michiel de Jong, Santiago Ontañón, Siddhartha Brahma, Yury Zemlyanskiy, David Uthus, Mandy Guo, James Lee-Thorp, Yi Tay et al. · 2023 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  35. Diagnostic and Prognostic Value of Protein Post-Translational Modifications in Hepatocellular Carcinoma
    Jing Wang, Fangfang Wang, Ning Wang, Mei‐Yin Zhang, Hui‐Yun Wang, Guoliang Huang · 2023 · Journal of Clinical and Translational Hepatology
  36. PIQA: Reasoning about Physical Commonsense in Natural Language
    Bisk, Yonatan, Zellers, Rowan, Le bras, Ronan, Gao, Jianfeng, Choi, Yejin · 2020 · Proceedings of the AAAI Conference on Artificial Intelligence
  37. Large language model (LLM)-driven chatbots for neuro-ophthalmic medical education
    Ethan Waisberg, Joshua Ong, Mouayad Masalkhi, Andrew G. Lee · 2023 · Eye
  38. Proceedings of the 2022 ACM Conference on Information Technology for Social Good
    2022
  39. Transparency Guidance for ChatGPT Usage in Scientific Writing
    Aczel, Balazs, Wagenmakers, Eric-Jan · 2023
  40. Using Large Language Models to Support Thematic Analysis in Empirical Legal Studies
    Jakub Drápal, Hannes Westermann, Jaromír Šavelka · 2023 · SSRN Electronic Journal
  41. Dynosaur: A Dynamic Growth Paradigm for Instruction-Tuning Data Curation
    Yin Da, Xiao Liu, Fan Yin, Ming Zhong, Hritik Bansal, Jiawei Han, Kai-Wei Chang · 2023 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  42. It’s All in the Heads: Using Attention Heads as a Baseline for Cross-Lingual Transfer in Commonsense Reasoning
    Alexey Tikhonov, Max Ryabinin · 2021 · Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
  43. Limits to Depth Efficiencies of Self-Attention
    Yoav Levine, Noam Wies, Or Sharir, Hofit Bata, Amnon Shashua · 2020 · arXiv (Cornell University)
  44. Can Large Language Models Explain Themselves? A Study of LLM-Generated Self-Explanations
    Huang, Shiyuan, Mamidanna, Siddarth, Jangam, Shreedhar, Zhou, Yilun, Gilpin, Leilani H. · 2023 · arXiv
  45. Shall We Pretrain Autoregressive Language Models with Retrieval? A Comprehensive Study
    Wang, Boxin, Ping, Wei, Xu, Peng, McAfee, Lawrence, Liu, Zihan, Shoeybi, Mohammad, Dong, Yi, Kuchaiev, Oleksii, Li, Bo, Xiao, Chaowei et al. · 2023 · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
  46. Proceedings of the 3rd International Workshop on Natural Language Generation from the Semantic Web (WebNLG+)
    Thiago Castro Ferreira, Claire Gardent, Nikolai Ilinykh, Chris van der Lee, Simon Mille, Diego Moussallem, Anastasia Shimorina · 2020 · HAL
  47. PROST: Physical Reasoning about Objects through Space and Time
    Stéphane Aroca-Ouellette, Cory Paik, Alessandro Roncone, Katharina Kann · 2021 · Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
  48. Exploring the Impacts of ChatGPT on Future Scientific Work
    Jessica L. Irons, Claire Mason, Patrick S. Cooper, Sidra Sidra, Andrew F. Reeson, Cécile L. Paris · 2023
  49. A Sentence Cloze Dataset for Chinese Machine Reading Comprehension
    Yiming Cui, Ting Liu, Ziqing Yang, Zhipeng Chen, Wentao Ma, Wanxiang Che, Shijin Wang, Guoping Hu · 2020 · International Conference on Computational Linguistics
  50. You are What You Write: Preserving Privacy in the Era of Pre-Trained Language Models
    Richard Plant, Mario Valerio Giuffrida, Dimitra Gkatzia · 2023 · SSRN Electronic Journal
  51. Blow the Dog Whistle: A Chinese Dataset for Cant Understanding with Common Sense and World Knowledge
    Canwen Xu, Wangchunshu Zhou, Tao Ge, Ke Xu, Julian McAuley, Furu Wei · 2021 · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
  52. AlphaTuning: Quantization-Aware Parameter-Efficient Adaptation of Large-Scale Pre-Trained Language Models
    Se Jung Kwon, Jeonghoon Kim, Jeongin Bae, Kang Min Yoo, Jin-Hwa Kim, Baeseong Park, Byeongwook Kim, Jung-Woo Ha, Nako Sung, Dongsoo Lee · 2022 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
  53. Structured Pruning for Efficient Generative Pre-trained Language Models
    Chaofan Tao, Lu Hou, Haoli Bai, Jiansheng Wei, Xin Jiang, Qun Liu, Ping Luo, Ngai Wong · 2023 · Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
  54. MATINF: A Jointly Labeled Large-Scale Dataset for Classification, Question Answering and Summarization
    Canwen Xu, Jiaxin Pei, Hongtao Wu, Yiyu Liu, Chenliang Li · 2020 · Proceedings of the conference - Association for Computational Linguistics. Meeting
  55. Correction: Exploring the potential of Chat-GPT as a supportive tool for sialendoscopy clinical decision making and patient information support
    Carlos Miguel Chiesa-Estomba, Jerome Rene Lechien, Luigi Angelo Vaira, Aina Brunet, Giovanni Cammaroto, Miguel Mayo‐Yáñez, Álvaro Sánchez Barrueco, Carlos Saga-Gutiérrez · 2023 · European Archives of Oto-Rhino-Laryngology
  56. Real-Time Execution of Large-scale Language Models on Mobile
    Wei Niu, Zhenglun Kong, Geng Yuan, Weiwen Jiang, Jiexiong Guan, Caiwen Ding, Pu Zhao, Sijia Liu, Bin Ren, Yanzhi Wang · 2020 · arXiv (Cornell University)
  57. Does ChatGPT Help Us Understand the Medical Literature?
    Kevin V. Lemley · 2023 · Journal of the American Society of Nephrology
  58. Artificial intelligence technology
    Jianjun Zhang, Jing Li · 2023 · Elsevier eBooks