Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

Liu, Pengfei, Yuan, Weizhe, Fu, Jinlan, Jiang, Zhengbao, Hayashi, Hiroaki, Neubig, Graham·2023·ACM Computing Surveys

DOI 10.1145/3560815

Cited by (3,933)

Items 1,201–1,300 of 3,933

“This is human intelligence debugging artificial intelligence”: Examining how people prompt GPT in seeking mental health support
Zhuoyang Li, Zihao Zhu, Xinning Gui, Yuhan Luo · 2025 · International Journal of Human-Computer Studies
On the Utility of Domain Modeling Assistance with Large Language Models
Meriem Ben Chaaben, Loli Burgueño, István Dávid, Houari A. Sahraoui · 2025 · ACM Transactions on Software Engineering and Methodology
Instruct or Interact? Exploring and Eliciting LLMs' Capability in Code Snippet Adaptation Through Prompt Engineering
Tanghaoran Zhang, Yue Yu, Xinjun Mao, Shangwen Wang, Kang Yang, Yao Lu, Zhang Zhang, Yuxin Zhao · 2025 · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion)
Deep learning-based in-ambulance speech recognition and generation of prehospital emergency diagnostic summaries using LLMs
Chen Chen, Yingying Hu, Wenwei Cai, Huibin Pan, Min Shen, Yujie Zhai, Sucy X. Wu, Qunyi Zhou, Yi Guo · 2025 · International Journal of Medical Informatics
A quasi-experimental analysis of capabilities and limitations of generative AI in academic content evaluation in social sciences
Yu Zhu, Yongrong Lu, Huan Xin Xie, Jiyuan Ye, Ming Chen · 2025 · Information Processing & Management
PromptNavi: Text-to-image generation through interactive prompt visual exploration
Bofei Huang, Haoran Xie · 2025 · Computers & Graphics
Large Language Models for computer networking operations and management: A survey on applications, key techniques, and opportunities
Fan Liu, Behrooz Farkiani, Patrick Crowley · 2025 · Computer Networks
Enhancing Class Understanding Via Prompt-Tuning For Zero-Shot Text Classification
Yuhao Dan, Jie Zhou, Qin Chen, Qingchun Bai, Liang He · 2022 · IEEE International Conference on Acoustics Speech and Signal Processing
PromptAttack: Prompt-Based Attack for Language Models via Gradient Search
Yundi Shi, Piji Li, Changchun Yin, Zhaoyang Han, Lu Zhou, Zhe Liu · 2022 · Lecture notes in computer science
Compositional Prompting Video-language Models to Understand Procedure in Instructional Videos
Guyue Hu, Bin He, Hanwang Zhang · 2023 · Machine Intelligence Research
Can ChatGPT Understand Causal Language in Science Claims?
Yuheun Kim, Lu Guo, Bei Yu, Yingya Li · 2023 · Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis (WASSA)
À-la-carte Prompt Tuning (APT): Combining Distinct Data Via Composable Prompting
Benjamin Bowman, Alessandro Achille, Luca Zancato, Matthew Trager, Pramuditha Perera, Giovanni Paolini, Stefano Soatto · 2023 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
Learning to Name Classes for Vision and Language Models
Sarah Parisot, Yongxin Yang, Steven McDonagh · 2023 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
From lazy to rich to exclusive task representations in neural networks and neural codes
Matthew Farrell, Stefano Recanatesi, Eric Shea‐Brown · 2023 · Current Opinion in Neurobiology
End-to-End Procedural Level Generation in Educational Games with Natural Language Instruction
Vikram Kumaran, Dan Carpenter, Jonathan Rowe, Bradford Mott, James C. Lester · 2023 · IEEE Conference on Games (CoG)
Retrieval-Augmented Few-shot Text Classification
Guoxin Yu, Lemao Liu, Haiyun Jiang, Shuming Shi, Xiang Ao · 2023 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
TacoPrompt: A Collaborative Multi-Task Prompt Learning Method for Self-Supervised Taxonomy Completion
Hongyuan Xu, Ciyi Liu, Yuhang Niu, Yunong Chen, Xiangrui Cai, Yanlong Wen, Xiaojie Yuan · 2023 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
Image retrieval using unsupervised prompt learning and regional attention
Bo-Jian Zhang, Guanghai Liu, Zuoyong Li · 2023 · Expert Systems with Applications
Artificial intelligence model GPT4 narrowly fails simulated radiological protection exam
Grace E. Roemer, Anyi Li, Usman A. Mahmood, Lawrence T. Dauer, Michael B. Bellamy · 2024 · Journal of Radiological Protection
Adaptive Prompt Routing for Arbitrary Text Style Transfer with Pre-trained Language Models
Qingyi Liu, Jinghui Qin, Wenxuan Ye, Hao Lei Mou, Yuxuan He, Keze Wang · 2024 · Proceedings of the AAAI Conference on Artificial Intelligence
Self-Recovery Prompting: Promptable General Purpose Service Robot System with Foundation Models and Self-Recovery
Mimo Shirasaka, Tatsuya Matsushima, Soshi Tsunashima, Yuya Ikeda, Aoi Horo, So Ikoma, Chikaha Tsuji, Hikaru Wada, Tsunekazu Omija, Dai Komukai et al. · 2024 · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings
Knowledge Graph-Based Reinforcement Federated Learning for Chinese Question and Answering
Liang Xu, Tao Chen, Zhaoxiang Hou, Weishan Zhang, Chitin Hon, Xiao Wang, Di Wang, Long Chen, Wenyin Zhu, Yunlong Tian et al. · 2023 · IEEE Transactions on Computational Social Systems
Reasoning in Large Language Models Through Symbolic Math Word Problems
Vedant Gaur, Nikunj Saunshi · 2023 · Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
LAnoBERT : System Log Anomaly Detection based on BERT Masked Language Model
Yukyung Lee, Jina Kim, Pilsung Kang · 2021 · Applied Soft Computing
A deep generative model of the SARS-CoV-2 spike protein predicts future variants
Rahul M. Dhodapkar · 2023 · bioRxiv (Cold Spring Harbor Laboratory)
Perils and Opportunities in Using Large Language Models in Psychological Research
Suhaib Abdurahman, Mohammad Atari, Farzan Karimi-Malekabadi, Mona J. Xue, Jackson P. Trager, Peter Seho Park, Preni Golazizian, Ali Omrani, Morteza Dehghani · 2023 · OSF Preprints (OSF Preprints)
Position Papers for the ASCR Workshop on Basic Research Needs in Quantum Computing and Networking
Pavel Lougovski, Ojas Parekh, Joe Broz, Mark Byrd, Yanne K. Chembo, Wibe Albert de Jong, Eden V. Figueroa, Travis S. Humble, Jeffrey M. Larson, Greg Quiroz et al. · 2023 · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information)
On the Robustness of Dialogue History Representation in Conversational Question Answering: A Comprehensive Study and a New Prompt-based Method
Gekhman, Zorik, Oved, Nadav, Keller, Orgad, Szpektor, Idan, Reichart, Roi · 2023 · Transactions of the Association for Computational Linguistics
Prompt-based fine-tuning with multilingual transformers for language-independent sentiment analysis
Faizad Ullah, Safiullah Faizullah, Imdadullah Khan, Turki G. Alghamdi, Toqeer Ali Syed, Ahmad B. Alkhodre, Muhammad Sohaib Ayub, Asim Karim · 2025 · Scientific Reports
Impact of Prompt Engineering on the Performance of ChatGPT Variants Across Different Question Types in Medical Student Examinations: Cross-Sectional Study
Ming-Yu Hsieh, Tzu-Ling Wang, Pen-Hua Su · 2025 · JMIR Medical Education
Lessons and Insights from a Unifying Study of Parameter-Efficient Fine-Tuning (PEFT) in Visual Recognition
Zheda Mai, Ping Zhang, Cheng-Hao Tu, Hong-You Chen, Quang-Huy Nguyen, Li Zhang, Wei‐Lun Chao · 2025 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
NeuroSync: Intent-Aware Code-Based Problem Solving via Direct LLM Understanding Modification
Wenshuo Zhang, Leixian Shen, Shuchang Xu, Jindu Wang, Jian Zhao, Huamin Qu, Lin-Ping Yuan · 2025 · ACM Symposium on User Interface Software and Technology (UIST)
Evaluating Large Language Models for Sentiment Analysis and Hesitancy Analysis on Vaccine Posts From Social Media: Qualitative Study
Augustine Annan, Amanda L Eiden, Dong Wang, Jingcheng Du, Majid Rastegar-Mojarad, Varun Kumar Nomula, Xiaoyan Wang · 2025 · JMIR Formative Research
Crop GraphRAG: pest and disease knowledge base Q&A system for sustainable crop protection
H. Wu, Nengfu Xie, Xiaoli Wang, Jingchao Fan, Yonglei Li, Zhibo Meng · 2026 · Frontiers in Plant Science
Explainable Generative AI: A Two-Stage Review of Existing Techniques and Future Research Directions
Prabha M. Kumarage, Mirka Saarela · 2026 · AI
Online Handwritten Chinese Character Recognition Based on 1-D Convolution and Two-Streams Transformers
Y J Chen, Hao Zheng, Yanchun Li, Wanli Ouyang, Jiang Zhu · 2023 · IEEE Transactions on Multimedia
Failures Pave the Way: Enhancing Large Language Models through Tuning-free Rule Accumulation
Zeyuan Yang, Peng Li, Yang Liu · 2023 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
Git Merge Conflict Resolution Leveraging Strategy Classification and LLM
Chaochao Shen, Wenhua Yang, Minxue Pan, Yu Zhou · 2023 · IEEE International Conference on Software Quality, Reliability and Security (QRS)
Turning Large Language Models into AI Assistants for Startups Using Prompt Patterns
Xiaofeng Wang, Muhammad Attal Idris, Usman Rafiq, Sylvia Hubner · 2023 · Lecture notes in business information processing
Domain-Enhanced Prompt Learning for Chinese Implicit Hate Speech Detection
Yaosheng Zhang, Tiegang Zhong, Tingjun Yi, Haoming Li · 2024 · IEEE Access
Open Set Video HOI detection from Action-centric Chain-of-Look Prompting
Nan Xi, Jingjing Meng, Junsong Yuan · 2023 · IEEE/CVF International Conference on Computer Vision (ICCV)
Test-Time Personalization with Meta Prompt for Gaze Estimation
Huan Liu, Julia Qi, Zhenhao Li, Mohammad Hassanpour, Yang Wang, Konstantinos N. Plataniotis, Yuanhao Yu · 2024 · Proceedings of the AAAI Conference on Artificial Intelligence
From Raw Video to Pedagogical Insights: A Unified Framework for Student Behavior Analysis
Zefang Yu, Mingye Xie, Jingsheng Gao, Ting Liu, Yuzhuo Fu · 2024 · Proceedings of the AAAI Conference on Artificial Intelligence
C5: toward better conversation comprehension and contextual continuity for ChatGPT
Pan Liang, Danwei Ye, Zihao Zhu, Yunchao Wang, Xia Wang, Ronghua Liang, Guodao Sun · 2024 · Journal of Visualization
Towards More Practical Automation of Vulnerability Assessment
Shengyi Pan, Lingfeng Bao, Jiayuan Zhou, Xing Hu, Xin Xia, Shanping Li · 2024 · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion)
Supervised and Few-Shot Learning for Aspect-Based Sentiment Analysis of Instruction Prompt
Jie Huang, Yunpeng Cui, Juan Liu, Ming Liu · 2024 · Electronics
From Conversational Web to Inclusive Conversations with LLMs
Emanuele Pucci, Ludovica Piro, Salvatore Andolina, Maristella Matera · 2024 · International Conference on Advanced Visual Interfaces (AVI)
Unlocking underrepresented use-cases for large language model-driven human-robot task planning
Selma Wanna, Fabian Parra, R. Valner, Karl Kruusamäe, Mitch Pryor · 2024 · Adv. Robotics
Few-shot relational triple extraction with hierarchical prototype optimization
Chen Gao, Xuan Zhang, Zhi Gang Jin, Weiyi Shang, Yubin Ma, Linyu Li, Zishuo Ding, Yuqin Liang · 2024 · Pattern Recognition
EAFL: Equilibrium Augmentation Mechanism to Enhance Federated Learning for Aspect Category Sentiment Analysis
Khwaja Mutahir Ahmad, Qiao Liu, Abdullah Aman Khan, Yanglei Gan, Run Lin · 2024 · Expert Systems with Applications
ProCom: A Few-shot Targeted Community Detection Algorithm
Xixi Wu, Kaiyu Xiong, Yun Xiong · 2024 · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD)
Extraction and classification of structured data from unstructured hepatobiliary pathology reports using large language models: a feasibility study compared with rules-based natural language processing
Ruben Geevarghese, Carlie Sigel, John A. Cadley, Subrata Chatterjee, Pulkit Jain, Alex Hollingsworth, Avijit Chatterjee, Nathaniel Swinburne, Khawaja Hasan Bilal, Brett S. Marinelli · 2024 · Journal of Clinical Pathology
Large Language Models (LLMs) as a Tool to Facilitate Information Seeking Behavior
Nishith Reddy Mannuru, Aashrith Mannuru, Brady Daniel Lund · 2024 · InfoScience Trends
Leveraging ChatGPT to Predict Requirements Testability with Differential In-Context Learning
Mahima Dahiya, Rashminder Gill, Nan Niu, Hemanth Gudaparthi, Zedong Peng · 2024 · IEEE International Conference on Information Reuse and Integration (IRI)
MOAT: Graph Prompting for 3D Molecular Graphs
Qingqing Long, Yuchen Yan, Wentao Cui · 2024 · ACM International Conference on Information and Knowledge Management (CIKM)
Unlocking the Potential of Generative AI in Large Language Models
Sahil Warudkar, Rugved Jalit · 2024 · Parul International Conference on Engineering and Technology (PICET)
Multi-scale contrast approach for stock index prediction with adaptive stock fusion
Jianliang Gao, Shujin Wang, Changlong He, Chongyun Qin · 2024 · Expert Systems with Applications
LLM as Dataset Analyst: Subpopulation Structure Discovery with Large Language Model
Yulin Luo, Ruichuan An, Bocheng Zou, Yiming Tang, Jiaming Liu, Shanghang Zhang · 2024 · Lecture notes in computer science
Open-Ethical AI: Advancements in Open-Source Human-Centric Neural Language Models
Sabrina Sicari, Jesús Fernando Cevallos Moreno, Alessandra Rizzardi, Alberto Coen‐Porisini · 2024 · ACM Computing Surveys
Large Language Models for Link Stealing Attacks Against Graph Neural Networks
Faqian Guan, Tianqing Zhu, Hui Sun, Wanlei Zhou, Philip S. Yu · 2024 · IEEE Transactions on Big Data
CrossGLG: LLM Guides One-Shot Skeleton-Based 3D Action Recognition in a Cross-Level Manner
Tingbing Yan, Wenzheng Zeng, Yang Xiao, Xingyu Tong, Bo Tan, Zhiwen Fang, Zhiguo Cao, Joey Tianyi Zhou · 2024 · Lecture notes in computer science
Strongly concealed adversarial attack against text classification models with limited queries
Yao Cheng, Senlin Luo, Yunwei Wan, Limin Pan, Xinshuai Li · 2024 · Neural Networks
Utilizing Large Language Models for Hyper Knowledge Graph Construction in Mine Hoist Fault Analysis
Xiaoling Shu, Xiaochao Dang, Xiaohui Dong, Fenfang Li · 2024 · Symmetry
INSNER: A generative instruction-based prompting method for boosting performance in few-shot NER
Peiwen Zhao, Chong Feng, Peiguang Li, Guanting Dong, Sirui Wang · 2025 · Information Processing & Management
Knowledge-guided prompt-based continual learning: Aligning task-prompts through contrastive hard negatives
Hengyang Lu, Long-kang Lin, Chenyou Fan, Chongjun Wang, Wei Fang, Xiao‐Jun Wu · 2025 · Knowledge-Based Systems
Efficient fine-tuning of vision transformer via path-augmented parameter adaptation
Yao Zhou, Yi Zhang, Gary G. Yen · 2025 · Information Sciences
KG-prompt: Interpretable knowledge graph prompt for pre-trained language models
Liyi Chen, Jie Liu, Yutai Duan, Runze Wang · 2025 · Knowledge-Based Systems
Reliable Text-to-SQL with Adaptive Abstention
Chen, Kaiwen, Chen, Yueting, Koudas, Nick, Yu, Xiaohui · 2025 · Proceedings of the ACM on Management of Data
Exploring the Boundaries Between LLM Code Clone Detection and Code Similarity Assessment on Human and AI-Generated Code
Zixian Zhang, Takfarinas Saber · 2025 · Big Data and Cognitive Computing
Topic classification of case law using a large language model and a new taxonomy for UK law: AI insights into summary judgment
Holli Sargeant, Ahmed Izzidien, Felix Steffek · 2025 · Artificial Intelligence and Law
Software Vulnerability Detection Using LLM: Does Additional Information Help?
Samiha Shimmi, Yash Saini, Mark Schaefer, Hamed Okhravi, Mona Rahimi · 2024 · Annual Computer Security Applications Conference Workshops (ACSAC Workshops)
Chat, Summary and Diagnosis: A LLM - Enhanced Conversational Agent for Interactive Depression Detection
Xiaoheng Zhang, Weigang Cui, Junjie Wang, Yang Li · 2024 · International Conference on Industrial Automation, Robotics and Control Engineering (IARCE)
An unsupervised approach towards promptable porosity segmentation In laser powder bed fusion by segment anything
Israt Zarin Era, Imtiaz Ahmed, Zhichao Liu · 2025 · npj Advanced Manufacturing
Federated Knowledge Distillation With 3D Transformer Adaptation for Weakly Labeled Multi-Organ Medical Image Segmentation
Tareq Mahmod Alzubi, Hamza Mukhtar · 2025 · IEEE Access
KERMIT: Knowledge graph completion of enhanced relation modeling with inverse transformation
Haotian Li, Bin Yu, Yu Wei, Kai Wang, Richard Yi Da Xu, Bailing Wang · 2025 · Knowledge-Based Systems
The Effectiveness of Large Language Models in Transforming Unstructured Text to Standardized Formats
William Brach, Kristián Košťál, Michal Ries · 2025 · IEEE Access
Comparing AI-generated and traditional textbook multiple-choice questions in nursing education: A prompt engineering-based Delphi study
Youbei Lin, Chuang Li, Hongyu Li · 2025 · Medical Teacher
Large Language Models Merging for Enhancing the Link Stealing Attack on Graph Neural Networks
Faqian Guan, Tianqing Zhu, Wenhan Chang, Wei Ren, Wanlei Zhou · 2025 · IEEE Transactions on Dependable and Secure Computing
EEG-SKDNet: A Self-Knowledge Distillation Model With Scaled Weights for Emotion Recognition From EEG Signals
Thuong Duong Thi Mai, Duc-Quang Vu, Huy Nguyen Phuong, Trung-Nghia Phung · 2025 · IEEE Access
Understanding Learner-LLM Chatbot Interactions and the Impact of Prompting Guidelines
Cansu Koyutürk, Emily Theophilou, Sabrina Patania, Gregor Donabauer, Andrea Martinenghi, Chiara Antico, Alessia Telari, Alessia Testa, Sathya Buršić, Franca Garzotto et al. · 2025 · Lecture notes in computer science
Source-free domain adaptation using prompt learning for medical image segmentation
Shishuai Hu, Zehui Liao, Yong Xia · 2025 · Pattern Recognition
Addressing data scarcity in multilingual fake news detection: an LLM-based dataset augmentation approach
Razieh Chalehchaleh, Reza Farahbakhsh, Noël Crespi · 2025 · Social Network Analysis and Mining
Improving Pre-trained Language Models
Gerhard Paaß, Sven Giesselbach · 2023 · Artificial intelligence: foundations, theory, and algorithms/Artificial intelligence: Foundations, theory, and algorithms
Prompt-based for Low-Resource Tibetan Text Classification
Bo An · 2023 · ACM Transactions on Asian and Low-Resource Language Information Processing
Incorporating entity-level knowledge in pretrained language model for biomedical dense retrieval
Jiajie Tan, Jinlong Hu, Shoubin Dong · 2023 · Computers in Biology and Medicine
Enhancing In-Context Learning with Answer Feedback for Multi-span Question Answering
Zixian Huang, Jiaying Zhou, Gengyang Xiao, Gong Cheng · 2023 · Lecture notes in computer science
Predictive Prompts with Joint Training of Large Language Models for Explainable Recommendation
Ching-Sheng Lin, Chung-Nan Tsai, Shao-Tang Su, Jung‐Sing Jwo, Cheng‐Hsiung Lee, Xin Eric Wang · 2023 · Mathematics
Enhancing conversational recommender systems via multi-level knowledge modeling with semantic relations
Yulin Wang, Yihao Zhang, Junlin Zhu, Weiwen Liao, Meng Yuan, Wei Guo Zhou · 2023 · Knowledge-Based Systems
GROVE: A Retrieval-augmented Complex Story Generation Framework with A Forest of Evidence
Zhihua Wen, Zhiliang Tian, Wei Wu, Yuxin Yang, Yanqi Shi, Zhen Huang, Dongsheng Li · 2023 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
Spatial and Temporal Awareness Network for Semantic Segmentation on Automotive Radar Point Cloud
Ziwei Zhang, Jun Liu, Guangfeng Jiang · 2023 · IEEE Transactions on Intelligent Vehicles
DE3TC: Detecting Events with Effective Event Type Information and Context
Boyang Liu, Guozheng Rao, Xin Wang, Li Zhang, Qing Cong · 2024 · Neural Processing Letters
Measuring Task Similarity and Its Implication in Fine-Tuning Graph Neural Networks
Renhong Huang, Jiarong Xu, Xin Jiang · 2024 · Proceedings of the AAAI Conference on Artificial Intelligence
Nature's lessons, AI's power: sustainable process design with generative AI
Mas’udah Mas’udah, Pavel Livotov · 2024 · Proceedings of the Design Society
A Steampunk Critique of Machine Learning Acceleration
Michele Cremaschi, Max Dorfmann, Antonella De Angeli · 2024 · Designing Interactive Systems Conference
Fairframe: a fairness framework for bias detection and mitigation in news
Dorsaf Sallami, Esma Aı̈meur · 2024 · AI and Ethics
Evidence Mining for Interpretable Charge Prediction via Prompt Learning
Lin Li, Dan Liu, Lingyun Zhao, Jianwei Zhang, Jinhang Liu · 2022 · IEEE Transactions on Computational Social Systems
Knowledge-aware document summarization: A survey of knowledge, embedding methods and architectures
Yutong Qu, Wei Emma Zhang, Jian Yu Yang, Lingfei Wu, Jia Xin Wu · 2022 · Knowledge-Based Systems
A Few-Shot Approach to Resume Information Extraction via Prompts
Chengguang Gan, Tatsunori Mori · 2023 · Lecture notes in computer science
Enhancing Chinese Address Parsing in Low-Resource Scenarios through In-Context Learning
Guangming Ling, Xiaofeng Mu, Chao Wang, Aiping Xu · 2023 · ISPRS International Journal of Geo-Information
GPT Struct Me: Probing GPT Models on Narrative Entity Extraction
Hugo Sousa, Nuno Guimar�ães, Alípio Jorge, Ricardo Campos · 2023 · IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT)