PTR: Prompt Tuning with Rules for Text Classification

“…al., 2020), summarization (Zhang et al., 2019; Liu and Lapata, 2019), question answering (Adiwardana et al., 2020), to text classification (Baldini Soares et al., 2019; Peng et al., 2020; Ding et al., 2021), fine-tuned PLMs have been demonstrated their effectiveness on almost all important NLP tasks.”

“To alleviate this issue, prompt tuning has been proposed to bridge the gap of objective forms in pre-training and fine-tuning (Brown et al., 2020; Schick et al., 2020).”

“, 2019), RoBERTa (Liu et al., 2019) and T5 (Raffel et al.”

“Recently, some continuous prompts have also been proposed (Li and Liang, 2021; Lester et al., 2021), which directly use a series of learnable continuous embeddings as prompt templates and get rid of the trouble of designing prompts.”

“Recently, some continuous prompts have also been proposed (Li and Liang, 2021; Lester et al., 2021), which directly use a series of learnable continuous embeddings as prompt templates and get rid of the trouble of designing prompts.”

“tasks such as natural language inference (Schick and Schütze, 2021; Liu et al., 2021).”

“, 2020), summarization (Zhang et al., 2019; Liu and Lapata, 2019), question answering (Adiwardana et al.”

“, 2021) and relation extraction (Han et al., 2021), also in low-resource languages (Hedderich et al.”

“By integrating symbol reasoning system into the learning pipeline, knowledge form unchanged KEPLMs reconcile the advantages of effective perception of PLMs and reasoning and interpretability of symbolic representation [29].”

“In particular, prompt-based text classification uses an identical projection from the probability distribution on label worlds to the probability distribution on classification classes and has achieved state-of-the-art results (Gao et al., 2021; Han et al., 2021b; Hu et al., 2022).”

“References [18], [19], [20], [21], and [22] transferred pretrained VLMs to various downstream tasks for image classification purposes.”

“They may exhibit a preference for specific prompt formats, paraphrases, or particular information contained in the input [6, 39].”

“Since then, numerous effective approaches have been developed for prompt learning [13,14].”

“Compared to manually designed prompts, continuous prompts (also referred to as soft prompts) are preferred due to their flexibility and scalability (Liu et al., 2021a,b; Han et al., 2021b).”

“Han et al. (2022) propose prompt-tuning methods for RE by applying logic rules to construct hierarchical prompts.”

“Han et al. incorporated logic rules into prompt designs, combining several simple sub-prompts according to these rules (Han et al., 2022).”

“Instead of explicit searching for the word sequences, continuous methods [17, 18, 27, 29, 36] aim to find a sequence of continuous embeddings that can be prepended to the embedded inputs.”

“Some researchers also introduce external knowledge to construct prompt templates (Han et al. 2022; Chen et al. 2022; Hu et al. 2022 ).”

“On the negative side, this paradigm faces challenges due to the disparity between pre-training and fine-tuning objectives, leading to inefficiencies in utilizing PLMs across diverse tasks, as they may be unstable in low-resource settings, and less transferable to new tasks after fine-tuning [ 7–10].”

“The hand-designed hard templates, which are composed of discrete words, are first employed in prompt-tuning and show the effectiveness [21], [22] for FSRE.”

“Some studies (Lester et al., 2021; Qin and Eisner, 2021; Li and Liang, 2021) proposed only tuning continuous prompts, while some works (Han et al., 2021; Zhong et al., 2021; Liu et al., 2021b; Chan et al., 2023b) explore combining discrete prompts and continuous prompts.”

“Hard prompt [10] is also named discrete prompt since it usually corresponds to natural language words in a discrete space [21].”

“To address the limitations of early systems, traditional credit scoring approaches were initially based on symbolic artificial intelligence and knowledge representation techniques [4].”

“This method has been proven to be helpful on various NLP tasks, including text classification (Han et al., 2021), entity typing (Ding et al., 2021), text generation (Li and Liang, 2021), and also multi-modal tasks (Tsimpoukelli et al., 2021).”

“Recently, Prefix-tuning (Li and Liang, 2021), P-tuningV2(Liu et al., 2021), PTR (Han et al., 2021), and soft-prompts (Qin and Eisner, 2021) propose continuous prompt construction, which introduce differential parameters to solve the issue.”

“In the relation classification task, prompt-based learning often involves inserting a prompt template containing masked tokens into the input, essentially converting the task into masked language modeling or text generation problems [7,13,14].”

“( Han et al., 2022) propose a model, called PTR, which creatively applies logic rules to construct prompts with several sub-prompts.”

“…of representative studies in prompting methods from four aspects: prompt template engineering [8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24], prompt answering engineering [25, 9, 26, 11, 10, 12, 27, 17, 28, 29, 30], and multi-turn prompting and multi-prompt learning…”

“Finally, training can be done in a few/zero-shot (Brown et al., 2020) or full-data setting (Han et al., 2021).”

“Prompting with constrained tuning Inspired by hard-soft prompt hybrid tuning (Han et al. 2021), prompting with constrained tuning is used to generate the token embedding by controlling the visible area of the augmented knowledge only to its corresponding entity mentions or column names.”

“2020; Ben-David, Oved, and Reichart 2021) or in a continuous space (Qin and Eisner 2021; Hambardzumyan, Khachatrian, and May 2021; Han et al. 2021; Liu et al. 2021b).”

“Recent works [60, 133] show that prompt learning can effectively leverage the knowledge encoded in the PLMs, especially for few-shot RE tasks in Section 4.1.2.”

“However, most of the studies focus on supervised or few-shot learning on text classification [12, 16, 18, 20], event detection [30], relation classification [6, 18] and name entity recognition [21, 29, 34].”

“LLMs, trained on vast text corpora, are promising in text classification, summarization, and knowledge retrieval(Han et al., 2022; Zhang et al., 2024b, 2019; Agrawal et al., 2023).”

“𝑜”

“There are also hybrid works to insert continuous embedding into discrete templates (Liu et al., 2021; Han et al., 2021).”

“…Gao et al., 2021, Ben-David et al., 2022, Su et al., 2022a, Diao et al., 2022, Datta et al., 2023, Pan et al., 2024] and continuous prompts [Hambardzumyan et al., 2021, Zhong et al., 2021, Han et al., 2021, Li and Liang, 2021, Qin and Eisner, 2021, Liu et al., 2021a] based on the format of prompts.”

“Since then, numerous prompt templates have been designed in various NLP domains, such as relation extraction [24], semantic parsing [25] and question answering [26].”

“As natural language prompts’ descriptive capability is limited, there is another branch of research studying continuous prompts (Li and Liang, 2021; Lester et al., 2021; Liu et al., 2021; Han et al., 2022; Hu et al., 2021) for fitting downstream tasks.”

“Many studies have been done to solve sentence-level RE where entities are within the same sentence, such as sequence-based methods (Zeng et al., 2014; Zhang et al., 2017), graph-based methods (Miwa and Bansal, 2016; Wu et al., 2019a), and PLMs based methods (Han et al., 2021; Zhou and Chen, 2021).”

“…recognition (Cui et al., 2021; Chen et al., 2021b; Zhou et al., 2021; Ma et al., 2022), entity typing (Ding et al., 2021), relation extraction (Han et al., 2021), event extraction (Hsu et al., 2021; Ye et al., 2021), sentiment analysis (Li et al., 2021), machine translation (Tan et al.,…”

“These range from prompt engineering (Petroni et al., 2019; Cui et al., 2021), to more advanced approaches such as prompt ensembling (Mao et al., 2021), composition (Han et al., 2021), or prompt-aware training methods (Lester et al., 2021; Gu et al., 2021).”

“Prompting means adding instructions and demos before input and output predictions to stimulate knowledge from PLMs. Recently, handcrafted prompts have achieved promising results in relation classification [40], entity typing [41], knowledge probing [42], natural language inference [43], and so on.”

“Moreover, the recent prompt-tuning techniques (Zhang et al., 2022) have been applied into the supervised RE task (Han et al., 2022b; Chen et al., 2022), achieving promising results.”

“Prompting Prompting can serve similar goals, but often requires human-picked prompt tokens (Keskar et al., 2019; Aghajanyan et al., 2021) or task-specific templates (Han et al., 2021; Chen et al., 2022), while metadata shaping provides a flexible baseline across metadata-types and task-types.”

“There are also various prompt tuning models for RE [11, 24] that incorporate different relation prompts to distill PLM’s relational knowledge for better reasoning performance.”

“Second, we want to check whether automatic prompt optimization can help achieve consistently good (though not necessarily optimal) results on all tasks without the need for manual tweaking by the experimenter.”

“The hard prompt [24, 25, 51] instruments the model input through the addition of fixed natural language elements, known as prompts.”

“Specifically, the prompt texts are of two types, discrete and continuous, which are concatenated into the raw data in the form of prefixes [28], [35] or cloze [36], [37].”

“Other directions feed prompts that capture the definition of the task and examples into encoder-decoder language models (Han et al., 2022b).”

“Han et al. (2021) proposed prompt-tuning with rules (PTR) which significantly outperformed state-of-the-art baselines for relation classification tasks.”

“Prompt tuning has received increasing attention recently (Radford et al., 2021; Yao et al., 2021) and has been successfully applied in many domains (Han et al., 2022; Liu et al., 2023b).”

“…for an optimal answer space and a map to the original output (Shin et al. 2020) and multi-prompt learning which involves prompt ensemble(Yuan, Neubig, and Liu 2021), prompt augmentation(Gao, Fisch, and Chen 2021), prompt composition(Han et al. 2021) and prompt decomposition(Cui et al. 2021).”

“Similarly, large generative models can be used to predict text classifications based on a given prompt (Han et al., 2022).”

“Recent works suggest prompt tuning (Shin et al., 2020; Schick and Schütze, 2021a; Ye et al., 2022; Gu et al., 2022; Han et al., 2022; Liu et al., 2023b) to be a plausible method for efficiently adapting abundant but general knowledge behind PLMs to various downstream tasks.”

“Considering that ECR is a complex task requiring reasoning, we construct our prompt by mixing multiple templates, similar to PTR (Han et al., 2022).”

“Although previous studies (Chen et al., 2020b; Han et al., 2021; Zhou and Chen, 2021) have also attempted to incorporate intermediate steps into language models, in the perspective of CoT, these methods lack both a decomposition process for tasks (not multi-step reasoning) and explicit use of…”

“Following several of the earliest works (Schick and Schütze, 2021a,b), prompting has been applied in various NLP tasks (Han et al., 2021b; Li and Liang, 2021; Sainz et al., 2021; Ding et al., 2021a).”

“[16] applied logic rules to construct prompts with several sub-prompts, effectively using prior knowledge from relation classification.”

“The most related prompt-based works to our task is prompt-based relation extraction (Chen et al., 2021; Han et al., 2021) and prompt-based knowledge base completion (Davison et al., 2019).”

“…PLMs to cloze-style prediction, autoregressive modeling, or sequence to sequence generation, resulting in promising performances on various tasks such as text classification (Liu et al., 2021; Gao et al., 2021), named entity typing (Ding et al., 2021a) and relation extraction (Han et al., 2021).”

“Emphasizing the key part of the prompt is a common skill in prompt-tuning for LLMs [43], [44], which encourages LLMs to focus on the critical aspects of our task.”

“Han et al. [60] introduced PTR, specifically, they proposed to encode the prior knowledge of a classification task into rules, then design sub-prompts according to the rules, and finally combine the sub-prompts to handle the task.”

“In addition, a series of works have employed learnable vectors as pseudo tokens injected into the input or hidden layers of models to participate in the attention computation of Transformer, known as soft prompts [14, 27, 28, 30, 31].”

“Subsequently, the PTR [1] model developed a set of sub-prompts that were later integrated into specific task prompts using logical rules.”

“For comparison, the typical R-BERT and PTR models were used in the fine-tuning and prompt-tuning paradigms, respectively.”

“As large language models are getting more and more popular in NLP research and application, DecT provides a cost-efficient way to adapt these large models.”

“Similar ideas have been used for learning prompts for relation classification (Han et al., 2021) and other NLP tasks (Crawford et al., 1996; Kiddon and Domin-gos, 2015; He et al., 2017; Tanchip et al., 2020).”

“As future work, we consider improving the reply sentiment prediction model – the bottleneck of the agent – by exploring different ways to incorporate retrieval augmentation methods [12] and prompt-based learning [4].”

“(2) Prompt engineering with structured domain knowledge (Aghajanyan et al. 2021, Chen et al. 2022, Han et al. 2021): in many NLP tasks, inputs may exhibit various structures (e.g., syntax trees or relational structures from relationship extraction); effectively expressing these structures in prompt…”

“One is to reverse the positions of two entities in an old relation (Han et al., 2021; Wang et al., 2022a).”

“Prompt-Tuning: Prompt-tuning (Brown et al., 2020; Zong et al., 2021; Lester et al., 2021; Han et al., 2021; Vu et al., 2022; Liang et al., 2022; Asai et al., 2022) is an efficient way to adapt pre-trained language models (PLMs) to downstream tasks without tuning the parameters of PLMs. Depending on…”

“Recent works add layer-wise adaptive prompt parameters (Qin and Eisner, 2021; Liu et al., 2021a), data-dependent mixture (Qin and Eisner, 2021) and hard-soft hybrid prompt (Han et al., 2021) based on adequate training data.”

“Then, prompt learning is proposed to solve this problem by filling the gap of objective forms between pre-training and fine-tuning (Brown et al., 2020; Han et al., 2021; Liu et al., 2021a; Ben-David et al.,”

“Han et al. [50] propose the PTR model, which constructs multiple sub-prompts through logical rules and incorporates prior human knowledge into the prompt-tuning process.”

“Both manually designed and rule-based PTR [ Han et al. , 2021] verbalizers perform poorly, indicating their lack of flexibility.”