A Multi-Task Role-Playing Agent Capable of Imitating Character Linguistic Styles

“To satisfy fundamental psychological needs of human such as love and belonging (Maslow, 1943), these models are deployed as Role-Playing Agents (RPAs) (Li et al., 2023; Zhou et al., 2023; Wang et al., 2024b), engaging in meaningful dialogues with users by skillfully simulating a variety of…”

“We anticipate that this research will establish a solid foundation for future inquiries into large-scale model-based role-playing challenges and foster advancements in more versatile RPAs.”

“We consider baselines of three genres:(1) Open-source Large Language Models(LLMs) including ChatGLM3-6B (GLM, 2024), Yi-6B-Chat (AI et al., 2024).”

“We utilized GPT as the evaluator, as its reliability has been demonstrated (Fu et al., 2023; Gilardi et al., 2023).”

“Persona-based dialogue datasets (Zhang et al., 2018; Di-nan et al., 2019; Xu et al., 2022) are constructed through interactions between two human speakers, each providing approximately five sentences to describe their persona traits, which are then reflected in the subsequent dialogue.”

“…accurately mimic the character’s linguistic style to simulate specific characters more accurately and authentically, as personalized linguistic style is critical in daily interactions and creation (Leech and Short, 2007) and lacking linguistic style could reduce user engagement and credibility.”

“Recent research advanced the key capabilities of large-scale language models (LLMs) within the field of RPAs (Park et al., 2023; Shanahan et al., 2023; Wang et al., 2024a) .”

“These agents can assume various roles by effectively simulating role data (Tu et al., 2024; Wang et al., 2024b), which is derived from prompt contexts, training sets, or external databases.”

“To further enhance the capabilities of RPAs, researchers have integrated retrieval-augmented methods; for example, Salemi et al. (2024) combined role-playing model training with retrieval information to improve agent performance in role-playing tasks.”

“Existing studies have enhanced RPAs’ performance by setting role descriptions as system prompts (Li et al., 2023; Tu et al., 2023).”

“The focus was on maintaining consistency between persona attributes and the generated responses (Cheng et al., 2023; Chen et al., 2023).”

“Persona-based dialogue datasets (Zhang et al., 2018; Di-nan et al., 2019; Xu et al., 2022) are constructed through interactions between two human speakers, each providing approximately five sentences to describe their persona traits, which are then reflected in the subsequent dialogue.”

“Although these studies explored character-related issues in dialogue, the personas used are often limited to basic personal details such as name, age, and experience (Jang et al., 2022; Gao et al., 2023).”

“45.1 42.2 47.4 45.5 48.7 49.5 56.0 47.8 ChatGLM3-6B 3.6 9.0 10.8 10.9 12.2 7.8 13.8 9.7 Yi-6B-Chat 4.6 11.3 12.2 14.6 16.0 8.5 17.7 12.1 ChatPLUG 2.6 3.7 6.0 8.9 10.1 9.1 12.9 7.6 CharacterGLM-6B 6.9 12.6 14.9 12.0 9.8 10.9 19.3 12.3 StyleRPA 54.9 57.8 52.6 54.5 51.3 50.5 44.0 52.2 data for each task were entirely new.”

“Inspired by the multi-task training paradigm adopted by previous RPAs (Du et al., 2024; Lu et al., 2024), we devise a two-scenario instruction fine-tuning framework based on potential real-world user inputs and choose Qwen2-7B-Base as the backbone to develop a multi-tasks RPA named StyleRPA.”

“The focus was on maintaining consistency between persona attributes and the generated responses (Cheng et al., 2023; Chen et al., 2023).”

“Unfortunately, existing datasets(Chen et al., 2024; Zhou et al., 2023; Gao et al., 2023) for character typically consist of fictional characters and contain only basic information.”

“(2) Open-source Character Large Language Model(CLLMs) including CharacterGLM-6B (Zhou et al., 2023), ChatPLUG (Tian et al., 2023).”

“Our evaluator’s prompts were slightly modified from the AlpacaEval prompts, focusing on the similarity of the character’s linguistic style and the accuracy of the generated responses.”

“We anticipate that this research will establish a solid foundation for future inquiries into large-scale model-based role-playing challenges and foster advancements in more versatile RPAs.”

“Furthermore, the applications of RPAs have also expanded from single interactions to multi-character social simulations, interactive drama generation [20, 21], and multi-task RPAs [22].”

“Additionally, role-playing applications have expanded to multi-character (Chen et al., 2024a), drama (Han et al., 2024; Wu et al., 2024) and multi-task (Chen et al., 2024c).”

“…LoRA-based methods (Gao et al., 2024; Gu et al., 2025a; Liu et al., 2024a; Gu et al., 2025b) and orthogonal fine-tuning (OFT) (Qiu et al., 2024; Liu et al., 2024d; Ma et al., 2024; Chen et al., 2024), and our method of adding parameter regularization is relatively similar to the OFT method.”

“Following the trend, Chen et al. (2024b) developed StyleRPA, a role-playing agent capable of up to 8 different categories of tasks.”

“The result is a clear instance of over-performative personality , where models mimic idealized personas that lack authenticity and flexibility (Chen et al., 2024b).”

“With the substantial leap in the capabilities of generative models, the research focus gradually shifts to the response generation sub-task (Zhao et al. 2020a; Liu et al. 2021; Zhao et al. 2020b; Zheng, Milic-Frayling, and Zhou 2021; Chen et al. 2024).”

“Training-free approaches include prompt engineering (Ge et al., 2023), agents (Chen et al., 2024b) and composing or biasing existing LLMs Dekoninck et al. (2024).”

“Recent efforts enhance RPAs’ fidelity to a character’s linguistic style (Chen et al. 2024), extend them to multi-character settings (Yu et al. 2024), and support configurable or customizable characters (He et al. 2025; Wang et al. 2025).”