PreprintCited by 12Speech and dialogue systemsTopic ModelingAI in Service Interactions

The DOI matches its DataCite record; 2 of the 2 references it cites were found in a registry or an index.

ChatHaruhi: Reviving Anime Character in Reality via Large Language Model

Open access

Abstract

Role-playing chatbots built on large language models have drawn interest, but better techniques are needed to enable mimicking specific fictional characters. We propose an algorithm that controls language models via an improved prompt and memories of the character extracted from scripts. We construct ChatHaruhi, a dataset covering 32 Chinese / English TV / anime characters with over 54k simulated dialogues. Both automatic and human evaluations show our approach improves role-playing ability over baselines. Code and data are available at https://github.com/LC1332/Chat-Haruhi-Suzumiya .

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2308.09597

Cites

2 of 2 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Our algorithm is role-playing Haruhi Suzumiya. Note that the user's questions are related but not identical to the original plot, while Chat Haruhi Suzumiya's answers can largely quote the original plot.
Figure 1 Our algorithm is role-playing Haruhi Suzumiya. Note that the user's questions are related but not identical to the original plot, while Chat Haruhi Suzumiya's answers can largely quote the original plot.CC-BY-SA · From the PDF
Figure 2 The statistics of the ChatHaruhi-54K dataset, showing 32 characters and 54,726 dialogues. The opaque bars indicate the original script data, while the translucent bars present simulated dialogues generated by models like Alpaca.
Figure 2 The statistics of the ChatHaruhi-54K dataset, showing 32 characters and 54,726 dialogues. The opaque bars indicate the original script data, while the translucent bars present simulated dialogues generated by models like Alpaca.CC-BY-SA · From the PDF
Figure 3 A blueprint of the complete ChatHaruhi system is given. Dialogues are first extracted from novels, TV shows etc. as reference exchanges D for each character, forming the core chatbot. Simulated dialogues are further generated by Alpaca-like models, training a 7B model. Thus, large models like ChatGPT and Claude can be used, or fine-tuned 7B models.
Figure 3 A blueprint of the complete ChatHaruhi system is given. Dialogues are first extracted from novels, TV shows etc. as reference exchanges D for each character, forming the core chatbot. Simulated dialogues are further generated by Alpaca-like models, training a 7B model. Thus, large models like ChatGPT and Claude can be used, or fine-tuned 7B models.CC-BY-SA · From the PDF
Figure 4 The core dialogue system of ChatHaruhi, comprising the system prompt, character memories D ( q, R ) retrieved for the user query q , and the dialogue history H .
Figure 4 The core dialogue system of ChatHaruhi, comprising the system prompt, character memories D ( q, R ) retrieved for the user query q , and the dialogue history H .CC-BY-SA · From the PDF
Figure 5 ChatHaruhi-54K covers 32 different Chinese and English characters.
Figure 5 ChatHaruhi-54K covers 32 different Chinese and English characters.CC-BY-SA · From the PDF
Figure 6 The 22k original exchanges for fine-tuning are extracted from movie scripts, skit scripts, TV shows and novels.
Figure 6 The 22k original exchanges for fine-tuning are extracted from movie scripts, skit scripts, TV shows and novels.CC-BY-SA · From the PDF
Figure 7 Massive simulated queries are generated with Alpaca-like. Detailed prompts given in Appendix.
Figure 7 Massive simulated queries are generated with Alpaca-like. Detailed prompts given in Appendix.CC-BY-SA · From the PDF
Figure 8 LLM generates full dialogues conditioned on the first utterance and history.
Figure 8 LLM generates full dialogues conditioned on the first utterance and history.CC-BY-SA · From the PDF

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 7

  1. Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. 2020. Language models are few-shot learners. Advances in neural information processing systems, 33:1877-1901.
  2. Mingda Chen, Jingfei Du, Ramakanth Pasunuru, Todor Mihaylov, Srini Iyer, Veselin Stoyanov, and Zor- nitsa Kozareva. 2022. Improving in-context few-shot learning via self-supervised training. In Proceedings of the 2022 Conference of the North American Chap- ter of the Association for Computational Linguistics: Human Language Technologies, pages 3558-3573, Seattle, United States. Association for Computational Linguistics. · DOI
  3. Avia Efrat, Uri Shaham, Dan Kilman, and Omer Levy. 2021. Cryptonite: A cryptic crossword benchmark for extreme ambiguity in language. In Proceedings of the 2021 Conference on Empirical Methods in Nat- ural Language Processing, pages 4186-4192, Online and Punta Cana, Dominican Republic. Association for Computational Linguistics. · DOI
  4. Ari Holtzman, Peter West, Vered Shwartz, Yejin Choi, and Luke Zettlemoyer. 2021. Surface form com- petition: Why the highest probability answer isn't always right. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Process- ing, pages 7038-7051, Online and Punta Cana, Do- minican Republic. Association for Computational Linguistics. · DOI · Paper page
  5. Arvind Neelakantan, Tao Xu, Raul Puri, Alec Rad- ford, Jesse Michael Han, Jerry Tworek, Qiming Yuan, Nikolas Tezak, Jong Wook Kim, Chris Hallacy, et al. 2022. Text and code embeddings by contrastive pre- training. arXiv preprint arXiv:2201.10005. · arXiv
  6. Ohad Rubin, Jonathan Herzig, and Jonathan Berant. 2022. Learning to retrieve prompts for in-context learning. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Tech- nologies, pages 2655-2671, Seattle, United States. Association for Computational Linguistics. · DOI · Paper page
  7. Hongjin Su, Jungo Kasai, Yizhong Wang, Yushi Hu, Mari Ostendorf, Wen-tau Yih, Noah A Smith, Luke Zettlemoyer, Tao Yu, et al. 2022. One embedder, any task: Instruction-finetuned text embeddings. arXiv preprint arXiv:2212.09741. · arXiv

Cited by

Sorted by citations

See all 12

Metadata

Authors
Li, C., Leng, Z., Yan, C., Shen, J., Wang, H., MI, W., Fei, Y., Feng, X., Yan, S., Wang, H., Zhan, L., Jia, Y., Wu, P., & Sun, H.
Venue
arXiv
Publisher
arXiv
Published
2023
ISSN
2331-8422 (ISSN-L)
OpenAlex
W4386044041
Cited by
12
References
2
Citations by year
2026: 2 · 2025: 6 · 2024: 3 · 2023: 1
Type
posted content
Language
en
Open access
Locations
  • arXiv (Cornell University) (submittedVersion, cc-by-sa)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
Keywords
anime characters, large language models, prompt engineering, simulated dialogue

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review