PIPPA: A Partially Synthetic Conversational Dataset
Open accessAbstract
With the emergence of increasingly powerful large language models, there is a burgeoning interest in leveraging these models for casual conversation and role-play applications. However, existing conversational and role-playing datasets often fail to capture the diverse and nuanced interactions typically exhibited by real-world role-play participants. To address this limitation and contribute to the rapidly growing field, we introduce a partially-synthetic dataset named PIPPA (Personal Interaction Pairs between People and AI). PIPPA is a result of a community-driven crowdsourcing effort involving a group of role-play enthusiasts. The dataset comprises over 1 million utterances that are distributed across 26,000 conversation sessions and provides a rich resource for researchers and AI developers to explore and refine conversational AI systems in the context of role-play scenarios.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
PIPPA's character prompts are free-form descriptions with varying quality and length.
“Another issue present in PIPPA is that the character prompts are free-form descriptions with varying quality and length.”
From Post-Thinking in NPC Dialogue: A Paradigm for Reflective Character Models (2026) · cites this paper as [2]
The Introduction says each character’s persona is delineated through free-text descriptions, supporting the free-form part of the claim. The paper does not establish that those descriptions vary in quality or length; §3.2 analyzes the length of conversation messages, not character prompts. (LLM, conf=0.86)
Experimental — accuracy not yet measuredPIPPA is a general role-playing dataset, and pippa_filtered is a post-processed version removing most of the NSFW content.
“PIPPA [2] is a general role-playing dataset, and pippa_filtered is a post-processed version, removing most of the NSFW content.”
From Post-Thinking in NPC Dialogue: A Paradigm for Reflective Character Models (2026) · cites this paper as [2]
The Abstract and Introduction describe PIPPA as a dataset for varied role-play scenarios, supporting the first part of the claim. Our copy does not identify pippa_filtered or say that a post-processed version removes most NSFW content; the Ethics Statement discusses possible inappropriate material and redaction of personal information instead. (LLM, conf=0.86)
Experimental — accuracy not yet measuredPIPPA has a diverse conversation length from 4 turns to as long as 11,491.
“PIPPA has a diverse conversation length from 4 turns to as long as 11,491.”
From Post-Thinking in NPC Dialogue: A Paradigm for Reflective Character Models (2026) · cites this paper as [2]
Section 3.1 (Conversation Length; page not specified) describes a diverse range of conversation lengths and states that the longest contains 11,491 turns. It does not give 4 turns as the shortest length, so the claimed lower bound is unsupported by our copy. (LLM, conf=0.88)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
No references could be resolved yet.
Research works printed but not linked: 7
- Cristian Danescu-Niculescu-Mizil and Lillian Lee. 2011. Chameleons in imagined conver- sations: A new approach to understanding coordination of linguistic style in dialogs. In Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics, ACL 2011.
- Matthew Henderson, Pawe l Budzianowski, Iñigo Casanueva, Sam Coope, Daniela Gerz, Girish Kumar, Nikola Mrkšić, Georgios Spithourakis, Pei-Hao Su, Ivan Vulic, and Tsung-Hsien Wen. 2019. A repository of conversational datasets. In Proceedings of the Workshop on NLP for Conversational AI. Data available at github.com/PolyAI- LDN/conversational-datasets.
- Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al. 2022. Training lan- guage models to follow instructions with human feedback. Advances in Neural Informa- tion Processing Systems, 35:27730-27744.
- Yida Wang, Pei Ke, Yinhe Zheng, Kaili Huang, Yong Jiang, Xiaoyan Zhu, and Minlie Huang. 2020. A large-scale chinese short-text conversation dataset. In Natural Language Processing and Chinese Computing: 9th CCF International Conference, NLPCC 2020, Zhengzhou, China, October 14-18, 2020, Proceedings, Part I 9, pages 91-103. Springer.
- Saizheng Zhang, Emily Dinan, Jack Urbanek, Arthur Szlam, Douwe Kiela, and Jason We- ston. 2018. Personalizing dialogue agents: I have a dog, do you have pets too? In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 2204-2213.
- Yinhe Zheng, Guanyi Chen, Minlie Huang, Song Liu, and Xuan Zhu. 2019. Personalized dialogue generation with diversified traits. arXiv preprint arXiv:1901.09672. · arXiv
- Chunting Zhou, Pengfei Liu, Puxin Xu, Srini Iyer, Jiao Sun, Yuning Mao, Xuezhe Ma, Avia Efrat, Ping Yu, Lili Yu, et al. 2023. Lima: Less is more for alignment. arXiv preprint arXiv:2305.11206. · arXiv
Cited by
Sorted by citations
Post-Thinking in NPC Dialogue: A Paradigm for Reflective Character Models
Carey, K., & Wang, H. (2026) · Proceedings of the 21st International Conference on the Foundations of Digital Games · doi:10.1145/3815598.3815681
- Authors
- Gosling, T., Dale, A., & Zheng, Y.
- ORCID
- Zheng, Yinhe
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2308.05884
- OpenAlex
- W4385825343
- Cited by
- 0
- References
- 0
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- arXiv (Cornell University) (submittedVersion, cc-by-sa)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › AI in Service Interactions
- Keywords
- conversational datasets, role play, human-AI interaction, crowdsourced data collection, conversational AI, large language models, everyday conversation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
