Avoidance Decoding for Diverse Multi-Branch Story Generation
Open accessAbstract
Large Language Models (LLMs) often generate repetitive and monotonous outputs, especially in tasks like story generation, due to limited creative diversity when given the same input prompt. To address this challenge, we propose a novel decoding strategy, Avoidance Decoding, that modifies token logits by penalizing similarity to previously generated outputs, thereby encouraging more diverse multi-branch stories. This penalty adaptively balances two similarity measures: (1) Concept-level Similarity Penalty, which is prioritized in early stages to diversify initial story concepts, and (2) Narrative-level Similarity Penalty, which is increasingly emphasized later to ensure natural yet diverse plot development. Notably, our method achieves up to 2.6 times higher output diversity and reduces repetition by an average of 30% compared to strong baselines, while effectively mitigating text degeneration. Furthermore, we reveal that our method activates a broader range of neurons, demonstrating that it leverages the model's intrinsic creativity.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Some work studies output variability via temperature scaling or decoding methods, but rarely distinguishes between stylistic variation, stochasticity, and knowledge diversity.
“Some work studies output variability via temperature scaling (Shur-Ofry et al., 2024;Peeperkorn et al., 2024) or decoding methods (Park et al., 2025;Su et al., 2022), but rarely distinguishes between stylistic variation, stochasticity, and knowledge diversity.”
From On Epistemic Diversity in Large Language Models (2026) · cites this paper as Park et al., 2025
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Still being checked.
Research works printed but not linked: 37
- Amal Alabdulkarim, Winston Li, Lara J Martin, and Mark O Riedl. 2021. Goal-directed story gen- eration: Augmenting generative language mod- els with reinforcement learning. arXiv preprint arXiv:2112.08593. · arXiv
- Esteban Garces Arias, Julian Rodemann, Meimingwei Li, Christian Heumann, and Matthias Aßenmacher. 2024. Adaptive contrastive search: Uncertainty- guided decoding for open-ended text generation. arXiv preprint arXiv:2407.18698. · arXiv
- Minwook Bae and Hyounghun Kim. 2024. Collective critics for creative story generation. arXiv preprint arXiv:2410.02428. · arXiv
- Satanjeev Banerjee and Alon Lavie. 2005. Meteor: An automatic metric for mt evaluation with improved cor- relation with human judgments. In Proceedings of the acl workshop on intrinsic and extrinsic evaluation measures for machine translation and/or summariza- tion, pages 65-72.
- Sourya Basu, Govardana Sachitanandam Ramachan- dran, Nitish Shirish Keskar, and Lav R Varshney. 2020. Mirostat: A neural text decoding algorithm that directly controls perplexity. arXiv preprint arXiv:2007.14966. · arXiv
- Yung-Sung Chuang, Yujia Xie, Hongyin Luo, Yoon Kim, James Glass, and Pengcheng He. 2023. Dola: Decoding by contrasting layers improves factu- ality in large language models. arXiv preprint arXiv:2309.03883. · arXiv
- Angela Fan, Mike Lewis, and Yann Dauphin. 2018. Hierarchical neural story generation. arXiv preprint arXiv:1805.04833. · arXiv
- Parsa Ghaffari and Chris Hokamp. 2025. Narra- tive studio: Visual narrative exploration using llms and monte carlo tree search. arXiv preprint arXiv:2504.02426. · arXiv
- YiQiu Guo, Yuchen Yang, Zhe Chen, Pingjie Wang, Yusheng Liao, Ya Zhang, Yanfeng Wang, and Yu Wang. 2025. Dsvd: Dynamic self-verify decod- ing for faithful generation in large language models. arXiv preprint arXiv:2503.03149. · arXiv
- Chris Hokamp and Qun Liu. 2017. Lexically con- strained decoding for sequence generation using grid beam search. arXiv preprint arXiv:1704.07138. · arXiv
- Ari Holtzman, Jan Buys, Li Du, Maxwell Forbes, and Yejin Choi. 2019. The curious case of neural text degeneration. arXiv preprint arXiv:1904.09751. · arXiv
- Runsheng Huang, Lara J Martin, Chris Callison-Burch, et al. 2024. What-if: Exploring branching narratives by meta-prompting large language models. arXiv preprint arXiv:2412.10582. · arXiv
- Corinna Jaschek, Tom Beckmann, Jaime A Garcia, and William L Raffe. 2019. Mysterious murder-mcts- driven murder mystery generation. In 2019 IEEE Conference on Games (CoG), pages 1-8. IEEE.
- Minbeom Kim, Kang-il Lee, Seongho Joo, Hwaran Lee, Thibaut Thonet, and Kyomin Jung. 2025. Drift: Decoding-time personalized alignments with implicit user preferences. arXiv preprint arXiv:2502.14289. · arXiv
- Robert Kirk, Ishita Mediratta, Christoforos Nalmpantis, Jelena Luketina, Eric Hambro, Edward Grefenstette, and Roberta Raileanu. 2023. Understanding the ef- fects of rlhf on llm generalisation and diversity. arXiv preprint arXiv:2310.06452. · arXiv
- Arash Lagzian, Srinivas Anumasa, and Dianbo Liu. 2025. Multi-novelty: Improve the diversity and nov- elty of contents generated by large language models via inference-time multi-views brainstorming. arXiv preprint arXiv:2502.12700. · arXiv
- Xiang Lisa Li, Ari Holtzman, Daniel Fried, Percy Liang, Jason Eisner, Tatsunori Hashimoto, Luke Zettle- moyer, and Mike Lewis. 2022. Contrastive decoding: Open-ended text generation as optimization. arXiv preprint arXiv:2210.15097. · arXiv
- Chin-Yew Lin. 2004. Rouge: A package for automatic evaluation of summaries. In Text summarization branches out, pages 74-81.
- Tobias Materzok. 2025. Cos (m+ o) s: Curiosity and rl- enhanced mcts for exploring story space via language models. arXiv preprint arXiv:2501.17104. · arXiv
- Minh Nguyen, Andrew Baker, Clement Neo, Allen Roush, Andreas Kirsch, and Ravid Shwartz-Ziv. 2024. Turning up the heat: Min-p sampling for creative and coherent llm outputs. arXiv preprint arXiv:2407.01082. · arXiv
- OpenAI. 2024. Gpt-4o system card. https://arxiv. org/abs/2410.21276.
- Kishore Papineni, Salim Roukos, Todd Ward, and Wei- Jing Zhu. 2002. Bleu: a method for automatic evalu- ation of machine translation. In Proceedings of the 40th annual meeting of the Association for Computa- tional Linguistics, pages 311-318.
- Kyeongman Park, Minbeom Kim, and Kyomin Jung. 2024a. A character-centric creative story generation via imagination. arXiv preprint arXiv:2409.16667. · arXiv
- Kyeongman Park, Nakyeong Yang, and Kyomin Jung. 2024b. Longstory: Coherent, complete and length controlled long story generation. In Pacific-Asia Con- ference on Knowledge Discovery and Data Mining, pages 184-196. Springer.
- Zeeshan Patel, Karim El-Refai, Jonathan Pei, and Tianle Li. 2024. Swag: Storytelling with action guidance. arXiv preprint arXiv:2402.03483. · arXiv
- Nils Reimers and Iryna Gurevych. 2019. Sentence-bert: Sentence embeddings using siamese bert-networks. arXiv preprint arXiv:1908.10084. · arXiv
- Ghada Sokar, Rishabh Agarwal, Pablo Samuel Castro, and Utku Evci. 2023. The dormant neuron phe- nomenon in deep reinforcement learning. In Inter- national Conference on Machine Learning, pages 32145-32168.
- PMLR.
- Yixuan Su, Tian Lan, Yan Wang, Dani Yogatama, Ling- peng Kong, and Nigel Collier. 2022. A contrastive framework for neural text generation. Advances in Neural Information Processing Systems, 35:21548- 21561.
- Haoran Sun, Yekun Chai, Shuohuan Wang, Yu Sun, Hua Wu, and Haifeng Wang. 2025. Curiosity-driven reinforcement learning from human feedback. arXiv preprint arXiv:2501.11463. · arXiv
- Ashwin K Vijayakumar, Michael Cogswell, Ram- prasath R Selvaraju, Qing Sun, Stefan Lee, David Crandall, and Dhruv Batra. 2016. Diverse beam search: Decoding diverse solutions from neural se- quence models. arXiv preprint arXiv:1610.02424. · arXiv
- Xuezhi Wang, Jason Wei, Dale Schuurmans, Quoc Le, Ed Chi, Sharan Narang, Aakanksha Chowdhery, and Denny Zhou. 2022. Self-consistency improves chain of thought reasoning in language models. arXiv preprint arXiv:2203.11171. · arXiv
- Sean Welleck, Ilia Kulikov, Stephen Roller, Emily Di- nan, Kyunghyun Cho, and Jason Weston. 2019. Neu- ral text generation with unlikelihood training. arXiv preprint arXiv:1908.04319. · arXiv
- Zhihua Wen, Zhiliang Tian, Wei Wu, Yuxin Yang, Yanqi Shi, Zhen Huang, and Dongsheng Li. 2023. Grove: a retrieval-augmented complex story gener- ation framework with a forest of evidence. arXiv preprint arXiv:2310.05388. · arXiv
- Emily Wenger and Yoed Kenett. 2025. We're different, we're the same: Creative homogeneity across llms. arXiv preprint arXiv:2501.19361. · arXiv
- Zongqian Wu, Tianyu Li, Baoduo Xu, Jiaying Yang, Mengmeng Zhan, Xiaofeng Zhu, and Lei Feng. 2025b. Is depth all you need? an exploration of iterative reasoning in llms. arXiv preprint arXiv:2502.10858. · arXiv
- Wenhong Zhu, Hongkun Hao, and Rui Wang. 2023. Penalty decoding: Well suppress the self- reinforcement effect in open-ended text generation. arXiv preprint arXiv:2310.14971. · arXiv
Cited by
Sorted by citations
On Epistemic Diversity in Large Language Models
Kirsten, E., Krämer, N., & Zafar, M. B. (2026) · arXiv · doi:10.48550/arxiv.2609.04835
“Their approach relies on similarity metrics, which may not capture the full structure of epistemic differences (Shypula et al., 2025; Yang et al., 2025).”
- Authors
- Park, K., Yang, N., & Jung, K.
- Affiliations
- Seoul National University (KR)
- ORCID
- Jung, Kyomin
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2025
- Pages
- 7500-7516
- arXiv
- 2509.02170
- OpenAlex
- W4416036609
- Cited by
- 0
- References
- 0
- FWCI
- 0.00
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Funders
- National Research Foundation
- Seoul National University (RS2021-II211343)
- National Research Foundation of Korea
- Ministry of Science and ICT, South Korea (2021-II212068, RS2021-II211343, RS-2021-II212068)
- Institute for Information and Communications Technology Promotion (RS-2022-II220184, RS-2021II211343, 2022-, RS‐2021‐II212068)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- story generation, output diversity, neuronal activation, large language models, creative diversity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
