Shelley: A Crowd-sourced Collaborative Horror Writer
The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Abstract
Fear induction in the form of stories and visual images pervades the history of human culture. Creating a visceral emotion such as fear remains one of the cornerstones of human creativity. As artificial intelligence makes strides in solving challenging analytical problems like chess and Go, an important question still remains: can machines induce extreme human emotions, such as fear? In this work, we propose a deep-learning based collaborative horror writer that collaboratively writes scary stories with people on Twitter. We deploy our system as a bot on Twitter that regularly generates and posts new stories on Twitter, and invites users to participate. Users who interact with the stories produce multiple storylines originating from the same tweet, thereby creating a tree-based story structure. We further perform a validation study on n = 105 subjects to verify whether the generated stories psychologically move people on psychometrically validated measures of effect and anxiety such as I-PANAS-SF [43] and STAI-SF [26]. Our experiments show that 1) stories generated by our bot as well as the stories generated collaboratively between our bot and Twitter users produced statistically significant increases in negative affect and state anxiety compared to the control condition, and 2) collaborated stories are more successful in terms of increasing negative affect and state anxiety than the machine-generated ones. Furthermore, we make three novel datasets used in our framework publicly available at https://github.com/catlab-team/shelley for encouraging further research on this topic.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This is driven, in particular, by our experimental condition that enables writers to request multiple generative AI ideas—up to five in our study—each presenting a different starting point, leading to a “tree” branching off to potential storylines (3).”
From Generative artificial intelligence enhances creativity but reduces the diversity of novel content (2023) · cites this paper as [3]
In the citing paper
“This gap is noteworthy given that theoretical research on Human-AI collaboration frameworks, such as [85,86,118] including CSCW research [143], do investigate interfaces that modulate AI support as a mechanism for humans to exert control over AI initiative in complex tasks.”
From Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process (2025) · cites this paper as [143]
Citations
Cites
Development and validation of brief measures of positive and negative affect: The PANAS scales.
Watson, D., Clark, L. A., & Tellegen, A. (1988) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.54.6.1063 · Cited by 32,433
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Effective Approaches to Attention-based Neural Machine Translation
Luong, T., Pham, H., & Manning, C. D. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1166 · Cited by 8,382 · cited 1×
“to-sequence [41] or attention [25] based models.”
Categorical Reparameterization with Gumbel-Softmax
Jang, E., Gu, S., & Poole, B. (2016) · arXiv · doi:10.48550/arxiv.1611.01144 · Cited by 3,616
Marteau, T. M., & Bekker, H. (1992) · British Journal of Clinical Psychology · doi:10.1111/j.2044-8260.1992.tb00997.x · Cited by 3,238 · cited 8×
“The second metric is a shortened version of the State-Trait Anxiety Inventory (STAI-SF) which measures the state anxiety of the participants.”
InfluentialThompson, E. R. (2007) · Journal of Cross-Cultural Psychology · doi:10.1177/0022022106297301 · Cited by 2,399 · cited 9×
“We run a validation study where we performed a controlled experiment on n = 105 subjects on Amazon’s Mechanical Turk where we verify whether the generated stories psychologically move people on psychometrically validated measures of effect and anxiety such as I-PANAS-SF and STAI-SF.”
InfluentialProceedings of the 29th Annual Conference of the Cognitive Science Society
Rohde, H., Kehler, A., & Elman, J. L. (2007) · Cognitive Science · Cited by 1,788
Diverse Image-to-Image Translation via Disentangled Representations
Lee, H.-Y., Tseng, H.-Y., Huang, J.-B., Singh, M., & Yang, M.-H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01246-5_3 · Cited by 1,541
Hierarchical Neural Story Generation
Fan, A., Lewis, M., & Dauphin, Y. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1082 · Cited by 1,266 · cited 3×
“[12] explores coherent text generation using a hierarchical model based on human-written stories paired with writing prompts from an online forum.”
Hierarchical Neural Story Generation
Fan, A., Lewis, M., & Dauphin, Y. (2018) · arXiv · doi:10.48550/arxiv.1805.04833 · Cited by 1,242
Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm
Silver, D., Hubert, T., Schrittwieser, J., Antonoglou, I., Lai, M., Guez, A., Lanctot, M., Sifre, L., Kumaran, D., Graepel, T., et al. (2017) · arXiv · doi:10.48550/arxiv.1712.01815 · Cited by 1,102 · cited 1×
“As Artificial Intelligence (AI) makes strides in solving challenging analytical problems like checkers [37], chess [39] or video-games [47] and defeating the world’s best Go and chess players [38, 39]”
BackgroundSome Studies in Machine Learning Using the Game of Checkers. II—Recent Progress
Samuel, A. L. (1967) · IBM Journal of Research and Development · doi:10.1147/rd.116.0601 · Cited by 695
TALE-SPIN, an interactive program that writes stories
Meehan, J. (1977) · Cited by 315
Interactive Narrative: An Intelligent Systems Approach
Riedl, M. O., & Bulitko, V. (2013) · AI Magazine · doi:10.1609/aimag.v34i1.2449 · Cited by 299 · cited 1×
“Interactive story generation using machine learning became a popular research area [34] in which users influence storylines through their actions.”
BackgroundCold Fusion: Training Seq2Seq Models Together with Language Models
Sriram, A., Jun, H., Satheesh, S., & Coates, A. (2018) · Interspeech 2018 · doi:10.21437/interspeech.2018-1392 · Cited by 270
Story Generation with Crowdsourced Plot Graphs
Li, B., Lee-Urban, S., Johnston, G., & Riedl, M. (2013) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v27i1.8649 · Cited by 198
Story Ending Generation with Incremental Encoding and Commonsense Knowledge
Guan, J., Wang, Y., & Huang, M. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33016473 · Cited by 166
How Novelists Use Generative Language Models: An Exploratory User Study.
Calderwood, A., Qiu, V., Gero, K. I., & Chilton, L. B. (2020) · Cited by 111
Ensemble: exploring complementary strengths of leaders and crowds in creative collaboration
Kim, J., Cheng, J., & Bernstein, M. S. (2014) · Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing · doi:10.1145/2531602.2531638 · Cited by 89
Creative Help: A Story Writing Assistant
Roemmele, M., & Gordon, A. S. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-27036-4_8 · Cited by 83 · cited 2×
“[35] proposed an application that generates suggestions for the next sentence in a story where users can modify or delete suggestions based on their choice.”
BackgroundSay Anything: A Massively Collaborative Open Domain Story Writing Companion
Swanson, R., & Gordon, A. S. (2006) · Lecture notes in computer science · doi:10.1007/978-3-540-89454-4_5 · Cited by 78
Story Generation from Sequence of Independent Short Descriptions
Jain, P., Agrawal, P., Mishra, A., Sukhwani, M., Laha, A., & Sankaranarayanan, K. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.05501 · Cited by 75
Story Scrambler - Automatic Text Generation Using Word Level RNN-LSTM
Assistant Professor, K. J. S. C. O. E., Pawade, D., Sakhapara, A., Jain, M., Jain, N., & Gada, K. (2018) · International Journal of Information Technology and Computer Science · doi:10.5815/ijitcs.2018.06.05 · Cited by 60
Veale, T., & Cook, M. (2018) · The MIT Press eBooks · doi:10.7551/mitpress/10859.001.0001 · Cited by 60
Makebelieve: using commonsense knowledge to generate stories
Liu, H., & Singh, P. (2002) · National Conference on Artificial Intelligence · doi:10.5555/777092.777241 · Cited by 57
Twitter: The Best of Bot Worlds for Automated Wit
Veale, T., Valitutti, A., & Li, G. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-20804-6_63 · Cited by 27
An RNN-based Binary Classifier for the Story Cloze Test
Roemmele, M., Kobayashi, S., Inoue, N., & Gordon, A. S. (2017) · doi:10.18653/v1/w17-0911 · Cited by 24
Twitterbots: Making Machines that Make Meaning
Veale, T., & Cook, M. (2018) · Cited by 17
O Poeta Artificial 2.0: Increasing Meaningfulness in a Poetry Generation Twitter bot
Oliveira, H. G. (2017) · doi:10.18653/v1/w17-3902 · Cited by 9
Cue Me In: Content-Inducing Approaches to Interactive Story GenerationPreprint
Brahman, F., Petrusca, A., & Chaturvedi, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.09935 · Cited by 6
TheRiddlerBot: A next step on the ladder towards computational creativity
Verhoeven, B., Guerrero, I. A. C., Barbieri, F., Martins, P., & y Pérez, R. P. (2015) · Cited by 5
Generating Plots for a Given Query Using a Case-Base of Narrative Schemas
Gervás, P., Hervás, R., & León, C. (2015) · Cited by 3
Crowdsourced Social Media Poetry
Lamb, C. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v13i1.12910 · Cited by 1
StarCraft II: A New Challenge for Reinforcement Learning
Vinyals, O., Ewalds, T., Bartunov, S., Georgiev, P., Vezhnevets, A. S., Yeo, M., Makhzani, A., Küttler, H., Agapiou, J., Schrittwieser, J., et al. (2017) · arXiv · doi:10.48550/arxiv.1708.04782
Research works printed but not linked: 7
- Nader Akoury , Shufan Wang , Josh Whiting , Stephen Hood , Nanyun Peng , and Mohit Iyyer . 2020 . STORIUM: A Dataset and Evaluation Platform for Machine-in-the-Loop Story Generation. arXiv preprint arXiv:2010.01717(2020). Nader Akoury, Shufan Wang, Josh Whiting, Stephen Hood, Nanyun Peng, and Mohit Iyyer. 2020. STORIUM: A Dataset and Evaluation Platform for Machine-in-the-Loop Story Generation. arXiv preprint arXiv:2010.01717(2020). · arXiv
- Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell Sandhini Agarwal Ariel Herbert-Voss Gretchen Krueger Tom Henighan Rewon Child Aditya Ramesh Daniel M. Ziegler Jeffrey Wu Clemens Winter Christopher Hesse Mark Chen Eric Sigler Mateusz Litwin Scott Gray Benjamin Chess Jack Clark Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever and Dario Amodei. 2020. Language Models are Few-Shot Learners. arxiv:2005.14165 [cs.CL] Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell Sandhini Agarwal Ariel Herbert-Voss Gretchen Krueger Tom Henighan Rewon Child Aditya Ramesh Daniel M. Ziegler Jeffrey Wu Clemens Winter Christopher Hesse Mark Chen Eric Sigler Mateusz Litwin Scott Gray Benjamin Chess Jack Clark Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever and Dario Amodei. 2020. Language Models are Few-Shot Learners. arxiv:2005.14165 [cs.CL] · arXiv
- Samuel Rhys Cox , Yunlong Wang , Ashraf Abdul , Christian von der Weth, and Brian Y Lim . 2021 . Directed Diversity : Leveraging Language Embedding Distances for Collective Creativity in Crowd Ideation . arXiv preprint arXiv:2101.06030(2021). Samuel Rhys Cox, Yunlong Wang, Ashraf Abdul, Christian von der Weth, and Brian Y Lim. 2021. Directed Diversity: Leveraging Language Embedding Distances for Collective Creativity in Crowd Ideation. arXiv preprint arXiv:2101.06030(2021). · arXiv
- Ahmed Khalifa Gabriella AB Barros and Julian Togelius. 2017. Deeptingle. arXiv preprint arXiv:1705.03557(2017). Ahmed Khalifa Gabriella AB Barros and Julian Togelius. 2017. Deeptingle. arXiv preprint arXiv:1705.03557(2017). · arXiv
- Pengfei Liu Xipeng Qiu and Xuanjing Huang. 2016. Recurrent neural network for text classification with multi-task learning. arXiv preprint arXiv:1605.05101(2016). Pengfei Liu Xipeng Qiu and Xuanjing Huang. 2016. Recurrent neural network for text classification with multi-task learning. arXiv preprint arXiv:1605.05101(2016). · arXiv
- Rutherford MONTGOMERY. 2009. The Abominable Snowman (Choose Your Own Adventure# 1). Choose Your Own Adventure Series.[Kindle Version] Chooseco ( 2009 ). Rutherford MONTGOMERY. 2009. The Abominable Snowman (Choose Your Own Adventure# 1). Choose Your Own Adventure Series.[Kindle Version] Chooseco (2009).
- David Silver , Aja Huang , Chris J Maddison , Arthur Guez , Laurent Sifre , George Van Den Driessche , Julian Schrittwieser, Ioannis Antonoglou , Veda Panneershelvam, Marc Lanctot , 2016 . Mastering the game of Go with deep neural networks and tree search. nature 529, 7587 (2016), 484–489. David Silver, Aja Huang, Chris J Maddison, Arthur Guez, Laurent Sifre, George Van Den Driessche, Julian Schrittwieser, Ioannis Antonoglou, Veda Panneershelvam, Marc Lanctot, 2016. Mastering the game of Go with deep neural networks and tree search. nature 529, 7587 (2016), 484–489.
Cited by
Generative artificial intelligence enhances creativity but reduces the diversity of novel content
Doshi, A., & Hauser, O. (2023) · doi:10.2139/ssrn.4535536 · Cited by 1,350
Collaborative Intelligence: A Scoping Review Of Current Applications
Schleiger, E., Mason, C., Naughtin, C. K., Reeson, A. F., & Paris, C. L. (2024) · Applied Artificial Intelligence · doi:10.1080/08839514.2024.2327890 · Cited by 117
Maiden, N., Lockerbie, J., Zachos, K., Wolf, A., & Brown, A. (2022) · Expert Systems · doi:10.1111/exsy.13194 · Cited by 45
Christiansen, F. R., Hollensberg, L. N., Jensen, N. B., Julsgaard, K., Jespersen, K. N., & Nikolov, I. A. (2024) · ACM Symposium on Virtual Reality Software and Technology (VRST) · doi:10.1145/3641825.3687716 · Cited by 42
Sun, Y., Ni, X., Feng, H., Lc, R., Lee, C. H., & Asadipour, A. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-22298-6_42 · Cited by 32
Metadata
- Authors
- Yanardag, P., Cebrian, M., & Rahwan, I.
- Affiliations
- Boğaziçi University (TR)
- MPI, Germany
- Venue
- Creativity and Cognition
- Publisher
- ACM
- Published
- 2021-06-22
- Pages
- 1-8
- OpenAlex
- W3173986481
- Cited by
- 20
- References
- 32
- Citations by year
- 2026: 1 · 2025: 5 · 2024: 6 · 2023: 3 · 2022: 5
- FWCI
- 1.62
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Creativity and Cognition (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- fear induction, emotion induction, Twitter bots, story generation, negative affect, state anxiety, emotion datasets
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.