Storyfier: Exploring Vocabulary Learning Support with Text Generation Models
Open accessThe DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
Vocabulary learning support tools have widely exploited existing materials, e.g., stories or video clips, as contexts to help users memorize each target word. However, these tools could not provide a coherent context for any target words of learners’ interests, and they seldom help practice word usage. In this paper, we work with teachers and students to iteratively develop Storyfier, which leverages text generation models to enable learners to read a generated story that covers any target words, conduct a story cloze test, and use these words to write a new story with adaptive AI assistance. Our within-subjects study (N=28) shows that learners generally favor the generated stories for connecting target words and writing assistance for easing their learning workload. However, in the read-cloze-write learning sessions, participants using Storyfier perform worse in recalling and using target words than learning with a baseline tool without our AI features. We discuss insights into supporting learning tasks with generative models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · cited 3×
“Particularly, transformer-based models [4, 35, 70] are able to produce incredibly fuent texts after training on a large language corpus.”
BackgroundMethodSentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Reimers, N., & Gurevych, I. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1410 · Cited by 12,778
Technology Acceptance Model 3 and a Research Agenda on Interventions
Venkatesh, V., & Bala, H. (2008) · Decision Sciences · doi:10.1111/j.1540-5915.2008.00192.x · Cited by 8,159 · cited 2×
“acceptance model [79, 81] to the perceived usefulness (four items,”
BackgroundMethodPrefix-Tuning: Optimizing Continuous Prompts for Generation
Li, X. L., & Liang, P. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.353 · Cited by 2,473
AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networks
Xu, T., Zhang, P., Huang, Q., Zhang, H., Gan, Z., Huang, X., & He, X. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00143 · Cited by 1,923
AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Prompts
Shin, T., Razeghi, Y., Logan IV, R. L., Wallace, E., & Singh, S. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.346 · Cited by 1,279
Hierarchical Neural Story Generation
Fan, A., Lewis, M., & Dauphin, Y. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1082 · Cited by 1,266 · cited 5×
“The textual story generation techniques aim at generating coherent and fuent narratives or ideas based on simple user inputs, such as a title [46] and prompts [17].”
BackgroundMethodInfluentialHierarchical Neural Story Generation
Fan, A., Lewis, M., & Dauphin, Y. (2018) · arXiv · doi:10.48550/arxiv.1805.04833 · Cited by 1,242
How Can We Know What Language Models Know?
Jiang, Z., Xu, F. F., Araki, J., & Neubig, G. (2020) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00324 · Cited by 1,002
Liu, X., Zheng, Y., Du, Z., Ding, M., Qian, Y., Yang, Z., & Tang, J. (2021) · arXiv · doi:10.48550/arxiv.2103.10385 · Cited by 908
Nasa-task load index (NASA-TLX); 20 years later: (577632012-009)
Hart, S. G. (2006) · PsycEXTRA Dataset · doi:10.1037/e577632012-009 · Cited by 838
CTRL: A Conditional Transformer Language Model for Controllable Generation
Keskar, N. S., McCann, B., Varshney, L. R., Xiong, C., & Socher, R. (2019) · arXiv · doi:10.48550/arxiv.1909.05858 · Cited by 751
A Corpus and Cloze Evaluation for Deeper Understanding of Commonsense Stories
Mostafazadeh, N., Chambers, N., He, X., Parikh, D., Batra, D., Vanderwende, L., Kohli, P., & Allen, J. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1098 · Cited by 598
Narrative Planning: Balancing Plot and Character
Riedl, M. O., & Young, R. M. (2010) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2989 · Cited by 522
Plug and Play Language Models: A Simple Approach to Controlled Text Generation
Dathathri, S., Madotto, A., Lan, J., Hung, J., Frank, E., Molino, P., Yosinski, J., & Liu, R. (2019) · arXiv · doi:10.48550/arxiv.1912.02164 · Cited by 508
Nation, P. (2007) · Innovation in Language Learning and Teaching · doi:10.2167/illt039.0 · Cited by 494 · cited 5×
“Regarding the learning activities in a traditional language course, Paul Nation, suggested that there should be roughly equal amounts of time given to each of the following four strands [47].”
BackgroundInfluentialMirowski, P., Mathewson, K. W., Pittman, J., & Evans, R. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581225 · Cited by 240 · cited 1×
“Recent intelligent systems have explored the usage of text generation techniques in a variety of scenarios, such as creative writing [45, 57], AI-mediated communication [18], and health intervention [34].”
BackgroundGeDi: Generative Discriminator Guided Sequence Generation
Krause, B., Gotmare, A. D., McCann, B., Keskar, N. S., Joty, S., Socher, R., & Rajani, N. F. (2021) · Findings of the Association for Computational Linguistics: EMNLP 2021 · doi:10.18653/v1/2021.findings-emnlp.424 · Cited by 220
Learning to Write with Cooperative Discriminators
Holtzman, A., Buys, J., Forbes, M., Bosselut, A., Golub, D., & Choi, Y. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1152 · Cited by 192 · cited 1×
“These features can describe the user preferences and are modeled by heuristics [20], supervised signals [30], and reinforcement learning [40].”
BackgroundJo, E., Epstein, D. A., Jung, H., & Kim, Y.-H. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581503 · Cited by 174 · cited 1×
“Recent intelligent systems have explored the usage of text generation techniques in a variety of scenarios, such as creative writing [45, 57], AI-mediated communication [18], and health intervention [34].”
BackgroundBuschek, D., Zürn, M., & Eiband, M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445372 · Cited by 108
AL: An Adaptive Learning Support System for Argumentation Skills
Wambsganss, T., Niklaus, C., Cetto, M., Söllner, M., Handschuh, S., & Leimeister, J. M. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376732 · Cited by 101
AngleKindling: Supporting Journalistic Angle Ideation with Large Language Models
Petridis, S., Diakopoulos, N., Crowston, K., Hansen, M., Henderson, K., Jastrzebski, S., Nickerson, J. V., & Chilton, L. B. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580907 · Cited by 98
Peng, Z., Guo, Q., Tsang, K. W., & Ma, X. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376695 · Cited by 81 · cited 2×
“Previous skills learning tools, such as ArgueTutor [80], Persua [86] and VoiceCoach [83], and writing support tools like MepsBot [56] also adopt a similar feedback flow, which can mitigate disturbance on the practicing process.”
BackgroundSelf-citationLaMPost: Design and Evaluation of an AI-assisted Email Writing Prototype for Adults with Dyslexia
Goodman, S. M., Buehler, E., Clary, P., Coenen, A., Donsbach, A., Horne, T. N., Lahav, M., MacDonald, R., Michaels, R. B., Narayanan, A., et al. (2022) · Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3517428.3544819 · Cited by 71
Dietz, G., Le, J. K., Tamer, N., Han, J., Gweon, H., Murnane, E. L., & Landay, J. A. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445039 · Cited by 67
Automatic Poetry Generation from Prosaic Text
Van de Cruys, T. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.223 · Cited by 50 · cited 1×
“On the other hand, LLMs can generate fluent and relevant texts given user specifications such as keywords, which have been used to support the writings of emails [24], articles or fiction [10], and poems [71, 78].”
BackgroundComparing Sentence-Level Suggestions to Message-Level Suggestions in AI-Mediated Communication
Fu, L., Newman, B., Jakesch, M., & Kreps, S. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581351 · Cited by 31 · cited 1×
“Recent intelligent systems have explored the usage of text generation techniques in a variety of scenarios, such as creative writing [45, 57], AI-mediated communication [18], and health intervention [34].”
BackgroundVisual StoryCoder: A Multimodal Programming Environment for Children’s Creation of Stories
Dietz, G., Tamer, N., Ly, C., Le, J. K., & Landay, J. A. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580981 · Cited by 24 · cited 2×
“motivated, on one hand, by the prevalent use of stories in language learning textbooks, and the proven efficacy of story-based learning in various scenarios such as programming [13, 14, 73], parent-child storytelling [92], and children’s visual storytelling [91].”
Background
Research works printed but not linked: 63
- 10.1145/3491102.3501839 · DOI
- Gordon H Bower. 1970. Analysis of a mnemonic device: Modern psychology uncovers the powerful components of an ancient system for improving memory. American Scientist 58, 5 (1970), 496–510.
- Patricia L Carrell. 1984. Schema theory and ESL reading: Classroom implications and applications. The modern language journal 68, 4 (1984), 332–343.
- 10.1016/j.compedu.2007.06.011 · DOI · Paper page
- John Joon Young Chung, Wooseok Kim, Kang Min Yoo, Hwaran Lee, Eytan Adar, and Minsuk Chang. 2022. TaleBrush: Sketching Stories with Generative Pretrained Language Models. In CHI Conference on Human Factors in Computing Systems. 1–19.
- 10.1145/3526113.3545672 · DOI · Paper page
- 10.1145/3173574.3173885 · DOI · Paper page
- Chris Donahue, Mina Lee, and Percy Liang. 2020. Enabling Language Models to Fill in the Blanks. ArXiv abs/2005.05339 (2020). · arXiv
- Rita Stafford Dunn and Kenneth J Dunn. 1972. Practical approaches to individualizing instructions: contracts and other effective teaching strategies. Parker Publishing.
- Pablo Gervás, Belén Díaz-Agudo, Federico Peinado, and Raquel Hervás. 2004. Story plot generation based on CBR. In International Conference on Innovative Techniques and Applications of Artificial Intelligence. Springer, 33–46.
- 10.18653/v1/P17-4008 · DOI · Paper page
- 10.4135/9781412983419 · DOI · Paper page
- Seraphina Goldfarb-Tarrant, Tuhin Chakrabarty, Ralph Weischedel, and Nanyun Peng. 2020. Content planning for neural story generation with aristotelian rescoring. arXiv preprint arXiv:2009.09870 (2020). · arXiv
- Seraphina Goldfarb-Tarrant Haining Feng and Nanyun Peng. 2019. Plan Write and Revise: an Interactive System for Open-Domain Story Generation. In NAACL. · DOI · Paper page
- 10.1111/j.1467-1770.1996.tb01355.x · DOI · Paper page
- Yongqi Gu and Robert Keith Johnson. 1996. Vocabulary learning strategies and language learning outcomes. Language learning 46, 4 (1996), 643–679.
- Brent Harrison, Christopher Purdy, and Mark O Riedl. 2017. Toward automated story generation with markov chain monte carlo methods and deep neural networks. In Thirteenth Artificial Intelligence and Interactive Digital Entertainment Conference.
- 10.1145/3108242 · DOI · Paper page
- Min-Chai Hsieh and Hao-Chiang Koong Lin. 2006. Interaction design based on augmented reality technologies for English vocabulary learning. In Proceedings of the 18th International Conference on Computers in Education, Vol. 1. 663–666.
- 10.1016/j.compedu.2011.08.008 · DOI · Paper page
- 10.1145/2556288.2557256 · DOI
- Mirella Lapata Regina Barzilay 2005. Automatic evaluation of text coherence: Models and representations. In IJCAI Vol. 5. Citeseer 1085–1090.
- Brian Lester, Rami Al-Rfou, and Noah Constant. 2021. The power of scale for parameter-efficient prompt tuning. arXiv preprint arXiv:2104.08691 (2021). · arXiv
- Jiwei Li, Will Monroe, and Dan Jurafsky. 2017. Learning to decode for future success. arXiv preprint arXiv:1701.06549 (2017). · arXiv
- 10.1609/aaai.v32i1.12233 · DOI · Paper page
- 10.1609/aaai.v32i1.11430 · DOI · Paper page
- Paul Nation and Teresa Chung. 2009. Teaching and testing vocabulary. The handbook of language teaching (2009), 543–559.
- 10.1145/3397481.3450696 · DOI
- 10.1145/3397481.3450696 · DOI
- OpenAI. 2023. GPT-4 Technical Report. arxiv:2303.08774 [cs.CL] · arXiv
- Rebecca Oxford and David Crookall. 1990. Vocabulary learning: A critical analysis of techniques. TESL Canada Journal (1990), 09–30.
- 10.1111/j.1944-9720.1989.tb03139.x · DOI
- 10.1016/0346-251X(94)90059-0 · DOI
- 10.18653/v1/W18-1505 · DOI · Paper page
- 10.1007/978-3-642-10643-9_28 · DOI
- 10.3102/00346543052001061 · doi:10.3102/00346543052001061 · Paper page
- 10.1145/3231848.3231851 · DOI
- Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, 2019. Language models are unsupervised multitask learners. OpenAI blog 1, 8 (2019), 9.
- Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. 2019. Exploring the limits of transfer learning with a unified text-to-text transformer. arXiv preprint arXiv:1910.10683 (2019). · arXiv
- 10.5555/1946417.1946422 · doi:10.5555/1946417.1946422
- Melissa Roemmele, Andrew S Gordon, and Reid Swanson. 2017. Evaluating story generation systems using automated linguistic analyses. In SIGKDD 2017 Workshop on Machine Learning for Creativity. 13–17.
- 10.1145/3397481.3450648 · DOI · Paper page
- Nathan Sakunkoo and Pattie Sakunkoo. 2013. Gliflix: Using movie subtitles for language learning. In Proceedings of the 26th Symposium on User Interface Software and Technology. ACM.
- 10.1186/s41039-016-0028-2 · DOI · Paper page
- Norbert Schmitt. 2008. Instructed second language vocabulary learning. Language teaching research 12, 3 (2008), 329–363.
- Abigail See, Aneesh Pappu, Rohun Saxena, Akhila Yerukola, and Christopher D Manning. 2019. Do massively pretrained language models make better storytellers?arXiv preprint arXiv:1909.10705 (2019). · arXiv
- 10.1145/3459637.3481964 · DOI
- 10.1145/3526113.3545617 · DOI · Paper page
- 10.1111/j.1540-4781.1988.tb04175.x · DOI
- Višnja Pavii Taka. 2008. Vocabulary learning strategies and foreign language acquisition. Multilingual Matters. · DOI · Paper page
- Preecha Tangworakitthaworn, Preeyapol Owatsuwan, Nutsima Nongyai, and Nongnapas Arayapong. 2019. An Image-Based Vocabulary Learning System Based on Multi-Agent System. In 2019 16th International Joint Conference on Computer Science and Software Engineering (JCSSE). IEEE, 324–329.
- Scott R Turner. 2014. The creative process: A computer model of storytelling and creativity. Psychology Press.
- 10.1145/3411764.3445781 · DOI · Paper page
- Lu Wang, Munif Ishad Mujib, Jake Williams, George Demiris, and Jina Huh-Yoo. 2021. An Evaluation of Generative Pre-Training Model-based Therapy Chatbot for Caregivers. arXiv preprint arXiv:2107.13115 (2021). · arXiv
- 10.1145/3313831.3376726 · DOI
- 10.1109/TCIAIG.2013.2277051 · DOI · Paper page
- 10.1145/3313831.3376324 · DOI
- 10.1145/3555210 · DOI
- Keiko Yamamoto, Jesus Rodriguez, and Yoshihiro Tsujino. 2019. FinDo: A Foreign Language Vocabulary Learning System Based on Location-Context. In 2019 20th IEEE/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD). IEEE, 302–307.
- 10.1609/aaai.v33i01.33017378 · DOI · Paper page
- 10.1109/DMDCM.2011.71 · DOI
- 10.1145/3491102.3501914 · DOI · Paper page
- 10.1145/3491102.3517479 · DOI · Paper page
Cited by
Charting the Future of AI in Project-Based Learning: A Co-Design Exploration with Students
Zheng, C., Yuan, K., Guo, B., Hadi Mogavi, R., Peng, Z., Ma, S., & Ma, X. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642807 · Cited by 70
Self-citationCharting the Future of AI in Project-Based Learning: A Co-Design Exploration with Students
Zheng, C., Yuan, K., Guo, B., Mogavi, R. H., Peng, Z., Ma, S., & Ma, X. (2024) · arXiv · doi:10.48550/arxiv.2401.14915 · Cited by 70
Self-citation'It was 80% me, 20% AI': Seeking Authenticity in Co-Writing with Large Language Models
Hwang, A. H.-C., Liao, Q. V., Blodgett, S. L., Olteanu, A., & Trischler, A. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3711020 · Cited by 42
Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process
Reza, M., Thomas-Mitchell, J., Dushniku, P., Laundry, N., Williams, J. J., & Kuzminykh, A. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757566 · Cited by 37
“In the Creative writing context, topics include: story writing [9, 22, 24, 41, 66, 73, 91, 120, 140], collaborative storytelling with AI [70, 88, 139], including CSCW work on AI support for human collaborative storytelling [112] and using dialects in creative writing [135].”
Where Do I 'Add the Egg'?: Exploring Agency and Ownership in AI Creative Co-Writing Systems
Carrera, D., Thomas-Mitchell, J., & Wigdor, D. (2026) · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791952 · Cited by 3
“Others used tool-like interfaces that were not found in the commercial systems, such as a tool for the generation of stories containing target words for language learning [54], and hierarchical generation [46].”
Metadata
- Authors
- Peng, Z., Wang, X., Han, Q., Zhu, J., Ma, X., & Qu, H.
- Venue
- Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology
- Publisher
- ACM
- Published
- 2023-10-29
- Pages
- 1-16
- OpenAlex
- W4387801070
- Cited by
- 27
- References
- 30
- FWCI
- 29.15
- Type
- conference paper
- Language
- en
- Open access
- bronze
- Funders
- The Young Scientists Fund of the National Natural Science Foundation of China (62202509)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.