LingoComics: Co-Authoring Comic Style AI-Empowered Stories for Language Learning Immersion with Story Designer

Abstract

In language learning applications, contextualization and immersion rely on real-life communication and remain challenging despite the recent advancements in artificial intelligence (AI) that have significantly impacted educational and language learning experiences. This paper introduces LingoComics, a web application that embeds AI-empowered stories with narrative and comic-style illustrations to enhance contextualization and personalization in language learning. At the core of LingoComics is the Story Designer module, which allows learners to co-author short narratives using a structured set of parameters within a simple user interface. Leveraging OpenAI’s GPT-4-turbo for text completion and DALLE-3 for image generation, the Story Designer generates contextually relatable stories and comic-style images based on user input.