From Expanded Cinema to Extended Reality: How AI Can Expand and Extend Cinematic Experiences
Open accessAbstract
This paper explores the concept of expanded cinema and its relationship to extended reality (XR), focusing on the potential of artificial intelligence (AI) to expand and extend expressive possibilities. Expanded cinema refers to experimental film and multimedia art forms that challenge the conventions of traditional cinema by creating immersive and interactive experiences for audiences. XR, on the other hand, blurs the line between physical and virtual reality, offering immersive storytelling experiences. Both expanded cinema and XR aim to push the boundaries of traditional norms and create immersive experiences through the integration of technology, interactivity, and cross-sensory elements. The paper emphasizes the role of AI in optimizing 3D scene creation for XR and enhancing the overall experience through a case study. It also presents several AI-based techniques, such as generative models and AI-assisted rendering, that facilitate efficient and effective 3D content creation. Additionally, it explores the use of AI plugins in 3D modeling software and the generation of 3D models and textures from 2D images using techniques like GANs and VAEs. The incorporation of AI to extend and expand opens up new possibilities for immersive experiences in the future.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Song et al.'s study focuses on a single scene type and does not include extensive qualitative and no quantitative analysis.
“They focus on a single scene type and do not include extensive qualitative and no quantitative analysis [45].”
From Understanding Creative Potential and Use Cases of AI-Generated Environments for Virtual Film Productions: Insights from Industry Professionals (2025) · cites this paper as [45]
Song et al.'s work stands out as the only one to explore generative and data-driven techniques for enhancing cinematic experiences.
“Song et al. 's [45] work stands out as the only one to explore generative and data-driven techniques for enhancing cinematic experiences.”
From Understanding Creative Potential and Use Cases of AI-Generated Environments for Virtual Film Productions: Insights from Industry Professionals (2025) · cites this paper as [45]
Academic research on AI in virtual production is still extremely rare.
“Academic research on AI in virtual production is still extremely rare.”
From Understanding Creative Potential and Use Cases of AI-Generated Environments for Virtual Film Productions: Insights from Industry Professionals (2025) · cites this paper as [45]
Section 4.3 calls for further research on specific uses of AI-generated scenes in virtual production workflows, but does not say academic research on AI in virtual production is extremely rare. Searches for statements about scarce or limited studies found no passage establishing that broader claim; page numbers were unavailable in our copy. (LLM, conf=0.72)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067 · see citing works
Generative adversarial networks
Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y. (2020) · Communications of the ACM · doi:10.1145/3422622 · Cited by 18,384 · see citing works
Denoising Diffusion Probabilistic Models
Ho, J., Jain, A., & Abbeel, P. (2020) · arXiv · doi:10.48550/arxiv.2006.11239 · Cited by 8,712 · see citing works
NeRF: representing scenes as neural radiance fields for view synthesis
Mildenhall, B., Srinivasan, P. P., Tancik, M., Barron, J. T., Ramamoorthi, R., & Ng, R. (2022) · Communications of the ACM · doi:10.1145/3503250 · Cited by 6,852 · see citing works
Unrestricted Facial Geometry Reconstruction Using Image-to-Image Translation
Sela, M., Richardson, E., & Kimmel, R. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.175 · Cited by 284 · see citing works
Pouyanfar, S., Yang, Y., Chen, S., Shyu, M., & Iyengar, S. S. (2018) · ACM Computing Surveys · doi:10.1145/3150226 · Cited by 195 · see citing works
“Culture: Intercom” and Expanded Cinema: A Proposal and Manifesto
Vanderbeek, S. (1966) · The Tulane Drama Review · doi:10.2307/1125263 · Cited by 29 · see citing works
Barker, T. (2012) · Studies In Australasian Cinema · doi:10.1386/sac.6.2.111_1 · Cited by 8 · see citing works
Cinema Expanded: Avant-Garde Film in the Age of Intermedia
Walley, J. (2020) · Cited by 5 · see citing works
Blülle, B., Altazin, S., Frouin, B., Stepanova, L., Jenatsch, S., & Ruhstaller, B. (2019) · SID Symposium Digest of Technical Papers · doi:10.1002/sdtp.13512 · Cited by 2 · see citing works
Disruptive Innovations in cinematic storytelling from 2D to 3D
Yip, D. K. M. (2022) · AHFE international · doi:10.54941/ahfe1002036 · Cited by 2 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 8
- [5]5. Disguise. 2023. Film and TV Drama XR Workshop: Five Ways XR is Revolu- tionising Film and TV. https://www.disguise.one/en/insights/blog/film-and-tv- drama-xr-workshop-five-ways-xr-is-revolutionising-film-and-tv/
- [9]9. Carmen Guiralt Gomar. 2014. El Two-Color Kodachrome y su inserción en The Llight in the Dark (Clarence Brown, 1922): primera y única exhibición pública del proceso experimental de color en un largometraje comercial. Fotocinema: revista científica de cine y fotografía 9 (2014), 82-116.
- [11]11. Filip Hauptfleisch, Ondrej Texler, Aneta Texler, Jaroslav Krivánek, and Daniel Sỳkora. 2020. StyleProp: Real-time Example-based Stylization of 3D Models. In Computer Graphics Forum, Vol. 39. Wiley Online Library, 575-586.
- [16]16. Batta Mahesh. 2020. Machine learning algorithms-a review. International Journal of Science and Research (IJSR).[Internet] 9, 1 (2020), 381-386.
- [22]22. Samira Pouyanfar, Saad Sadiq, Yilin Yan, Haiman Tian, Yudong Tao, Maria Presa Reyes, Mei-Ling Shyu, Shu-Ching Chen, and Sundaraja S Iyengar. 2018. A survey on deep learning: Algorithms, techniques, and applications. ACM Computing Surveys (CSUR) 51, 5 (2018), 1-36.
- [24]24. Catherine Rogers. 2014. Film Outside Cinema. Ph. D. Dissertation. Royal College of Art (United Kingdom).
- [25]25. Julian A Ross. 2014. Beyond the frame: intermedia and expanded cinema in 1960- 1970s Japan. Ph. D. Dissertation. University of Leeds.
- [29]29. David Kei-Man Yip. 2020. The Invisible Art of Storytelling and Media Production. In Advances in Creativity, Innovation, Entrepreneurship and Communication of Design: Proceedings of the AHFE 2020 Virtual Conferences on Creativity, Innovation and Entrepreneurship, and Human Factors in Communication of Design, July 16-20, 2020, USA. Springer, 262-266.
Cited by
Sorted by citations
Chen, X., & Wu, D. (2024) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2024.3378279 · Cited by 76 · see citing works
Diffusion-Based Visual Art Creation: A Survey and New Perspectives
Wang, B., Chen, Q., & Wang, Z. (2025) · ACM Computing Surveys · doi:10.1145/3728459 · Cited by 40 · see citing works
Self-citation(19448503), J. H., Hitchen, G., & Dogan, S. (2025) · Convergence The International Journal of Research into New Media Technologies · doi:10.1177/13548565251383409 · Cited by 24 · see citing works
MagicScroll: Enhancing Immersive Storytelling with Controllable Scroll Image Generation
Wang, B., Meng, H., Cao, R., Cai, Z., Li, L., Ma, Y., Chen, Q., & Wang, Z. (2025) · IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr59515.2025.00067 · Cited by 12 · see citing works
Self-citationAnalyzing Multimodal Interaction Strategies for LLM-Assisted Manipulation of 3D Scenes
Chen, J., Grubert, J., & Kristensson, P. O. (2025) · IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr59515.2025.00045 · Cited by 9 · see citing works
Intersecting Realms: Examining the Convergence of Vision and AI in Extended Reality Graphics
Alhakamy, A. (2025) · IEEE Access · doi:10.1109/access.2025.3599337 · Cited by 4 · see citing works
Ink Harmony: An AI- and VR-enhanced System for Calligraphy Education
Zhuo, Y., Wang, B., & Wang, Z. (2024) · doi:10.1145/3641521.3680540 · Cited by 4 · see citing works
Self-citationStoryboarding in Extended Reality: leveraging real-world elements in storyboard creation
Manuri, F., Mafrici, F., & Sanna, A. (2025) · ACM SIGGRAPH Conference on Motion, Interaction and Games (MIG) · doi:10.1145/3769047.3769062 · Cited by 3 · see citing works
Memory Remedy: An AI-Enhanced Interactive Story Exploring Human-Robot Interaction and Companionship
Han, L., Zhou, Y., Chen, Q., & Yip, D. K. M. (2024) · International Symposium on Visual Information Communication and Interaction (VINCI) · doi:10.1145/3678698.3687186 · Cited by 3 · see citing works
Self-citationLeininger, P., Weber, C. J., & Rothe, S. (2025) · Proceedings of the 2025 ACM International Conference on Interactive Media Experiences · doi:10.1145/3706370.3727853 · Cited by 3 · see citing works
Zhu, T., You, W., Ma, Z., & Lin, T. (2025) · International Symposium on Visual Information Communication and Interaction (VINCI) · doi:10.1145/3769534.3769586 · Cited by 1 · see citing works
Expanding Virtual Production Frontiers: AI-Driven Workflows for Enhanced Cinematic Creation
Song, J., Guo, H., Lujin, Z., Wang, Z., & Yip, D. K. M. (2025) · International Symposium on Visual Information Communication and Interaction (VINCI) · doi:10.1145/3769534.3769550 · Cited by 1 · see citing works
Self-citationHussein, K. M. A. M., & Özad, B. E. (2025) · Qeios · doi:10.32388/miw542
Generative Strokes: A Parametric Framework for 3D Calligraphic Expression
Lin, T., Zheng, B., You, W., Lin, H., & Liang, C. (2025) · International Symposium on Visual Information Communication and Interaction (VINCI) · doi:10.1145/3769534.3769619
Interactive Cinema at the Convergence of Video Games, Films, and AI-Mediated Narratives
Koscianski, A. (2026) · IGI Global eBooks · doi:10.4018/979-8-3373-8587-7.ch005
Guerrilla Cinema in Social VR: Designing a Feature-Film Production Pipeline
Cılızoğlu, S., Tan, B. G., Sönmez, C., Vatansever, A., & Yantaç, A. E. (2026) · Nordic Conference on Human-Computer Interaction · doi:10.1145/3829807.3829849
- Authors
- Song, J., Wang, B., Wang, Z., & Yip, D. K.-M.
- Affiliations
- The Hong Kong University of Science and Technology (Guangzhou) (CN)
- Venue
- Proceedings of the 16th International Symposium on Visual Information Communication and Interaction
- Publisher
- ACM
- Published
- 2023-09-22
- Pages
- 1-5
- OpenAlex
- W4387827827
- Semantic Scholar
- cff98fa0b15647a17f26cb152f997d1228164ec4
- Cited by
- 16
- References
- 10
- Citations by year
- 2026: 2 · 2025: 11 · 2024: 3
- FWCI
- 4.68
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- International Symposium on Visual Information Communication and Interaction (VINCI) (publishedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Digital Media and Visual Art
- Social Sciences › Arts and Humanities › Visual Arts and Performing Arts › Art, Technology, and Culture
- Social Sciences › Arts and Humanities › Visual Arts and Performing Arts › Cinema History and Criticism
- Keywords
- expanded cinema, extended reality, artificial intelligence in film, immersive storytelling, interactive film, 3D scene generation, generative adversarial networks, variational autoencoder, experimental film, multimedia art
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
