The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Vellum of Lies: Designing and Evaluating a Multimodal Tangible Interaction System for Embodied Serious Historical Narratives
Open accessAbstract
Many existing historical narrative experiences still rely on screen-based viewing and limited multimodal interaction, which tends to keep users in a passive receiving role and limits their cognitive understanding, reflective thinking, user engagement, and emotional response. To address this, we designed Vellum of Lies, an immersive tangible user interface for anti-feudal historical narratives. The work integrates physical props, sensors, motion-based input, and projection mapping, organizing the story into continuous interaction nodes that allow users to participate in narrative progression through embodied interaction, including spatial movement, object manipulation, and final choice-making. The final choice mechanism operationalizes Tragic Agency by allowing users to make meaningful choices while constraining their ability to alter the final tragic outcome, with the aim of evoking tension between perceived choice and narrative inevitability. A mixed-methods user experience evaluation (N = 32) compared Vellum of Lies with a video-watching narrative experience. In this small-scale exploratory study, the experimental condition showed significant advantages in the HUQ Overall score, Reflection, the UES-SF Overall score, Aesthetic Appeal, Interest/Enjoyment, Pleasure/Valence, and Arousal, while also showing lower NASA-TLX Overall scores, Mental Demand, and Effort. Other measured subdimensions did not reach statistical significance. These preliminary findings suggest that multimodal tangible interaction may function not only as a presentation technique, but also as a narrative mechanism that coordinates physical input, bodily movement, projected feedback, and constrained choice-making to support selected aspects of understanding, engagement, and emotional reflection in serious historical narratives.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
The weirdest people in the world?
Henrich, J., Heine, S. J., & Norenzayan, A. (2010) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0999152x · Cited by 12,641
Measuring emotion: The self-assessment manikin and the semantic differential
Bradley, M. M., & Lang, P. J. (1994) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(94)90063-9 · Cited by 9,538
NASA-Task Load Index (NASA-TLX); 20 Years Later
Hart, S. G. (2006) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120605000909 · Cited by 4,297
Control and information in the intrapersonal sphere: An extension of cognitive evaluation theory.
Ryan, R. M. (1982) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.43.3.450 · Cited by 2,721
O’Brien, H. L., Cairns, P., & Hall, M. (2018) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2018.01.004 · Cited by 1,014
User experience over time: an initial framework
Karapanos, E., Zimmerman, J., Forlizzi, J., & Martens, J.-B. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518814 · Cited by 561
Why Story Matters: A Review of Narrative in Serious Games
Naul, E., & Liu, M. (2020) · Journal of Educational Computing Research · doi:10.1177/0735633119859904 · Cited by 204
Mixed Reality and Gamification for Cultural Heritage
(2017) · Springer eBooks · doi:10.1007/978-3-319-49607-8 · Cited by 191
The narrative arc: Revealing core narrative structures through text analysis
Boyd, R. L., Blackburn, K. G., & Pennebaker, J. W. (2020) · Science Advances · doi:10.1126/sciadv.aba2196 · Cited by 185
Škola, F., Rizvić, S., Cozza, M., Barbieri, L., Bruno, F., Skarlatos, D., & Liarokapis, F. (2020) · Sensors · doi:10.3390/s20205851 · Cited by 180
Research works printed but not linked: 5
- Peters, 2022, News as They Know It: Young Adults’ Information Repertoires in the Digital Media Landscape, Digit. Journal., 10, 62
- Koenitz, H. (2015). Interactive Digital Narrative: History, Theory and Practice, Taylor & Francis Group. [1st ed.]. Routledge Studies in European Communication Research and Education Ser.
- Vassos, 2017, Museum Experience Design: A Modern Storytelling Methodology, Des. J., 20, S3975
- Rizvic, S., Okanovic, V., Prazina, I., and Sadzak, A. (2016). 4D Virtual Reconstruction of White Bastion Fortress. Eurographics Workshop on Graphics and Cultural Heritage, Eurographics Association.
- Kim, 2020, Shang Dynasty Ritual Activities for Rain as Seen in Oracle Bone Inscriptions, J. Chin. Stud., 70, 1
Cited by
Still being checked.
Metadata
- Authors
- Hou, Y., Wang, S., Su, Z., Bi, L., Ye, X., & Zhang, Y.
- Affiliations
- University of Edinburgh (GB)
- Corresponding author
- Hou, Yuli
- Venue
- Multimodal Technologies and Interaction
- Publisher
- MDPI AG
- Published
- 2026-09-20
- Volume
- 10
- Issue
- 9
- Pages
- 96
- ISSN
- 2414-4088 (ISSN-L)
- OpenAlex
- W7213999781
- Cited by
- 0
- References
- 49
- FWCI
- 0.00
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Multimodal Technologies and Interaction (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Physical Sciences › Computer Science › Human-Computer Interaction › Virtual Reality Applications and Impacts
- Keywords
- tangible user interfaces, multimodal interaction, embodied interaction, constrained choice, projection mapping, user engagement, emotional reflection, user experience evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Vellum of Lies: Designing and Evaluating a Multimodal Tangible Interaction System for Embodied Serious Historical Narratives. https://app.cochat.ai/papers/10.3390/mti10090096
- The paper
- Hou, Y., Wang, S., Su, Z., Bi, L., Ye, X., & Zhang, Y. (2026). Vellum of Lies: Designing and Evaluating a Multimodal Tangible Interaction System for Embodied Serious Historical Narratives. Multimodal Technologies and Interaction. https://doi.org/10.3390/mti10090096
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.