Multisensory Interactive Storytelling to Augment the Visit of a Historical House Museum
Open accessThe DOI matches its Crossref record; 23 of the 24 references it cites were found in a registry or an index.
Abstract
We present an interactive and multisensory intervention designed for a house museum. Digital technology holds great potential for such heritage sites, but current use is limited to the pre- and post-visit experience. Interviews with museum professionals highlighted their concerns about technology placed in historic houses and suggested four design principles that we used to carefully integrate interactive technology, and the value of a bespoke installation. The installation, the Interactive Tableaux, shows a novel use of digital interactive storytelling where we combined both tangible qualities and informational aspects while respecting the aesthetic of the house and its home feeling. We discuss the process of crafting a conversation in and with a particular place and present evidence from our evaluations that the interactive multisensory installation encouraged observation, reflection and conversation.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In comparison, digital technology is easily seen as dry, a distraction from the actual place and curators of house museums are reluctant to introduce it [11].”
From Crafting Critical Heritage Discourses into Interactive Exhibition Design (2020) · cites this paper as [11]
In the citing paper
“Staff and volunteers play an important role here, as they weave stories and place by sharing with visitors a mixture of facts, speculation and anecdotes about the lives of previous residents [11] [12].”
From Crafting Critical Heritage Discourses into Interactive Exhibition Design (2020) · cites this paper as [11]
In the citing paper
“Critical to this was how we 'crafted content' to resemble a real conversation (see details in [11]): 'I really liked the way they had conversations together.Felt like you were part of the conversation' (v93).”
From Crafting Critical Heritage Discourses into Interactive Exhibition Design (2020) · cites this paper as [11]
In the citing paper
“As such the system was ready for visitors who made the most of their visit by coming back to characters to listen to all remaining content and a lot of them did as we showed in [11].”
From Crafting Critical Heritage Discourses into Interactive Exhibition Design (2020) · cites this paper as [11]
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
Hamlet on the holodeck: the future of narrative in cyberspace
(1997) · Choice Reviews Online · doi:10.5860/choice.35-1342 · Cited by 2,780
Getting a grip on tangible interaction: a framework on physical space and social interaction
Hornecker, E., & Buur, J. (2006) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124838 · Cited by 1,100
Friel, B. (1989) · Cited by 231
Storytelling on mobile devices for cultural heritage
Lombardo, V., & Damiano, R. (2012) · New Review of Hypermedia and Multimedia · doi:10.1080/13614568.2012.617846 · Cited by 134
Using Tangible Smart Replicas as Controls for an Interactive Museum Exhibition
Marshall, M. T., Dulake, N., Ciolfi, L., Duranti, D., Kockelkorn, H., & Petrelli, D. (2016) · Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction · doi:10.1145/2839462.2839493 · Cited by 132
Self-citationShaping experiences in the hunt museum: a design case study
Ferris, K., Bannon, L. J., Ciolfi, L., Gallagher, P., Hall, T., & Lennon, M. (2004) · Designing Interactive Systems Conference · doi:10.1145/1013115.1013144 · Cited by 105
Self-citationNakevska, M., van der Sanden, A., Funk, M., Hu, J., & Rauterberg, M. (2017) · Entertainment Computing · doi:10.1016/j.entcom.2017.01.001 · Cited by 70
Anarchist's Guide to Historic House Museums
Vagnone, F., & Ryan, D. E. (2016) · Routledge eBooks · doi:10.4324/9781315435053 · Cited by 68
CHESS: Personalized Storytelling Experiences in Museums
Katifori, A., Karvounis, M., Kourtis, V., Kyriakidi, M., Roussou, M., Tsangaris, M. M., Vayanou, M., Ioannidis, Y., Balet, O., Prados, T., et al. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-12337-0_28 · Cited by 62
Research works printed but not linked: 3
- israr, 2014, Feel effect: enriching storytelling with haptic feedback, ACM Transactions on Applied Perception, 1
- capurro, 0, Tangible interfaces for digital museum applications The Virtex and Virtex Light systems in the Keys to Rome exhibition, 2015 Digital Heritage, 271
- de reus, 2013, Nonlinear stories told by cups and saucers: smart replicas with responsive 3D audio, Ar[t] Magazine, 3, 34
Cited by
Wang, Z., Yuan, L.-P., Wang, L., Jiang, B., & Zeng, W. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642235 · Cited by 114
Thermal and wind devices for multisensory human-computer interaction: an overview
da Silveira, A. C., Rodrigues, E. C., Saleme, E. B., Covaci, A., Ghinea, G., & Santos, C. A. S. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-14672-y · Cited by 42
Petrelli, D., & Roberts, A. J. (2023) · Journal on Computing and Cultural Heritage · doi:10.1145/3625367 · Cited by 36
Self-citationDuranti, D., Spallazzo, D., & Petrelli, D. (2024) · Journal on Computing and Cultural Heritage · doi:10.1145/3631132 · Cited by 35
“For instance, an interactive belt inspired by the WW1 army uniform detects the position of the visitor in relation to specific points of interest and triggers the playing of stories in place [Marshall et al. 2015].”
Self-citationCrafting Critical Heritage Discourses into Interactive Exhibition Design
Claisse, C., Petrelli, D., Ciolfi, L., Dulake, N., Marshall, M. T., & Durrant, A. C. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376689 · Cited by 30
Self-citationDigital for Heritage and Museums: Design-Driven Changes and Challenges
Lupo, E., Camosino, G., Gobbo, B., Motta, M., Mauri, M., & Parente, M. (2023) · International Association of Societies of Design Research Congress (IASDR) · doi:10.21606/iasdr.2023.397 · Cited by 30
Stories as Boundary Objects: Digital Storytelling with Migrant Communities for Heritage Discourses
Bala, P., Nisi, V., & Nunes, N. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3641016 · Cited by 28
Petrelli, D., Ciolfi, L., & Avram, G. (2021) · Human-Computer Interaction · doi:10.1080/07370024.2021.1946398 · Cited by 24
Self-citationNikolakopoulou, V., Vosinakis, S., Nikopoulos, G., Stavrakis, M., Politopoulos, N., Fragkedis, L., & Koutsabasis, P. (2022) · Journal on Computing and Cultural Heritage · doi:10.1145/3522743 · Cited by 21
Hybrid Interactions in Museums: Why Materiality Still Matters
Ciolfi, L. (2021) · Ubiquity Press eBooks · doi:10.5334/bck.g · Cited by 20
Self-citationThe Diary of Niels: Affective Engagement Through Tangible Interaction with Museum Artifacts
Schou, M. M., & Løvlie, A. S. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-73043-7_24 · Cited by 18
Subtle Sound Design: Designing for Experience Blend in a Historic House Museum
Yates, M. F., & Løvlie, A. S. (2024) · Journal on Computing and Cultural Heritage · doi:10.1145/3633476 · Cited by 18
Un-authorised View: Leveraging Volunteer Expertise in Heritage
Tsenova, V., Wood, G., Dolfini, A., Tindley, A., & Kirk, D. S. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376558 · Cited by 18
Designing with Genius Loci: An Approach to Polyvocality in Interactive Heritage Interpretation
Tsenova, V., Wood, G., & Kirk, D. S. (2022) · Multimodal Technologies and Interaction · doi:10.3390/mti6060041 · Cited by 15
Design synthesis: An act of Research through Design
Conference, R., Claisse, C., Daniela, P., & Dulake, N. (2019) · SHURA (Sheffield Hallam University Research Archive) (Sheffield Hallam University) · doi:10.6084/m9.figshare.7855826 · Cited by 15
Self-citationExperiencing Authenticity of the House Museums in Hybrid Environments
Miano, A., & Borsotti, M. (2023) · Multimodal Technologies and Interaction · doi:10.3390/mti7070072 · Cited by 10
Loci Stories: Exploring Design for Polyvocality
Tsenova, V., Wood, G., & Kirk, D. S. (2023) · Designing Interactive Systems Conference · doi:10.1145/3563657.3596114 · Cited by 9
Carroll, F., Pigott, J., Taylor, A., Thorne, S., & Pinney, J. (2023) · Heritage · doi:10.3390/heritage7010003 · Cited by 7
Park, S., Lee, W., Lee, S., & Lee, W. (2025) · Designing Interactive Systems Conference · doi:10.1145/3715336.3735716 · Cited by 5
Ppali, S., Pasia, M., Wolf, S., Han, J., Muntean, R., Yoo, M., Rodil, K., Berger, A., Papallas, A., Ciolfi, L., et al. (2024) · Designing Interactive Systems Conference · doi:10.1145/3656156.3658400 · Cited by 5
Self-citationGazi, A., Giannakis, T., Marmaras, I., Skoulidas, Y., Stoyannidis, Y., Venieri, F., & Ziff, S. (2021) · Communications in computer and information science · doi:10.1007/978-3-030-83647-4_12 · Cited by 4
Towards Game-Guided Exploration Systems for Self-Facilitated Exhibitions
Krishnasamy, R. (2019) · Electronic workshops in computing · doi:10.14236/ewic/eva2019.32
The augmented house: Crafting tangible interaction in house museums
Claisse, C. (2019) · Sheffield Hallam University · doi:10.7190/shu-thesis-00195
Self-citationWilson, P. F. (2026) · Warwick Research Archive Portal (University of Warwick) · doi:10.82444/warw.33814714
SensoryX ’21 Workshop on Multisensory Experiences at ACM IMX ’21
Covaci, A., Saleme, E. B., & Ghinea, G. (2021) · doi:10.5753/sensoryx.2021.15682
SensoryX ’22 Workshop on Multisensory Experiences at ACM IMX ’22
Covaci, A., Saleme, E. B., Jost, C., dos Santos, J. A. F., & Ghinea, G. (2022) · doi:10.5753/sensoryx.2022.20000
Mixed Reality as Activator of Collaborative Processes for Transcultural Future
Miano, A. (2024) · DIID · doi:10.30682/diiddsi23t3m
Silva, E., Mombelli, A., Bondi, F., Montanari, R., Losi, M. G., & Genovese, G. (2025) · Journal on Computing and Cultural Heritage · doi:10.1145/3771088
Reid, M. (2022) · Maryland Shared Open Access Repository (USMAI Consortium) · doi:10.13016/m2obfh-uost
Sopravvivere alla transizione digitale. Design e Terzo Settore
Costa, P., Fagnoni, R., Foppiani, G., Lodovini, A., Manfroni, M., & Sinni, G. (2025) · AirIuav (Università Iuav di Venezia)
Emergency Design. Esperienze e progetti per la prevenzione del rischio e la gestione dell’emergenza
Maniscalco, E., Ferrara, C., & Costa, M. (2025) · Nova Science Publishers (Nova Science Publishers, Inc.)
Smart Museum Dimensions: Museum Visitor Satisfaction Analysis
Ramadhan, S. H., Priyambodo, T. K., & Mustofa, K. (2026) · Asean Journal on Hospitality and Tourism · doi:10.5614/ajht.2026.24.2.06
Καραχάλιου, Α. (2023) · Institutional Repository Hellanicus
Francesco, B. R., & Campagnaro, C. (2025) · PORTO@Iris
Metadata
- Authors
- Claisse, C., Petrelli, D., Dulake, N., Marshall, M. T., & Ciolfi, L.
- Affiliations
- Sheffield Hallam University (GB)
- Venue
- 2018 3rd Digital Heritage International Congress (DigitalHERITAGE) held jointly with 2018 24th International Conference on Virtual Systems & Multimedia (VSMM 2018)
- Publisher
- IEEE
- Published
- 2018-10
- Pages
- 1-8
- OpenAlex
- W2904588116
- Cited by
- 23
- References
- 24
- Citations by year
- 2025: 1 · 2024: 3 · 2023: 7 · 2022: 3 · 2021: 5 · 2020: 2 · 2019: 2
- FWCI
- 18.83
- Type
- conference paper
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- other-oa
- Locations
- Digital Heritage International Congress (publishedVersion)
- SHURA (Sheffield Hallam University Research Archive) (Sheffield Hallam University) (acceptedVersion)
- Virtual Community of Pathological Anatomy (University of Castilla La Mancha) (submittedVersion, other-oa)
- Newcastle University ePrints (Newcastle Univesity)
- Topics
- Social Sciences › Arts and Humanities › Museology › Museums and Cultural Heritage
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- interactive storytelling, house museums, historic sites, historic houses, tangible interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.