CoChat
Sign Up
Cited by 183Museums and Cultural HeritageInnovative Human-Technology InteractionDigital Accessibility for Disabilities

Human-Centered Artificial Intelligence for Designing Accessible Cultural Heritage

Open access
Pisoni, Galena, Díaz-Rodríguez, Natalia, Gijlers, Hannie, Tonolli, Linda·2021·Applied Sciences
DOI 10.3390/app11020870
Open this paper in CoChat — free accountOpen PDF

Abstract

This paper reviews the literature concerning technology used for creating and delivering accessible museum and cultural heritage sites experiences. It highlights the importance of the delivery suited for everyone from different areas of expertise, namely interaction design, pedagogical and participatory design, and it presents how recent and future artificial intelligence (AI) developments can be used for this aim, i.e.,improving and widening online and in situ accessibility. From the literature review analysis, we articulate a conceptual framework that incorporates key elements that constitute museum and cultural heritage online experiences and how these elements are related to each other. Concrete opportunities for future directions empirical research for accessibility of cultural heritage contents are suggested and further discussed.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/app11020870

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The citation lists haven’t been fetched yet

References 133 · Cited by 183

Research works printed but not linked: 109

  1. Vom Lehn, D.; Heath, C.; Hindmarsh, J. Exhibiting interaction: Conduct and collaboration in museums and galleries. Symb. Interact. 2001, 24, 189-216. [CrossRef] · DOI
  2. Patiwael, P.R.; Groote, P.; Vanclay, F. Improving heritage impact assessment: An analytical critique of the ICOMOS guidelines. Int. J. Herit. Stud. 2019, 25, 333-347. [CrossRef] · DOI
  3. Antoniou, A.; Lepouras, G. Modeling visitors' profiles: A study to investigate adaptation aspects for museum learning technologies. J. Comput. Cult. Herit. 2010, 3, 1-19. [CrossRef] · DOI
  4. Petrelli, D.; Ciolfi, L.; Van Dijk, D.; Hornecker, E.; Not, E.; Schmidt, A. Integrating material and digital: A new way for cultural heritage. Interactions 2013, 20, 58-63. [CrossRef] · DOI
  5. Ackland, P.; Resnikoff, S.; Bourne, R. World blindness and visual impairment: Despite many successes, the problem is growing. Community Eye Health 2017, 30, 71.
  6. Johnson, J. Sensory: Please Touch the Art. Art Educ. 2018, 71, 12-15. [CrossRef] · DOI
  7. Persson, H.; Åhman, H.; Yngling, A.A.; Gulliksen, J. Universal design, inclusive design, accessible design, design for all: Different concepts-One goal? On the concept of accessibility-Historical, methodological and philosophical aspects. Univ. Access Inf. Soc. 2015, 14, 505-526. [CrossRef] · DOI
  8. Ten, A.; Kaushik, P.; Oudeyer, P.Y.; Gottlieb, J. Humans monitor learning progress in curiosity-driven exploration. PsyarXiv 2020. [CrossRef] · DOI
  9. Oudeyer, P.Y. Computational theories of curiosity-driven learning. arXiv 2018, arXiv:1802.10546. · arXiv
  10. Alaimi, M.; Law, E.; Pantasdo, K.D.; Oudeyer, P.Y.; Sauzeon, H. Pedagogical Agents for Fostering Question-Asking Skills in Children. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA, 25-30 April 2020; pp. 1-13.
  11. Popay, J.; Roberts, H.; Sowden, A.; Petticrew, M.; Arai, L.; Rodgers, M.; Britten, N.; Roen, K.; Duffy, S. Guidance on the conduct of narrative synthesis in systematic reviews. Prod. Esrc Methods Program. Version 2006, 1, b92.
  12. Evett, L.; Tan, Y.K. Talk your way round-A speech interface to a virtual museum. Disabil. Rehabil. 2002, 24, 607-612. [CrossRef] [PubMed] · DOI
  13. Dulyan, A.; Edmonds, E. AUXie: Initial evaluation of a blind-accessible virtual museum tour. In Proceedings of the 22nd Conference of the Computer-Human Interaction Special Interest Group of Australia on Computer-Human Interaction, Melbourne, Australia, 22-26 November 2010; pp. 272-275.
  14. Shi, T.; Liu, H. Supporting World War I heritage digitisation and presentation through user-centered web design. In Proceedings of the 2016 SAI Computing Conference (SAI), London, UK, 13-15 July 2016; pp. 1349-1352.
  15. Schwartz, M.; Kautonen, H. The Challenges and Opportunities of Designing National Digital Services for Cross-Border Use. In Proceedings of the International Conference of Design, User Experience, and Usability, Los Angeles, CA, USA, 2-7 August 2015; pp. 104-115.
  16. Sorce, S.; Gentile, V.; Oliveto, D.; Barraco, R.; Malizia, A.; Gentile, A. Exploring Usability and Accessibility of Avatar-based Touchless Gestural Interfaces for Autistic People. In Proceedings of the 7th ACM International Symposium on Pervasive Displays, Munich, Germany, 6-8 June 2018; pp. 1-2.
  17. Yoshino, K.; Obata, K.; Tokuhisa, S. FLIPPIN' Exploring a Paper-based Book UI Design in a Public Space. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, Denver, CO, USA, 6-11 May 2017; pp. 1508-1517.
  18. Rapp, A.; Marcengo, A.; Geymonat, M.; Simeoni, R.; Console, L. E-Inclusion as the next challenge for sustainable consumption. In Proceedings of the International Conference on Universal Access in Human-Computer Interaction, Las Vegas, NV, USA, 21-26 July 2013; pp. 224-232.
  19. Hsu, H.H.; Liao, H.T. A mobile RFID-based tour system with instant microblogging. J. Comput. Syst. Sci. 2011, 77, 720-727. [CrossRef] · DOI
  20. Higuera, J.F.D.; Pernas, F.J.D. MINERVA: Multimedia on the Internet for virtual arts. In Proceedings of the IEEE International Conference on Multimedia Computing and Systems, Florence, Italy, 7-1 June 1999; pp. 825-829.
  21. Usaka, T.; Yura, S.; Fujimori, K.; Mori, H.; Sakamuram, K. A multimedia MUD system for the digital museum. In Proceedings of the 3rd Asia Pacific Computer Human Interaction (Cat. No. 98EX110), Shonan Village Center, Kanagawa, Japan, 15-17 July 1998; pp. 32-37.
  22. Trahanias, P.; Burgard, W.; Argyros, A.; Hahnel, D.; Baltzakis, H.; Pfaff, P.; Stachniss, C. TOURBOT and WebFAIR: Web-operated mobile robots for tele-presence in populated exhibitions. IEEE Robot. Autom. Mag. 2005, 12, 77-89. [CrossRef] · DOI
  23. Ng, M.K.; Primatesta, S.; Giuliano, L.; Lupetti, M.L.; Russo, L.O.; Farulla, G.A.; Indaco, M.; Rosa, S.; Germak, C.; Bona, B. A cloud robotics system for telepresence enabling mobility impaired people to enjoy the whole museum experience. In Proceedings of the 2015 10th International Conference on Design & Technology of Integrated Systems in Nanoscale Era (DTIS), Napoli, Italy, 21-23 April 2015; pp. 1-6.
  24. Partarakis, N.; Klironomos, I.; Antona, M.; Margetis, G.; Grammenos, D.; Stephanidis, C. Accessibility of cultural heritage exhibits. In Proceedings of the International Conference on Universal Access in Human-Computer Interaction, Toronto, ON, Canada, 17-22 July 2016; pp. 444-455.
  25. Chalkia, E.; Bekiaris, E.; Panou, M.; Loukea, M. The Expansion of a Scheme About ACCESSIBILITY in Tourism at the Cultural Sector. In Proceedings of the International Conference on Universal Access in Human-Computer Interaction, Los Angeles, CA, USA, 2-7 August 2015; pp. 21-28.
  26. Trotta, R.; Hajas, D.; Camargo-Molina, J.E.; Cobden, R.; Maggioni, E.; Obrist, M. Communicating cosmology with multisensory metaphorical experiences. J. Sci. Commun. 2020, 19, N01. [CrossRef] · DOI
  27. Carrozzino, M.; Bergamasco, M. Beyond virtual museums: Experiencing immersive virtual reality in real museums. J. Cult. Herit. 2010, 11, 452-458. [CrossRef] · DOI
  28. Coelho, A.; Cardoso, P.; van Zeller, M.; Santos, L.; Raimundo, J.; Vaz, R. Gamifying the Museological Experience. 2020. Available online: https://www.semanticscholar.org/paper/Gamifying-the-Museological-Experience-Coelho-Zeller/21e5b997f9da380 d123300552c5dcfe20814c076 (accessed on 1 January 2021).
  29. Frid, E.; Lindetorp, H.; Hansen, K.F.; Elblaus, L.; Bresin, R. Sound Forest: Evaluation of an Accessible Multisensory Music Installation. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Glasgow, UK, 4-9 May 2019; pp. 1-12.
  30. Vaz, R.; Fernandes, P.O.; Veiga, A.C.R. Designing an interactive exhibitor for assisting blind and visually impaired visitors in tactile exploration of original museum pieces. Procedia Comput. Sci. 2018, 138, 561-570. [CrossRef] · DOI · Paper page
  31. Halbach, T.; Tjostheim, I. Towards Reliable Accessibility Assessments of Science Center Exhibits. In Proceedings of the IFIP Conference on Human-Computer Interaction, Paphos, Cyprus, 2-6 September 2019; pp. 33-41.
  32. Fogli, D.; Arenghi, A. 'Design for All 'Versus' One-Size-Fits-All': The Case of Cultural Heritage. In Proceedings of the Fifth International Workshop on Cultures of Participation in the Digital Age-CoPDA 2018, Castiglione della Pescaia, Grosseto, Italy, 29 May-1 June 2018; pp. 89-96.
  33. Ott, M.; Dagnino, F.M.; Pozzi, F.; Tavella, M. Widening access to Intangible Cultural Heritage: Towards the development of an innovative platform. In Proceedings of the International Conference on Universal Access in Human-Computer Interaction, Heraklion, Crete, Greece, 25-27 June 2014; pp. 705-713.
  34. Song, M.; Elias, T.; Martinovic, I.; Mueller-Wittig, W.; Chan, T.K. Digital heritage application as an edutainment tool. In Proceedings of the 2004 ACM SIGGRAPH International Conference on Virtual Reality Continuum and Its Applications in Industry, Singapore, 16-18 June 2004; pp. 163-167.
  35. Manitsaris, S.; Glushkova, A.; Bevilacqua, F.; Moutarde, F. Capture, modeling, and recognition of expert technical gestures in wheel-throwing art of pottery. J. Comput. Cult. Herit. 2014, 7, 1-15. [CrossRef] · DOI
  36. Dal Falco, F.; Vassos, S. Museum experience design: A modern storytelling methodology. Des. J. 2017, 20, S3975-S3983. [CrossRef] · DOI
  37. Callaway, C.; Stock, O.; Dekoven, E. Experiments with Mobile Drama in an Instrumented Museum for Inducing Conversation in Small Groups. ACM Trans. Interact. Intell. Syst. 2014, 4. [CrossRef] · DOI
  38. Schiavo, G.; Cappelletti, A.; Mencarini, E.; Stock, O.; Zancanaro, M. Influencing participation in group brainstorming through ambient intelligence. Int. J. Hum. Comput. Interact. 2016, 32, 258-276. [CrossRef] · DOI
  39. Zancanaro, M.; Stock, O.; Schiavo, G.; Cappelletti, A.; Gehrmann, S.; Canetti, D.; Shaked, O.; Fachter, S.; Yifat, R.; Mimran, R. Evaluating an automated mediator for joint narratives in a conflict situation. Behav. Inf. Technol. 2020, 39, 1022-1037. [CrossRef] · DOI
  40. Conole, G.; Fill, K. A learning design toolkit to create pedagogically effective learning activities. J. Interact. Media Educ. 2005. [CrossRef] · DOI
  41. Colas, C.; Karch, T.; Lair, N.; Dussoux, J.M.; Moulin-Frier, C.; Dominey, P.F.; Oudeyer, P.Y. Language as a Cognitive Tool to Imagine Goals in Curiosity-Driven Exploration. arXiv 2020, arXiv:2002.09253. · arXiv
  42. Oudeyer, P.Y. Socially guided intrinsic motivation for robot learning of motor skills. Auton. Robot. 2014, 36, 273-294.
  43. Grbic, D.; Palm, R.B.; Najarro, E.; Glanois, C.; Risi, S. EvoCraft: A New Challenge for Open-Endedness. arXiv 2020, arXiv:cs.AI/2012.04751.
  44. Doncieux, S.; Filliat, D.; Díaz-Rodríguez, N.; Hospedales, T.; Duro, R.; Coninx, A.; Roijers, D.M.; Girard, B.; Perrin, N.; Sigaud, O. Open-Ended Learning: A Conceptual Framework Based on Representational Redescription. Front. Neurorobotics 2018, 12, 59. [CrossRef] · DOI
  45. Oudeyer, P. Autonomous development and learning in artificial intelligence and robotics: Scaling up deep learning to human-like learning. arXiv 2017, arXiv:1712.01626. · arXiv
  46. Falk, J.H.; Dierking, L.D. Lifelong science learning for adults: The role of free-choice experiences. In Second International Handbook of Science Education; Springer: Berlin/Heidelberg, Germany, 2012; pp. 1063-1079.
  47. Pecore, J.L.; Kirchgessner, M.L.; Demetrikopoulos, M.K.; Carruth, L.L.; Frantz, K.J. Formal lessons improve informal educational experiences: The influence of prior knowledge on student engagement. Visit. Stud. 2017, 20, 89-104. [CrossRef] · DOI
  48. Hughes, K.; Moscardo, G. ICT and the future of tourist management. J. Tour. Future 2019, 5, 228-240. [CrossRef] · DOI
  49. Hughes, K.; Moscardo, G. For Me or Not For Me? Exploring Young Adults' Museum Representations. Leis. Sci. 2019, 41, 516-534. [CrossRef] · DOI
  50. Povis, K.T.; Crowley, K. Family learning in object-based museums: The role of joint attention. Visit. Stud. 2015, 18, 168-182. [CrossRef] · DOI
  51. Hohenstein, J.; Moussouri, T. Museum Learning; Routledge: Adbigton, UK, 2018.
  52. Horn, M.S.; Phillips, B.C.; Evans, E.M.; Block, F.; Diamond, J.; Shen, C. Visualizing biological data in museums: Visitor learning with an interactive tree of life exhibit. J. Res. Sci. Teach. 2016, 53, 895-918. [CrossRef] · DOI
  53. Land-Zandstra, A.M.; Hoefakker, K.; Damsma, W. Reasoning about Objects in a Natural History Museum: The Effect of Complexity of Questions on Object Labels. Visit. Stud. 2020, 23, 218-236. [CrossRef] · DOI
  54. Nelson, B.C.; Bowman, C.; Bowman, J. Designing for data with ask Dr. Discovery: Design approaches for facilitating museum evaluation with real-time data mining. Technol. Knowl. Learn. 2017, 22, 427-442. [CrossRef] · DOI
  55. Nelson, B.C.; Bowman, C.D.; Bowman, J.D.; Cortés, L.E.P.; Adkins, A.; Escalante, E.; Owen, B.L.; Ha, J.; Su, M. Ask Dr. Discovery: The impact of a casual mobile game on visitor engagement with science museum content. Educ. Technol. Res. Dev. 2020, 68, 345-362. [CrossRef] · DOI
  56. Lakkaraju, H.; Kleinberg, J.; Leskovec, J.; Ludwig, J.; Mullainathan, S. The Selective Labels Problem: Evaluating Algorithmic Predictions in the Presence of Unobservables. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining; ACM: New York, NY, USA, 2017; pp. 275-284. [CrossRef] · DOI · Paper page
  57. Marty, P.F.; Sayre, S.; Fantoni, S.F. Personal digital collections: Involving users in the co-creation of digital cultural heritage. In Handbook of Research on Technologies and Cultural Heritage: Applications and Environments; IGI Global: Hershey, PA, USA, 2011; pp. 285-304.
  58. Marty, P.F. My lost museum: User expectations and motivations for creating personal digital collections on museum websites. Libr. Inf. Sci. Res. 2011, 33, 211-219. [CrossRef] · DOI
  59. Falk, J.H.; Randol, S.; Dierking, L.D. Mapping the informal science education landscape: An exploratory study. Public Underst. Sci. 2012, 21, 865-874. [CrossRef] · DOI
  60. Simonsen, J. Participatory Design. In Routledge International Handbook of Participatory Design;
  61. Asaro, P.M. Transforming society by transforming technology: The science and politics of participatory design. Account. Manag. Inf. Technol. 2000, 10, 257-290. [CrossRef] · DOI
  62. Ehn, P. Scandinavian design: On participation and skill. Particip. Des. Princ. Pract. 1993, 41, 77.
  63. Ehn, P. Participation in Interaction Design: Actors and Artifacts in Interaction; Lawrence Erlbaum Associates: Mahwah, NJ, USA, 2006; pp. 137-154.
  64. Bjerknes, G.; Bratteteig, T. User participation and democracy: A discussion of Scandinavian research on system development. Scand. J. Inf. Syst. 1995, 7, 1.
  65. Braa, J. Community-based participatory design in the Third World. In Proceedings of the Participatory Design Conference, Palo Alto, CA, USA, 13-15 November 1996; Volume 96.
  66. DiSalvo, C.; Clement, A.; Pipek, V. Participatory design for, with, and by communities. Int. Handb. Particip. Des. 2012, 28, 182-209.
  67. Le Dantec, C.A. Designing Publics; MIT Press: Cambridge, MA, USA, 2016.
  68. Manzini, E.; Rizzo, F. Small projects/large changes: Participatory design as an open participated process. CoDesign 2011, 7, 199-215. [CrossRef] · DOI
  69. Light, A.; Seravalli, A. The breakdown of the municipality as caring platform: Lessons for co-design and co-learning in the age of platform capitalism. CoDesign 2019, 15, 192-211. [CrossRef] · DOI
  70. Avram, G.; Choi, J.H.J.; De Paoli, S.; Light, A.; Lyle, P.; Teli, M. Repositioning CoDesign in the age of platform capitalism: From sharing to caring. Int. J. Cocreation Des. Arts 2019, 15, 185-191. [CrossRef] · DOI
  71. Smith, R.C.; Kjærsgaard, M.G. Design anthropology in participatory design from ethnography to anthropological critique? In Proceedings of the 13th Participatory Design Conference: Short Papers, Industry Cases, Workshop Descriptions, Doctoral Consortium Papers, and Keynote Abstracts, Windhoek, Namibia, 6-10 October 2014; Volume 2, pp. 217-218.
  72. Dindler, C.; Iversen, O.S.; Smith, R.; Veerasawmy, R. Participatory design at the museum: Inquiring into children's everyday engagement in cultural heritage. In Proceedings of the 22nd Conference of the Computer-Human Interaction Special Interest Group of Australia on Computer-Human Interaction, Brisbane, Australia, 22-26 November 2010; pp. 72-79.
  73. Macchia, T.; Poderi, G.; D'Andrea, V. Infrastructuring Knowledge in Cultural Infrastructure: Informal Example of Participatory Design for Museum Exhibition. Int. J. Sociotechnol. Knowl. Dev. 2015, 7, 16-32. [CrossRef] · DOI
  74. Zuljevic, M.; van de Weijer, M.; Carabelli, G. Walking, recording and collaborative mapping: How can we advance PD methodology by engaging with heritage? In Proceedings of the 15th Participatory Design Conference: Short Papers, Situated Actions, Workshops and Tutorial, Hasselt, Belgium, 20-24 August 2018; Volume 2, pp. 1-4.
  75. Giaccardi, E. Things we value. Interactions 2011, 18, 17-21. [CrossRef] · DOI
  76. Ciolfi, L. The collaborative work of heritage: Open challenges for CSCW. In Proceedings of the ECSCW 2013: 13th European Conference on Computer Supported Cooperative Work, Paphos, Cyprus, 21-25 September 2013; pp. 83-101.
  77. Cumbo, B.J.; Eriksson, E.; Iversen, O.S. The "Least-Adult" Role in Participatory Design with Children. In Proceedings of the 31st Australian Conference on Human-Computer-Interaction, Perth, Australia, 3-5 December 2019; pp. 73-84.
  78. González, S. Contested Markets, Contested Cities: Gentrification and Urban Justice in Retail Spaces; Routledge: London, UK, 2017.
  79. Ciolfi, L.; Damala, A.; Hornecker, E.; Lechner, M.; Maye, L. Cultural Heritage Communities: Technologies and Challenges; Routledge: London, UK, 2017.
  80. Avram, G.; Ciolfi, L.; Maye, L. Creating tangible interactions with cultural heritage: Lessons learned from a large scale, long term co-design project. CoDesign 2019, 16, 251-266. [CrossRef] · DOI
  81. Ciolfi, L.; Petrelli, D. Studying a community of volunteers at a historic cemetery to inspire interaction concepts. In Proceedings of the 7th International Conference on Communities and Technologies, Limerick, Ireland, 27-30 June 2015; pp. 139-148.
  82. Dindler, C. The construction of fictional space in participatory design practice. CoDesign 2010, 6, 167-182. [CrossRef] · DOI
  83. Smith, J.; Skrbis, Z.; Western, M. Beneath the 'Digital Native'myth: Understanding young Australians' online time use. J. Sociol. 2013, 49, 97-118. [CrossRef] · DOI
  84. Díaz-Rodríguez, N.; Pisoni, G. Accessible Cultural Heritage through Explainable Artificial Intelligence. In Proceedings of the 11th Workshop on Personalized Access to Cultural Heritage, Genova, Italy, 14-17 July 2020.
  85. Guidotti, R.; Monreale, A.; Ruggieri, S.; Turini, F.; Giannotti, F.; Pedreschi, D. A survey of methods for explaining black box models. ACM Comput. Surv. (CSUR) 2018, 51, 1-42. [CrossRef] · DOI · Paper page
  86. Mueller, S.T.; Hoffman, R.R.; Clancey, W.J.; Emrey, A.; Klein, G. Explanation in Human-AI Systems: A Literature Meta-Review, Synopsis of Key Ideas and Publications, and Bibliography for Explainable AI. arXiv 2019, arXiv:1902.01876. · arXiv
  87. Rocchi, C.; Stock, O.; Zancanaro, M.; Kruppa, M.; Krüger, A. The museum visit: Generating seamless personalized presentations on multiple devices. In Proceedings of the 9th International Conference on Intelligent User Interfaces, Madeira, Portugal, 13-16 January 2004; pp. 316-318. 101. Stock, O.; Zancanaro, M. PEACH-Intelligent Interfaces for Museum Visits; Springer Science & Business Media: Berlin/Heidelberg, Germany, 2007. 102.
  88. Kuflik, T.; Stock, O.; Zancanaro, M.; Gorfinkel, A.; Jbara, S.; Kats, S.; Sheidin, J.; Kashtan, N. A visitor's guide in an active museum: Presentations, communications, and reflection. J. Comput. Cult. Herit. 2011, 3, 11. [CrossRef] 103. Aoki, P.M.; Grinter, R.E.; Hurst, A.; Szymanski, M.H.; Thornton, J.D.; Woodruff, A. Sotto voce: Exploring the interplay of conversation and mobile audio spaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Minneapolis, MN, USA, 20-25 April 2002; pp. 431-438. 104. Kostoska, G.; Fezzi, D.; Valeri, B.; Baez, M.; Casati, F.; Caliari, S.; Tarter, S. Collecting memories of the museum experience. In CHI'13 Extended Abstracts on Human Factors in Computing Systems; ACM: New York, NY, USA, 2013; pp. 247-252. 105. Kostoska, G.; Baez, M.; Daniel, F.; Casati, F. Virtual, remote participation in museum visits by older adults: A feasibility study In Proceedings of 8th International Workshop on Personalized Access to Cultural Heritage (PATCH 2015), ACM IUI, Atlanta, GA, USA, 29 March-1 April 2015. 106. Kostoska, G.; Vermeeren, A.P.O.S.; Kort, J.; Gullstrom, C. Virtual, remote participation in museum visits by older adults: A feasibility study. In Proceedings of 10th International Conference on Design & Emotion, Amsterdam, The Netherland, 27-30 September 2016. 107. Pisoni, G. Mediating distance: New interfaces and interaction design techniques to follow and take part in remote museum visits. J. Syst. Inf. Technol. 2020, 22, 331-352. [CrossRef] 108. Pisoni, G.; Daniel, F.; Casati, F.; Callaway, C.; Stock, O. Interactive remote museum visits for older adults: An evaluation of feelings of presence, social closeness, engagement, and enjoyment in an social visit. In Proceedings of the 2019 IEEE International Symposium on Multimedia (ISM), San Diego, CA, USA, 9-11 December 2019; pp. 99-993. 109. Diligenti, M.; Roychowdhury, S.; Gori, M. Integrating prior knowledge into deep learning. In Proceedings of the 2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA), Cancun, Mexico, 18-21 December 2017; pp. 920-923. 110. Hrga, I.; Ivašić-Kos, M. Deep Image Captioning: An Overview. In Proceedings of the 2019 42nd International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), Opatia, Croatia, 20-24 May 2019; pp. 995-1000. 111. Agarwal, P.; Betancourt, A.; Panagiotou, V.; Díaz-Rodríguez, N. Egoshots, an ego-vision life-logging dataset and semantic fidelity metric to evaluate diversity in image captioning models. In Proceedings of the Machine Learning in Real Life (ML-IRL) Workshop at the International Conference on Learning Representations (ICLR), New Orleans, LO, USA, 6-9 May 2020 . 112. Lu, J.; Yang, J.; Batra, D.; Parikh, D. Neural Baby Talk. In Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 18-22 June 2018; pp. 7219-7228. 113. · DOI
  89. Dong, Y.; Su, H.; Zhu, J.; Zhang, B. Improving interpretability of deep neural networks with semantic information. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, 21-26 July 2017; pp. 4306-4314. 118.
  90. Selvaraju, R.R.; Lee, S.; Shen, Y.; Jin, H.; Batra, D.; Parikh, D. Taking a HINT: Leveraging Explanations to Make Vision and Language Models More Grounded. In Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Korea, 27 October-2 November 2019; pp. 2591-2600. 119.
  91. Dost, S.; Serafini, L.; Rospocher, M.; Ballan, L.; Sperduti, A. VTKEL: A resource for visual-textual-knowledge entity linking. In Proceedings of the 35th Annual ACM Symposium on Applied Computing, Brno, Czech Republic, 30 March-3 April 2020; pp. 2021-2028. 120.
  92. Mathews, A.P.; Xie, L.; He, X. Senticap: Generating image descriptions with sentiments. In Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, Phoenix Convention Center, Phoenix, AZ, USA, 12-17 February 2016. 124.
  93. Nezami, O.M.; Dras, M.; Anderson, P.; Hamey, L. Face-cap: Image captioning using facial expression analysis. In Proceedings of the Joint European Conference on Machine Learning and Knowledge Discovery in Databases, Dublin, Ireland, 10-14 September 2018; pp. 226-240. 125.
  94. Beer, J.M.; Takayama, L. Mobile remote presence systems for older adults: Acceptance, benefits, and concerns. In Proceedings of the 6th International Conference on Human-Robot Interaction, Lausanne, Switzerland, 6-9 March 2011; pp. 19-26. 127.
  95. Evers, V.; Menezes, N.; Merino, L.; Gavrila, D.; Nabais, F.; Pantic, M.; Alvito, P.; Karreman, D. The development and real-world deployment of FROG, the fun robotic outdoor guide. In Proceedings of the 2014 ACM/IEEE International Conference on Human-Robot Interaction, Bielefeld Germany, 3-6 March 2014; p. 100. 128.
  96. Evers, V.; Menezes, N.; Merino, L.; Gavrila, D.; Nabais, F.; Pantic, M.; Alvito, P. The Development and Real-World Application of FROG, the Fun Robotic Outdoor Guide. In Proceedings of the Companion Publication of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing, Portland, OR, USA, 15-19 February 2014; Association for Computing Machinery: New York, NY, USA, 2014; p. 281-284. [CrossRef] 129. Maye, L.A.; McDermott, F.E.; Ciolfi, L.; Avram, G. Interactive exhibitions design: What can we learn from cultural heritage professionals? In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational, Helsinki, Finland, 26-30 October 2014; pp. 598-607. 130. · DOI
  97. Davison, D.P.; Wijnen, F.M.; Charisi, V.; van der Meij, J.; Reidsma, D.; Evers, V. Words of encouragement: How praise delivered by a social robot changes children's mindset for learning. J. Multimodal User Interfaces 2020, 17, 1-16. 132.
  98. Charisi, V.; Malinverni, L.; Rubegni, E.; Schaper, M.M. Empowering Children's Critical Reflections on AI, Robotics and Other Intelligent Technologies. In Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society, Tallinn, Estonia, 25-29 October 2020; pp. 1-4. 133. Drohan, M.; Faustini, P. UNICEF Office of Research-Innocenti; UNICEF: Florence, Italy, 2019. 134.
  99. MacLeod, H.; Bennett, C.L.; Morris, M.R.; Cutrell, E. Understanding blind people's experiences with computer-generated captions of social media images. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, Denver, CO, USA, 6-11 May 2017; pp. 5988-5999. 137.
  100. McCoy, R.T.; Pavlick, E.; Linzen, T. Right for the wrong reasons: Diagnosing syntactic heuristics in natural language inference. arXiv 2019, arXiv:1902.01007. 140. · arXiv
  101. Herzig, R.; Bar, A.; Xu, H.; Chechik, G.; Darrell, T.; Globerson, A. Learning Canonical Representations for Scene Graph to Image Generation. arXiv 2020, arXiv:cs.CV/1912.07414. 141.
  102. Mellor, J.F.J.; Park, E.; Ganin, Y.; Babuschkin, I.; Kulkarni, T.; Rosenbaum, D.; Ballard, A.; Weber, T.; Vinyals, O.; Eslami, S.M.A. Unsupervised Doodling and Painting with Improved SPIRAL. arXiv 2019, arXiv:cs.CV/1910.01007. 142. Maillet, F.; Eck, D.; Desjardins, G.; Lamere, P. Steerable Playlist Generation by Learning Song Similarity from Radio Station Playlists. In Proceedings of the 10th International Conference on Music Information Retrieval, Kobe, Japan, 26-30 October 2009; pp. 345-350. 143. Huang, C.Z.A.; Vaswani, A.; Uszkoreit, J.; Shazeer, N.; Hawthorne, C.; Dai, A.M.; Hoffman, M.D.; Eck, D. An Improved Relative Self-Attention Mechanism for Transformer with Application to Music Generation. arXiv 2018, arXiv:1809.04281. 144. · arXiv
  103. Roberts, A.; Engel, J.; Mann, Y.; Gillick, J.; Kayacik, C.; Nørly, S.; Dinculescu, M.; Radebaugh, C.; Hawthorne, C.; Eck, D. Magenta Studio: Augmenting Creativity with Deep Learning in Ableton Live. In Proceedings of the International Workshop on Musical Metacreation (MUME), Charlotte, CA, USA, 17-18 June 2019. 145. Ippolito, D.; Duckworth, D.; Callison-Burch, C.; Eck, D. Human and Automatic Detection of Generated Text. arXiv 2019, arXiv:1911.00650. 146. Behrooz, M.; Robertson, J.; Jhala, A. Story Quality as a Matter of Perception: Using Word Embeddings to Estimate Cognitive Interest. In Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, Georgia Tech, Atlanta, GA, USA, 8-12 October 2019; Volume 15, pp. 3-9. 147. · arXiv
  104. Behrooz, M.; Jhala, A. Modeling social interestingness in conversational stories. In Proceedings of the Australasian Computer Science Week Multiconference, Geelong, Australia, 31 January-3 February 2017; pp. 1-6. 148. Behrooz, M. Curating Interest in Open Story Generation. Ph.D. Thesis, University of California Santa Cruz, Santa Cruz, CA, USA, 2019. 149. Bollacker, K.; Díaz-Rodríguez, N.; Li, X. Extending Knowledge Graphs with Subjective Influence Networks for Personalized Fashion. In Designing Cognitive Cities;
  105. Portmann, E., Tabacchi, M.E., Seising, R., Habenstein, A., Eds.; Springer International Publishing: Cham, Switzerland, 2019; pp. 203-233. 150. Ramalho, T.; Kociský, T.; Besse, F.; Eslami, S.M.A.; Melis, G.; Viola, F.; Blunsom, P.; Hermann, K.M. Encoding Spatial Relations from Natural Language. arXiv 2018, arXiv:1807.01670. 151. Cornia, M.; Stefanini, M.; Baraldi, L.; Corsini, M.; Cucchiara, R. Explaining digital humanities by aligning images and textual descriptions. Pattern Recognit. Lett. 2020, 129, 166-172. [CrossRef] 152. Sanchez, J.; Díaz-Rodríguez, N.; Tabik, S.; Lamas, A.; Donadello, I.; Franchi, G.; Filliat, D.; Herrera, F. EXPLANet: Expert-aligned eXplainable Part-based cLAssifying NETwork via SHAP Backprop for compositional neural-symbolic learning with domain expert knowledge graphs. 2021, submitted. 153. · DOI
  106. Bennetot, A.; Charisi, V.; Díaz-Rodríguez, N. Should artificial agents ask for help in human-robot collaborative problem-solving? ICRA Brain-PIL Workshop-New advances in brain-inspired perception, interaction and learning. arXiv 2020, arXiv:2006.00882. 154. · arXiv
  107. Hoffman, R.R.; Mueller, S.T.; Klein, G.; Litman, J. Metrics for explainable ai: Challenges and prospects. arXiv 2018, arXiv:1812.04608. 155. Pérez-Higueras, N.; Ramón-Vigo, R.; Hurtado, I.P.; Capitán, J.; Caballero, F. A social navigation system in telepresence robots for elderly. In Proceedings of the Workshop on the International Conference on Social Robotics, Kansas City, MO, USA, 1-3 November 2016. 156. Yang, G.Z.J.; Nelson, B.; Murphy, R.R.; Choset, H.; Christensen, H.H.; Collins, S.; Dario, P.; Goldberg, K.; Ikuta, K.; Jacobstein, N.; et al. Combating COVID-19-The role of robotics in managing public health and infectious diseases. Sci. Robot. 2020, 5. Available online: https://robotics.sciencemag.org/content/5/40/eabb5589.full.pdf (accessed on 11 January 2021). [CrossRef] [PubMed] 157. UNICEF. AI and child rights policy. In Workshop Towards Global Guidance on AI and Child Rights, Office of Global Insight and Policy 26-27 June; UNICEF: New York, NY, USA, 2019; p. 13. 158. · DOI
  108. Charisi, V.; Šabanović, S.; Cangelosi, A.; Gomez, R. Designing and Developing Better Robots for Children: A Fundamental Human Rights Perspective. In Proceedings of the Intl Conference on Human Robot Interaction, Boulder, CO, USA, 8-11 March 2021. 159.
  109. Charisi, V.; Malinverni, L.; Schaper, M.M.; Rubegni, E. Creating opportunities for children's critical reflections on AI, robotics and other intelligent technologies. In Proceedings of the 2020 ACM Interaction Design and Children Conference: Extended Abstracts, London, UK, June 2020; pp. 89-95.

Authors
Pisoni, G., Díaz-Rodríguez, N., Gijlers, H., & Tonolli, L.
Affiliations
  • Université Côte d'Azur (FR)
  • Institut national de recherche en sciences et technologies du numérique (FR)
  • University of Twente (NL)
  • University of Trento (IT)
Corresponding author
Pisoni, Galena
ORCID
Venue
Applied Sciences
Publisher
MDPI AG
Published
2021-01-19
Volume
11
Issue
2
Pages
870
ISSN
2076-3417 (ISSN-L)
DOI
10.3390/app11020870
OpenAlex
W3121927947
Cited by
183
References
133
Citations by year
2026: 42 · 2025: 55 · 2024: 41 · 2023: 27 · 2022: 10 · 2021: 8
FWCI
173.33
Type
journal article
Language
en
Open access
Licence
Locations
  • Applied Sciences (publishedVersion, cc-by)
  • University of Twente Research Information (publishedVersion, cc-by)
  • Institutional Research Information System (Università degli Studi di Trento) (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • University of Twente Research Information (submittedVersion, cc-by)
Funders
Fondazione Cassa Di Risparmio Di Trento E Rovereto
Topics
  • Social Sciences › Arts and Humanities › Museology › Museums and Cultural Heritage
  • Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
  • Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
Keywords
human-centered AI, accessibility, cultural heritage, museums, interaction design, participatory design, instructional design, conceptual framework

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review