Accessible Visual Artworks for Blind and Visually Impaired People: Comparing a Multimodal Approach with Tactile Graphics
Open accessThe DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index; 4 of the 30 sources its claims cite were checked for support.
Abstract
Despite the use of tactile graphics and audio guides, blind and visually impaired people still face challenges to experience and understand visual artworks independently at art exhibitions. Art museums and other art places are increasingly exploring the use of interactive guides to make their collections more accessible. In this work, we describe our approach to an interactive multimodal guide prototype that uses audio and tactile modalities to improve the autonomous access to information and experience of visual artworks. The prototype is composed of a touch-sensitive 2.5D artwork relief model that can be freely explored by touch. Users can access localized verbal descriptions and audio by performing touch gestures on the surface while listening to themed background music along. We present the design requirements derived from a formative study realized with the help of eight blind and visually impaired participants, art museum and gallery staff, and artists. We extended the formative study by organizing two accessible art exhibitions. There, eighteen participants evaluated and compared multimodal and tactile graphic accessible exhibits. Results from a usability survey indicate that our multimodal approach is simple, easy to use, and improves confidence and independence when exploring visual artworks.
Overview
CoChat Summary
TL;DR
This paper presents an interactive multimodal guide (IMG) combining touch-sensitive 2.5D relief models with on-demand audio descriptions for accessing visual artworks. A usability study with 18 participants found the IMG more effective than traditional tactile graphics for independent artwork exploration.
Key findings
- Eighteen participants rated the IMG as "extremely easy to use," with mean scores of 4.67 (on 5-point scale) for ease of use versus 1.67 for tactile graphics complexity.
- Participants reported higher confidence using IMG (mean 4.83) than with tactile graphics (mean 3.72).
- The IMG was less cumbersome (mean 1.39) compared to tactile graphics (mean 2.89), with switching between Braille and tactile elements cited as the primary burden.
- Participants expressed eagerness to use IMG frequently and demanded it, with one stating "I can't understand why these are not available everywhere for every single artwork."
Methods
- Formative study with 8 blind and visually impaired participants (average age 29.13), art museum and gallery staff, and 2 artists to identify design requirements.
- Evaluation study with 18 participants (age 15–52, mean 27.7) at an accessible gallery and school for blind and visually impaired people.
- 2×2 Latin square test design to counterbalance medium and presentation order; standard usability scale survey administered after each interaction; participants explored five artworks for ~10 minutes without prior training.
Limitations
- Some IMG prototypes failed to register touch gestures correctly, and not all interactive zones had audio feedback, causing users to question system functionality (stated in paper).
- The prototypes only used tactile and audio modalities; the authors note future work should explore other modalities like smell and taste (stated in paper).
- Formative study involved only 8 participants; evaluation study of 18 may not represent broader blind and visually impaired population (evident from text).
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 1 Not valid · 16 Not checked · 74 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Unfortunately, they are ineffective to express visual information of complex images [17,18], such as those present in many visual artworks.”
What the sources say
- Not checked — no full text of the sourcecites [17] Sinha, 2012, Tactile picture recognition: Errors are in shape acquisition or object matching?, See. Perc. source
- Partly supportedcites [18] Brock, 2015, Interactivity improves usability of geographic maps for visually impaired people, Hum. Comput. Interact. sourceExperimental — accuracy not yet measured
The sections “Maps for Visually Impaired People” and “Usability of Interactive Maps for Visually Impaired People” say that excessively detailed tactile maps can become unreadable and that many elements and legends impair readability. The paper addresses geographic maps, not complex images in visual artworks, so it does not establish the claim at that broader level. Page numbers were not available in our copy. (LLM, conf=0.86)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“all of the participants with previous experience with tactile graphics of visual artworks stated dissatisfaction due to their limitations.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“most of the encounters with this type of materials were limited to educational materials and tactile books during their early education or related to STEM subjects and maps.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Only two mentioned having experienced them during a visit to a museum or gallery.”
plainn = 2- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Mixed results were reported in their use for tactile maps.”
plainn = 3- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
30 more claims
Create a free account to see all 95 claims and to verify the 6 references still open.
- Probably not a substantial claim. 52
- It may state two separate claims as one. 23
- The quote only partly states this claim. 1
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 4.1. General Impressions
“All the participants expressed feeling very confident when using the IMG (Table 4-S10)”
§ 4.1. General Impressions
“S10. I needed to learn a lot of things before I could get going with this system.”
Citations
Cites
Zhang, R., Tsai, P.-S., Cryer, J. E., & Shah, M. (1999) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.784284 · Cited by 1,731 · cited 3×
“SFS only requires a single image of the painting to generate the depth information to create a 2.5-dimensional model [49].”
MethodInfluentialConvention on the Rights of Persons with Disabilities (CRPD)
Lord, J. E., & Stein, M. A. (2022) · Elgar Encyclopedia of Human Rights · doi:10.4337/9781789903621.convention.rights.persons.disabilities · Cited by 775
Handbook of Mathematical Models in Computer Vision
(2006) · doi:10.1007/0-387-28831-7 · Cited by 574
Tactual Perception: A Source Book
Geldard, F. A., Schiff, W., & Foulke, E. (1983) · The American Journal of Psychology · doi:10.2307/1422824 · Cited by 338
Interactivity improves usability of geographic maps for visually impaired people
Brock, A. M., Truillet, P., Oriola, B., Picard, D., & Jouffrais, C. (2015) · Human–Computer Interaction · doi:10.1080/07370024.2014.924412 · Cited by 195 · cited 2×
“Some of the improvements are better content exploration [18], learning facilitation [19], and expansion of the amount of information provided without over-complications [20].”
BackgroundAccessible Maps for the Blind: Comparing 3D Printed Models with Tactile Graphics
Holloway, L., Marriott, K., & Butler, M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173772 · Cited by 149 · cited 3×
“[31] - Touch (Embedded capacitive sensors) - Tactile 3D Map- Verbal descriptions - Orientation & Mobility”
BackgroundInfluentialMapSense: Multi-Sensory Interactive Maps for Children Living with Visual Impairments
Brule, E., Bailly, G., Brock, A., Valentin, F., Denis, G., & Jouffrais, C. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858375 · Cited by 122 · cited 2×
“MapSense [26] also uses a touchscreen to identify user touch gestures and conductive tangible tokens placed on the surface.”
BackgroundMethodPrados, E., & Faugeras, O. D. (2005) · Springer eBooks · doi:10.1007/0-387-28831-7_23 · Cited by 106
Accessibility of European museums to visitors with visual impairments
Mesquita, S., & Carneiro, M. J. (2016) · Disability & Society · doi:10.1080/09687599.2016.1167671 · Cited by 106 · cited 1×
“Moreover, they fail to support independent visits, exploration, and the artworks prepared for touch exploration are not the most prominent collection pieces due to the risk of damage [8].”
BackgroundD’Agnano, F., Balletti, C., Guerra, F., & Vernier, P. (2015) · The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences · doi:10.5194/isprsarchives-xl-5-w4-207-2015 · Cited by 98 · cited 3×
“For example, pen-shaped devices like The Talking Tactile Pen [35] or wearables like the ring-shaped Tooteko [36].”
BackgroundThe Tactile Graphics Helper: Providing Audio Clarification for Tactile Graphics Using Machine Vision
Fusco, G., & Morash, V. S. (2015) · Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility - ASSETS '15 · doi:10.1145/2700648.2809868 · Cited by 91 · cited 4×
“[30] The Tactile Graphics Helper - Touch (Mobile Camera)- Voice - Tactile graph- Verbal descriptions - STEM Education- Map Exploration”
BackgroundMethodInfluentialCustomizable 3D Printed Tactile Maps as Interactive Overlays
Taylor, B., Dey, A., Siewiorek, D., & Smailagic, A. (2016) · Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/2982142.2982167 · Cited by 84 · cited 3×
“[24] and LucentMaps [25] make use of the touch screens in mobile devices to detect user–touch interactions in a portable way.”
BackgroundThe Dubious Inheritance of Touch: Art History and Museum Access
Candlin, F. (2006) · Journal of Visual Culture · doi:10.1177/1470412906066906 · Cited by 70 · cited 1×
“One of them is the preservation efforts and prioritization of the primacy of vision to experience the art pieces [13].”
BackgroundMapSense: Multi-Sensory Interactive Maps for Children Living with Visual Impairments
Brulé, É., Bailly, G., Brock, A., et al. (2016) · HAL (Le Centre pour la Communication Scientifique Directe) · Cited by 69
Anagnostakis, G., Antoniou, M., Kardamitsi, E., Sachinidis, T., Koutsabasis, P., Stavrakis, M., Vosinakis, S., & Zissis, D. (2016) · Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct · doi:10.1145/2957265.2963118 · Cited by 67 · cited 2×
“[41] - Touch (PIR and touch sensors) - Tactile Objects- Verbal descriptions - Museum Object Exploration”
BackgroundVisually Augmented Audio-Tactile Graphics for Visually Impaired People
Götzelmann, T. (2018) · ACM Transactions on Accessible Computing · doi:10.1145/3186894 · Cited by 64 · cited 5×
“[25] LucentMaps - Touch (Touchscreen)- Voice - Tactile overlay- Visual agumentation - Orientation & Mobility”
BackgroundInfluentialGual, J., Puyuelo, M., & Lloveras, J. (2014) · British Journal of Visual Impairment · doi:10.1177/0264619614540291 · Cited by 55 · cited 1×
“[33,34], they report improvements in terms of accuracy, efficiency, and memorability compared to two-dimensional symbols.”
BackgroundHolloway, L., Marriott, K., Butler, M., & Reinders, S. (2019) · Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3308561.3353790 · Cited by 55
Gesture-Based Interactive Audio Guide on Tactile Reliefs
Reichinger, A., Fuhrmann, A., Maierhofer, S., & Purgathofer, W. (2016) · Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/2982142.2982176 · Cited by 52
Tactile graphics with a voice: using QR codes to access text in tactile graphics
Baker, C. M., Milne, L. R., Scofield, J., Bennett, C. L., & Ladner, R. E. (2014) · Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility - ASSETS '14 · doi:10.1145/2661334.2661366 · Cited by 51 · cited 4×
“The Tactile Graphics with Voice projects work by using a mobile or wearable device’s camera to identify QR codes printed along a tactile graphic.”
MethodInfluentialThe effect of volumetric (3D) tactile symbols within inclusive tactile maps
Gual, J., Puyuelo, M., & Lloveras, J. (2015) · Applied Ergonomics · doi:10.1016/j.apergo.2014.10.018 · Cited by 50 · cited 1×
“[33,34], they report improvements in terms of accuracy, efficiency, and memorability compared to two-dimensional symbols.”
BackgroundElkhuizen, W. S., Callewaert, T., Leonhardt, E., et al. (2019) · Heritage Science · doi:10.1186/s40494-019-0331-5 · Cited by 50 · cited 1×
“Three of them are 3D laser triangulation, structured light 3D scanning, and focus variation microscopy [47].”
BackgroundScientific diagrams made easy with iveotm
Gardner, J. A., & Bulatov, V. (2006) · Lecture Notes in Computer Science · doi:10.1007/11788713_179 · Cited by 49
From 2D to 2.5D i.e. from painting to tactile model
Furferi, R., Governi, L., Volpe, Y., Puggelli, L., Vanni, N., & Carfagni, M. (2014) · Graphical Models · doi:10.1016/j.gmod.2014.10.001 · Cited by 45
Vaz, R., Fernandes, P. O., & Rocha Veiga, A. C. (2018) · Procedia Computer Science · doi:10.1016/j.procs.2018.10.076 · Cited by 40 · cited 2×
“[42] - Touch (Embedded capacitive sensors) - Tactile Objects- Verbal descriptions- Visual augmentation - Museum Object Exploration”
BackgroundMaking Sense of Art: Access for Gallery Visitors with Vision Impairments
Holloway, L., Marriott, K., Butler, M., & Borning, A. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300250 · Cited by 38 · cited 2×
“[14] evaluated three techniques for visual artwork representation: tactile graphic, 3D print (sculpture model), and laser cut.”
BackgroundMethodPictures in Your Mind: Using Interactive Gesture-Controlled Reliefs to Explore Art
Reichinger, A., Carrizosa, H. G., Wood, J., Schröder, S., Löw, C., Luidolt, L. R., Schimkowitsch, M., Fuhrmann, A., Maierhofer, S., & Purgathofer, W. (2018) · ACM Transactions on Accessible Computing · doi:10.1145/3155286 · Cited by 34
Baker, C. M., Milne, L. R., Drapeau, R., Scofield, J., Bennett, C. L., & Ladner, R. E. (2016) · ACM Transactions on Accessible Computing · doi:10.1145/2854005 · Cited by 31 · cited 4×
“The Tactile Graphics with Voice projects work by using a mobile or wearable device’s camera to identify QR codes printed along a tactile graphic.”
MethodInfluentialLeporini, B., Rossetti, V., Furfari, F., Pelagatti, S., & Quarta, A. (2020) · ACM Transactions on Accessible Computing · doi:10.1145/3399679 · Cited by 31 · cited 2×
“[43] - Touch (Physical buttons) - Tactile 3D Map & Model- Verbal descriptions - Archeological site exploration- Artwork exploration”
BackgroundComputer-based methodologies for semi-automatic 3D model generation from paintings
Volpe, Y., Furferi, R., Governi, L., & Tennirelli, G. (2014) · International Journal of Computer Aided Engineering and Technology · doi:10.1504/ijcaet.2014.058012 · Cited by 30 · cited 1×
“[39] explore the semi-automatic generation of 3D models from digital images of paintings, and classifies four classes of 3D models (tactile outline, textured tactile, flat-layered bas-relief, and bas-relief) for visual artwork representation.”
BackgroundShen, H., Edwards, O., Miele, J., & Coughlan, J. M. (2013) · Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/2513383.2513423 · Cited by 28
Tactile Picture Recognition: Errors Are in Shape Acquisition or Object Matching?
Sinha, P., & Kalia, A. A. (2012) · Seeing and Perceiving · doi:10.1163/187847511x584443 · Cited by 24
(2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-41264-1 · Cited by 22
Tactile colour pictogram to improve artwork appreciation of people with visual impairments
Cho, J. D., Quero, L. C., Bartolomé, J. I., Lee, D. W., Oh, U., & Lee, I. (2021) · Color Research & Application · doi:10.1002/col.22567 · Cited by 19 · cited 1×
“[38] present a novel tactile color pictogram system to communicate the color information of visual artworks.”
BackgroundSelf-citationHoyt, B. O. (2013) · Disability Studies Quarterly · doi:10.18061/dsq.v33i3.3737 · Cited by 15
Leveling the Participatory Field: the Mind's Eye Program at the Guggenheim Museum
Krantz, G. (2013) · Disability Studies Quarterly · doi:10.18061/dsq.v33i3.3738 · Cited by 13
A Concept for Re-useable Interactive Tactile Reliefs
Reichinger, A., Fuhrmann, A. L., Maierhofer, S., & Purgathofer, W. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-41267-2_15 · Cited by 11
Use of tactile pictures to communicate the work of visual artists to blind people
Hinton, R. A. L. (1991) · Journal of Visual Impairment & Blindness · doi:10.1177/0145482x9108500409 · Cited by 10 · cited 1×
“Hinton [40] describes the use of tactile graphics of visual artworks made using thermoforming intended to be explored along with tape recordings.”
BackgroundMiesenberger, K., Klaus, J., & Zagler, W. L. (2002) · Lecture notes in computer science · doi:10.1007/11788713 · Cited by 6
Research works printed but not linked: 5
- Schiff, W., and Foulke, E. (1982). Tactual Perception: A Sourcebook, Cambridge University Press.
- Landau, S., and Wells, L. (2003, January 6–9). Merging tactile sensory input and audio data by means of the Talking Tactile Tablet. Proceedings of the EuroHaptics, Dublin, Ireland.
- Rybaczuk, K., and Blakemore, M.J. (1991). The design of tactile maps: Theoretical and practical considerations. Mapping the Nations: Proceedings, Volume 1, International Cartographic Association.
- Parkes, D. (1988, January 20). “NOMAD”: An audio-tactile tool for the acquisition, use and management of spatially distributed information by partially sighted and blind persons. Proceedings of the Second International Conference on Maps and Graphics for Visually Disabled People, Nottingham, UK.
- Landau, S., Holborow, R., and Jane, E. (2004, January 15–20). Use of the talking tactile tablet for delivery of standardized tests. Proceedings of the CSUN 2004, Los Angeles, CA, USA.
Cited by
A systematic review of digital transformation technologies in museum exhibition
Li, J., Zheng, X., Watanabe, I., & Ochiai, Y. (2024) · Computers in Human Behavior · doi:10.1016/j.chb.2024.108407 · Cited by 136
Zdravkova, K., Krasniqi, V., Dalipi, F., & Ferati, M. (2022) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2022.970430 · Cited by 118
Mukhiddinov, M., & Kim, S.-Y. (2021) · Processes · doi:10.3390/pr9101726 · Cited by 110
“Quero et al. [64] presented an interactive multimodal guide prototype that consisted of a touch-sensitive 2.5D artwork relief model that used audio and tactile graphics to enhance independent access to visual information and knowledge of visual artworks.”
Cho, J. (2021) · Electronics · doi:10.3390/electronics10040470 · Cited by 106
Self-citationLavric, A., Beguni, C., Zadobrischi, E., Căilean, A.-M., & Avătămăniței, S.-A. (2024) · Sensors · doi:10.3390/s24154834 · Cited by 75
Metadata
- Authors
- Cavazos Quero, L., Iranzo Bartolomé, J., & Cho, J.
- Affiliations
- Deptartment of Electrical and Computer Engineering, Sungkyunkwan University, Suwon, Gyeonggi-do 16419, Korea
- Department of Human ICT Convergence, Sungkyunkwan University, Suwon, Gyeonggi-do 16419, Korea
- Venue
- Electronics
- Publisher
- MDPI AG
- Published
- 2021-01-26
- Volume
- 10
- Issue
- 3
- Pages
- 297
- ISSN
- 2079-9292 (ISSN-L)
- OpenAlex
- W3123680532
- Cited by
- 86
- References
- 39
- Citations by year
- 2026: 12 · 2025: 22 · 2024: 24 · 2023: 11 · 2022: 9 · 2021: 8
- FWCI
- 6.82
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Electronics (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Research Foundation of Korea (2018M3C1B6061353)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Social Sciences › Arts and Humanities › Museology › Museums and Cultural Heritage
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Keywords
- accessible art, blind and visually impaired people, tactile graphics, multimodal interaction, touch gestures, audio description, art museums, user-centered design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.