Gesture-Based Interactive Audio Guide on Tactile Reliefs
The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
For blind and visually impaired people, tactile reliefs offer many benefits over the more classic raised line drawings or tactile diagrams, as depth, 3D shape and surface textures are directly perceivable. However, without proper guidance some reliefs are still difficult to explore autonomously.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
User-defined gestures for surface computing
Wobbrock, J. O., Morris, M. R., & Wilson, A. D. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518866 · Cited by 1,317 · cited 1×
“[33]) these are only valid for dynamic interaction on flat screens, and are not directly applicable.”
BackgroundEfficient model-based 3D tracking of hand articulations using Kinect
Oikonomidis, I., Kyriazis, N., & Argyros, A. (2011) · Procedings of the British Machine Vision Conference 2011 · doi:10.5244/c.25.101 · Cited by 874 · cited 3×
“The probably most similar approach is a feasibility study [4], which uses a Microsoft Kinect with the CVRL FORTH Hand Tracker [20] to trigger audio by touch events of the right in dex fingertip on tactile reliefs.”
MethodThe use of eye movements in human-computer interaction techniques: what you look at is what you get
Jacob, R. J. K. (1991) · ACM Transactions on Information Systems · doi:10.1145/123078.128728 · Cited by 845 · cited 1×
“The user should be able to explore the relief with one or both hands without triggering unwanted audio and avoid Midas touch effects [14, p. 156].”
BackgroundAccurate, Robust, and Flexible Real-time Hand Tracking
Sharp, T., Keskin, C., Robertson, D., Taylor, J., Shotton, J., Kim, D., Rhemann, C., Leichter, I., Vinnikov, A., Wei, Y., et al. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702179 · Cited by 431 · cited 1×
“Based on the selected set of gestures, the requirements for the gesture detection system are as follows: 1) a reliable detection of hands and individual fingers, 2) measurement of the palm height for off-relief gestures, 3) detection of touch events of a pointing finger and the position of the touch.”
Usable gestures for blind people: understanding preference and performance
Kane, S. K., Wobbrock, J. O., & Ladner, R. E. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979001 · Cited by 314 · cited 1×
“Despite ongoing research on gestures for BVI people (e.g. [16]) and user-elicited gestures (e.g. [33]) these are only valid for dynamic interaction on flat screens, and are not directly applicable.”
BackgroundUsing a depth camera as a touch sensor
Wilson, A. D. (2010) · ACM International Conference on Interactive Tabletops and Surfaces · doi:10.1145/1936652.1936665 · Cited by 262 · cited 2×
“Probably for the first time, Wilson [31] introduced the concept of using a depth camera as a touch sensor on non-flat surfaces.”
BackgroundHand tracking and gesture recognition system for human-computer interaction using low-cost hardware
Yeo, H.-S., Lee, B.-G., & Lim, H. (2015) · Multimedia Tools and Applications · doi:10.1007/s11042-013-1501-1 · Cited by 210 · cited 7×
“Because of the demonstrated robustness and the detailed documentation we based our implementation on [35].”
BackgroundMethodInfluentialO'Modhrain, S., Giudice, N. A., Gardner, J. A., & Legge, G. E. (2015) · IEEE Transactions on Haptics · doi:10.1109/toh.2015.2466231 · Cited by 100
D’Agnano, F., Balletti, C., Guerra, F., & Vernier, P. (2015) · The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences · doi:10.5194/isprsarchives-xl-5-w4-207-2015 · Cited by 98 · cited 1×
“For instance, Tooteko [5] integrates NFC Tags in 3D models which are read by a wearable NFC reader.”
BackgroundScalable 3D Tracking of Multiple Interacting Objects
Kyriazis, N., & Argyros, A. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.438 · Cited by 98 · cited 1×
“In a future implemen tation this can be improved, using multiple sensors, and/or a fully articulated hand tracker that allows overlap (e.g. [18]).”
Background3D Object Detection and Localization Using Multimodal Point Pair Features
Drost, B., & Ilić, S. (2012) · International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission · doi:10.1109/3dimpvt.2012.53 · Cited by 96 · cited 1×
“Manual ini tialization [4] and fiducial markers [29] might be eliminated by detecting the base plane and corners of rectangular re liefs, or by using novel 3D feature based algorithms [7].”
MethodThe Tactile Graphics Helper: Providing Audio Clarification for Tactile Graphics Using Machine Vision
Fusco, G., & Morash, V. S. (2015) · Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility - ASSETS '15 · doi:10.1145/2700648.2809868 · Cited by 91 · cited 2×
“The Tactile Graph ics Helper [12] plays pre-recorded audio when the finger is over pre-defined labels, and is triggered by voice commands.”
BackgroundKlatzky, R. L., Giudice, N. A., Bennett, C. R., & Loomis, J. M. (2014) · Multisensory Research · doi:10.1163/22134808-00002447 · Cited by 74 · cited 1×
“…) objects [1, 8] like tactile dia grams, line drawings or plans, e.g. on embossed paper, swell paper, and increasingly also with vibrotactile cues [17, 22], b) fully 3D objects [23, 26, 30, 34] like anatomical models, 3D-printed reproductions or everyday objects, and c) the 2.5D realm in-between,…”
BackgroundArt Beyond Sight: A Resource Guide to Art, Creativity, and Visual Impairment
Axel, E. S., & Levent, N. (2002) · Medical Entomology and Zoology · Cited by 69
Access lens: a gesture-based screen reader for real-world documents
Kane, S. K., Frey, B., & Wobbrock, J. O. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2470704 · Cited by 63 · cited 1×
“Several projects utilize color cameras to track the user’s fingertips: Access Lens [15] recognizes and reads texts on documents where the finger points at.”
BackgroundHigh-quality tactile paintings
Reichinger, A., Maierhofer, S., & Purgathofer, W. (2011) · Journal on Computing and Cultural Heritage · doi:10.1145/2037820.2037822 · Cited by 63 · cited 2×
“The demand and importance is demon strated by more and more art shows (e.g. [27]) all over the world incorporating tactile reliefs, as well as technical devel opments [10, 11, 25] in order to ease their creation.”
BackgroundMethodSelf-citationTactile graphics with a voice: using QR codes to access text in tactile graphics
Baker, C. M., Milne, L. R., Scofield, J., Bennett, C. L., & Ladner, R. E. (2014) · Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility - ASSETS '14 · doi:10.1145/2661334.2661366 · Cited by 51 · cited 1×
“Tactile Graphics with a Voice [2] is an app for cell phones and Google Glass, that reads labels indicated by QR codes.”
The 65th IFLA Council and General Conference
Division, C. N., & Bang, T. (1999) · Interlending & Document Supply · doi:10.1108/ilds.1999.12227bab.012 · Cited by 50
Scientific diagrams made easy with iveotm
Gardner, J. A., & Bulatov, V. (2006) · Lecture Notes in Computer Science · doi:10.1007/11788713_179 · Cited by 49 · cited 1×
“The Talking Tactile Tablet [19] and ViewPlus’ IVEO [13] detects touch-gestures on tactile diagrams put on a high-resolution touch pad.”
Background(2001) · Information technology and disabilities · Cited by 47
From 2D to 2.5D i.e. from painting to tactile model
Furferi, R., Governi, L., Volpe, Y., Puggelli, L., Vanni, N., & Carfagni, M. (2014) · Graphical Models · doi:10.1016/j.gmod.2014.10.001 · Cited by 45 · cited 1×
“The demand and importance is demon strated by more and more art shows (e.g. [27]) all over the world incorporating tactile reliefs, as well as technical devel opments [10, 11, 25] in order to ease their creation.”
BackgroundEnlarged Skeleton Models of Plankton for Tactile Teaching
Teshima, Y., Matsuoka, A., Fujiyoshi, M., Ikegami, Y., Kaneko, T., Oouchi, S., Watanabe, Y., & Yamazawa, K. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-14100-3_78 · Cited by 32 · cited 1×
“…line drawings or plans, e.g. on embossed paper, swell paper, and increasingly also with vibrotactile cues [17, 22], b) fully 3D objects [23, 26, 30, 34] like anatomical models, 3D-printed reproductions or everyday objects, and c) the 2.5D realm in-between, i.e., “height fields, surfaces that…”
BackgroundComputer-Aided Design of Tactile Models
Reichinger, A., Neumüller, M., Rist, F., Maierhofer, S., & Purgathofer, W. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-31534-3_73 · Cited by 31
Self-citationShen, H., Edwards, O., Miele, J., & Coughlan, J. M. (2013) · Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/2513383.2513423 · Cited by 28 · cited 4×
“Manual ini tialization [4] and fiducial markers [29] might be eliminated by detecting the base plane and corners of rectangular re liefs, or by using novel 3D feature based algorithms [7].”
BackgroundMethodResultInfluentialKin'touch: understanding how visually impaired people explore tactile maps
Brock, A., Lebaz, S., Oriola, B., Picard, D., Jouffrais, C., & Truillet, P. (2012) · CHI '12 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/2212776.2223821 · Cited by 23 · cited 1×
“And, Kin’touch [3] studies the combination of optical fin ger tracking and touch events from a capacitive multi-touch screen.”
BackgroundMaking Blind People Autonomous in the Exploration of Tactile Models: A Feasibility Study
Buonamici, F., Furferi, R., Governi, L., & Volpe, Y. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-20681-3_8 · Cited by 17
Oouchi, S., Yamazawa, K., & Secchi, L. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-14100-3_79 · Cited by 16 · cited 1×
“on embossed paper, swell paper, and increasingly also with vibrotactile cues [17, 22], b) fully 3D objects [23, 26, 30, 34] like anatomical models, 3D-printed reproductions or everyday objects, and c) the 2.”
BackgroundTactile 3D Bas-relief from Single-point Perspective Paintings: A Computer Based Method
Furferi, R. (2014) · Journal of Information and Computational Science · doi:10.12733/jics20104135 · Cited by 15
Yamazawa, K., Teshima, Y., Watanabe, Y., Ikegami, Y., Fujiyoshi, M., Oouchi, S., & Kaneko, T. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-31534-3_74 · Cited by 7 · cited 1×
“…line drawings or plans, e.g. on embossed paper, swell paper, and increasingly also with vibrotactile cues [17, 22], b) fully 3D objects [23, 26, 30, 34] like anatomical models, 3D-printed reproductions or everyday objects, and c) the 2.5D realm in-between, i.e., “height fields, surfaces that can be…”
Background
Research works printed but not linked: 3
- Axel E. S., 2003, AFB Press
- Edman P. K., 1992, New York
- Reichinger A., 2016, ICCHP2016, 9759, 108
Cited by
Cavazos Quero, L., Iranzo Bartolomé, J., & Cho, J. (2021) · Electronics · doi:10.3390/electronics10030297 · Cited by 86
Markit and Talkit: A Low-Barrier Toolkit to Augment 3D Printed Models with Audio Annotations
Shi, L., Zhao, Y., & Azenkot, S. (2017) · Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3126594.3126650 · Cited by 72
“Previous projects that required a 3D print to be fixed to a surface or attached to a device inhibited a user’s ability to explore the model [12,18,31,43,52,62].”
BackgroundMethodMelfi, G., Müller, K., Schwarz, T., Jaworek, G., & Stiefelhagen, R. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376508 · Cited by 63
“Instead of using touch displays, some approaches use finger tracking methods [8, 19, 22, 27].”
MethodEyes-Free Art: Exploring Proxemic Audio Interfaces For Blind and Low Vision Art Engagement
Rector, K., Salmon, K., Thornton, D., Joshi, N., & Morris, M. R. (2017) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3130958 · Cited by 58
“[39] augmented the tactile reliefs by adding an interactive audio guide for people who are visually impaired to independently explore with their finger.”
BackgroundUnderstanding Visual Arts Experiences of Blind People
Li, F. M., Zhang, L., Bandukda, M., Stangl, A. J., Shinohara, K., Findlater, L., & Carrington, P. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580941 · Cited by 92
“A range of system innovations further added interactivity to these multimodal presentations to help blind people understand visual arts through exploration [4, 25, 31, 54, 74, 103, 121].”
Background
Metadata
- Authors
- Reichinger, A., Fuhrmann, A., Maierhofer, S., & Purgathofer, W.
- Affiliations
- VRVis GmbH (Austria) (AT)
- ORCID
- Reichinger, Andreas
- Venue
- Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility
- Publisher
- ACM
- Published
- 2016-10-23
- Pages
- 91-100
- OpenAlex
- W2538440082
- Cited by
- 52
- References
- 29
- Citations by year
- 2026: 1 · 2025: 7 · 2024: 5 · 2023: 6 · 2022: 4 · 2021: 5 · 2020: 8 · 2019: 7 · 2018: 5 · 2017: 3 · 2016: 1
- FWCI
- 9.16
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) (publishedVersion)
- Funders
- Austrian Science Fund (P24352-N23)
- Erasmus+ (2014-1-AT01-KA204-001014)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Keywords
- gesture-based interaction, audio guides, blind and visually impaired users, accessible design, surface texture perception, assistive technology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.