Tactile Audio Responsive Intelligent System
Open accessThe DOI matches its Crossref record; 45 of the 46 references it cites were found in a registry or an index.
Abstract
For people with visual impairments, information encoded in a visual format creates certain barriers. To alleviate this, a large volume of research has been conducted in the field of assistive technology. In our work, we developed a special system that makes educational materials more accessible. The system consists of three components: the pre-labelled tactile graphics, an interactive labelling web tool and the phone application. Tactile graphics are used at schools for the blind and allow the students to understand non-textual information by touch. The digital version of the graphics first needs to be labelled by teachers using the developed web tool. Then, the phone app, which is based on the Android platform, will accompany those graphics with the audio descriptions. The fundamental purpose of the developed app is to allow the user to gain information without sighted assistance. We also conducted a study to evaluate the system. First, the structured interview was carried out to gather data about the participant’s experience with the tactile graphics and mobile devices. Next, quantitative measurements were obtained through a series of experiments. Subsequently, a post-experimental session was carried out to record the participants’ thoughts and opinions about the system. The results of the experiments demonstrated that the proposed mobile application allows the users to explore the graphics more efficiently.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“A blind participant in Zeinullin and Hersh's study [55] found the lack of clarity in navigation to be a problem: 'I wish the app guided me while I was exploring images. Like, in which direction I should move in order to get to the object' [55].”
From The accessibility of digital technologies for people with visual impairment and blindness: a scoping review (2024) · cites this paper as [55]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803 · cited 7×
“YOLO’s main advantage is the ability to process images in real-time.”
BackgroundMethodInfluentialAn analysis of variance test for normality (complete samples)
SHAPIRO, S. S., & WILK, M. B. (1965) · Biometrika · doi:10.1093/biomet/52.3-4.591 · Cited by 23,480 · cited 1×
“After performing a series of Shapiro-Wilk tests [44], it was verified that most of the data were not normally distributed.”
MethodYOLOv3: An Incremental Improvement
Redmon, J., & Farhadi, A. (2018) · arXiv · doi:10.48550/arxiv.1804.02767 · Cited by 17,141
A Multi-Modal Distributed Real-Time IoT System for Urban Traffic Control (Invited Paper)
Khanam, Z., Achari, V. P. S., Boukhennoufa, I., Jindal, A., & Singh, A. K. (2024) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/oasics.ng-res.2024.2 · Cited by 14,040
Mezei, A., & Paivio, A. (1972) · Leonardo · doi:10.2307/1572599 · Cited by 3,246
Individual Comparisons by Ranking Methods
Wilcoxon, F. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-4380-9_16 · Cited by 2,915
Automatic generation and detection of highly reliable fiducial markers under occlusion
Garrido-Jurado, S., Muñoz-Salinas, R., Madrid-Cuevas, F. J., & Marín-Jiménez, M. J. (2014) · Pattern Recognition · doi:10.1016/j.patcog.2014.01.005 · Cited by 2,604 · cited 1×
“As was mentioned above, Aruco markers [35] are an essential component of TAURIS.”
BackgroundLearning openCV: computer vision with the openCV library
Bradski, G. R., & Kaehler, A. (2008) · CERN Document Server (European Organization for Nuclear Research) · Cited by 2,468
Face detection in color images
Hsu, R.-L., Abdel-Mottaleb, M., & Jain, A. K. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.1000242 · Cited by 1,843
The theory underlying concept maps and how to construct and use them
Cañas, A. J., & Novak, J. D. (2010) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 956
Speeded up detection of squared fiducial markers
Romero-Ramirez, F. J., Muñoz-Salinas, R., & Medina-Carnicer, R. (2018) · Image and Vision Computing · doi:10.1016/j.imavis.2018.05.004 · Cited by 623 · cited 1×
“Experimental results show that the Aruco algorithm works faster than other marker detectors while maintaining accuracy [37].”
BackgroundMediaPipe Hands: On-device Real-time Hand Tracking
Zhang, F., Bazarevsky, V., Vakunov, A., Tkachenka, A., Sung, G., Chang, C.-L., & Grundmann, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.10214 · Cited by 557 · cited 2×
“This app utilises Google’s MediaPipe [30] hand-tracking system for fingertip detection.”
MethodAssistive Technology for Visually Impaired and Blind People
(2008) · Springer eBooks · doi:10.1007/978-1-84628-867-8 · Cited by 426
Self-citationReal-Time Pedestrian Detection with Deep Network Cascades
Angelova, A., Krizhevsky, A., Vanhoucke, V., Ogale, A., & Ferguson, D. (2015) · Procedings of the British Machine Vision Conference 2015 · doi:10.5244/c.29.32 · Cited by 239 · cited 1×
“Whereas real-time execution expects at least 15 fps (frames per second) [31].”
BackgroundNeural correlates of the episodic encoding of pictures and words
Grady, C. L., McIntosh, A. R., Rajah, M. N., & Craik, F. I. M. (1998) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.95.5.2703 · Cited by 192 · cited 1×
“Several studies have demonstrated the ability to remember visuals [4], [5].”
BackgroundPasquero, J., & Vincent Hayward, B. (2003) · Cited by 128
The Tactile Graphics Helper: Providing Audio Clarification for Tactile Graphics Using Machine Vision
Fusco, G., & Morash, V. S. (2015) · Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility - ASSETS '15 · doi:10.1145/2700648.2809868 · Cited by 91 · cited 3×
“In other studies [10], [22], [26], OrCam,2 it is required to point with the index finger only, which, as it was mentioned before, is inconvenient.”
BackgroundResultCavazos Quero, L., Iranzo Bartolomé, J., & Cho, J. (2021) · Electronics · doi:10.3390/electronics10030297 · Cited by 86 · cited 1×
“Several audio-tactile solutions were developed subsequently [10], [15], [16], [17], [18], [19], [20], [21], [22], [23] and are summarised in Table 1.”
BackgroundRefreshable tactile graphics applied to schoolbook illustrations for students with visual impairment
Petit, G., Dufresne, A., Lévesque, V., Vincent Hayward, B., & Trudeau, N. (2008) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/1414471.1414489 · Cited by 77 · cited 1×
“Several audio-tactile solutions were developed subsequently [10], [15], [16], [17], [18], [19], [20], [21], [22], [23] and are summarised in Table 1.”
BackgroundMarkit and Talkit: A Low-Barrier Toolkit to Augment 3D Printed Models with Audio Annotations
Shi, L., Zhao, Y., & Azenkot, S. (2017) · Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3126594.3126650 · Cited by 72 · cited 1×
“developed subsequently [10], [15], [16], [17], [18], [19], [20], [21], [22], [23] and are summarised in Table 1.”
Access lens: a gesture-based screen reader for real-world documents
Kane, S. K., Frey, B., & Wobbrock, J. O. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2470704 · Cited by 63 · cited 1×
“Several audio-tactile solutions were developed subsequently [10], [15], [16], [17], [18], [19], [20], [21], [22], [23] and are summarised in Table 1.”
BackgroundMelfi, G., Müller, K., Schwarz, T., Jaworek, G., & Stiefelhagen, R. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376508 · Cited by 63 · cited 2×
“This finding is consistent with those of [10] and [25].”
BackgroundResultLook what I have felt: Unidentified haptic line drawings are identified after sketching
Wijntjes, M. W. A., van Lienen, T., Verstijnen, I. M., & Kappers, A. M. L. (2008) · Acta Psychologica · doi:10.1016/j.actpsy.2008.01.006 · Cited by 60 · cited 1×
“However, studies show [32], [33] that it is easier to recognise tactile images using both than one hand.”
BackgroundStraight from the Source: Perceptions of Students with Visual Impairments about Graphic Use
Zebehazy, K. T., & Wilton, A. P. (2014) · Journal of Visual Impairment & Blindness · doi:10.1177/0145482x1410800403 · Cited by 58 · cited 2×
“For instance, 52% of 59 visually impaired students were found to agree (or strongly agree) that they liked using TG and wanted more access to them [9].”
BackgroundResultNavigating maps with little or no sight: An audio-tactile approach
Jacobson, D. (1998) · Cited by 57
Tactile graphics in school education: perspectives from pupils
Aldrich, F. K., & Sheppard, L. (2001) · British Journal of Visual Impairment · doi:10.1177/026461960101900204 · Cited by 53
Gesture-Based Interactive Audio Guide on Tactile Reliefs
Reichinger, A., Fuhrmann, A., Maierhofer, S., & Purgathofer, W. (2016) · Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/2982142.2982176 · Cited by 52 · cited 2×
“In other studies [10], [22], [26], OrCam,2 it is required to point with the index finger only, which, as it was mentioned before, is inconvenient.”
BackgroundTactile graphics with a voice: using QR codes to access text in tactile graphics
Baker, C. M., Milne, L. R., Scofield, J., Bennett, C. L., & Ladner, R. E. (2014) · Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility - ASSETS '14 · doi:10.1145/2661334.2661366 · Cited by 51 · cited 2×
“2) TACTILE GRAPHICS WITH A VOICE [26] is an application which runs on a smartphone and provides feedback by scanning QR codes placed on the TG.”
BackgroundMethodLeo, F., Cocchi, E., & Brayda, L. (2017) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2016.2619742 · Cited by 51 · cited 1×
“As there are few advantages in exploring a tactile image with one finger [41], another model was trained using the SingleFive set (Figure 2.b).”
MethodRosenblum, L. P., Cheng, L., & Beal, C. R. (2018) · Journal of Visual Impairment & Blindness · doi:10.1177/0145482x1811200505 · Cited by 49 · cited 3×
“If the user prefers to explore the image with both hands [2], the phone can be mounted on a holder (Figure 1).”
Background(2001) · Information technology and disabilities · Cited by 47
Zebehazy, K. T., & Wilton, A. P. (2014) · Journal of Visual Impairment & Blindness · doi:10.1177/0145482x1410800102 · Cited by 44 · cited 2×
“A recent study [34] of 241 teachers of visually impaired students in Canada and the USA found that almost all (98”
BackgroundResultTactile graphics in school education: perspectives from teachers
Sheppard, L., & Aldrich, F. K. (2001) · British Journal of Visual Impairment · doi:10.1177/026461960101900303 · Cited by 41
Molder: An Accessible Design Tool for Tactile Maps
Shi, L., Zhao, Y., Penuela, R. E. G., Kupferstein, E., & Azenkot, S. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376431 · Cited by 38 · cited 1×
“Researchers from Cornell University created a Molder [27] - an accessible tool for tactile maps design and exploration.”
MethodDo, H.-C., You, J., & Chien, S. (2007) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2007.4341592 · Cited by 34 · cited 1×
“This is due to the fact that skin tone changes under different lighting conditions [42], [43].”
BackgroundYOLSE: Egocentric Fingertip Detection from Single RGB Images
Wu, W., Li, C., Cheng, Z., Zhang, X., & Jin, L. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.79 · Cited by 30 · cited 1×
“In our project, the SCUT-Ego-Gesture Dataset was used for model development [40].”
MethodZebehazy, K. T., & Wilton, A. P. (2014) · Journal of Visual Impairment & Blindness · doi:10.1177/0145482x1410800402 · Cited by 29 · cited 2×
“Several studies [1], [2], [3] have concluded that this enables individuals to communicate and obtain knowledge more effectively.”
BackgroundShen, H., Edwards, O., Miele, J., & Coughlan, J. M. (2013) · Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/2513383.2513423 · Cited by 28 · cited 1×
“developed subsequently [10], [15], [16], [17], [18], [19], [20], [21], [22], [23] and are summarised in Table 1.”
Production of Accessible Tactile Graphics
Prescher, D., Bornschein, J., & Weber, G. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-08599-9_5 · Cited by 26 · cited 1×
“Authors of another study [11] asked users about their experiences with TG exploration and found that 74% of 76 participants expressed positive (medium to very high) attitudes.”
BackgroundExploratory Procedures Employed by Visually Impaired Children During Joint Book Reading
Bara, F. (2013) · Journal of Developmental and Physical Disabilities · doi:10.1007/s10882-013-9352-2 · Cited by 26 · cited 1×
“However, studies show [32], [33] that it is easier to recognise tactile images using both than one hand.”
BackgroundBehavioral Strategies and Problems in Scanning and Interpreting Tactual Displays.
Berlá, E. P. (1972) · The New outlook for the blind · Cited by 7
TARS Mobile App with Deep Fingertip Detector for the Visually Impaired
Miwa, T., Hosokawa, Y., Hashimoto, Y., & Lisi, G. (2020) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-39512-4_48 · Cited by 3 · cited 1×
“In the further work conducted by the same authors [29], it took two seconds to”
MethodParks, D. L. (1988) · Medical Entomology and Zoology · Cited by 3
Hands and Fingers Tracking for Tactile Graphics Reading Assistive Device
Bahrin, M. I. H. S., Yusof, H. M., & Sidek, S. N. (2022) · Lecture notes in electrical engineering · doi:10.1007/978-981-19-2095-0_35 · Cited by 3
Development of TARS Mobile App with Deep Fingertip Detector for the Visually Impaired
Hosokawa, Y., Miwa, T., & Hashimoto, Y. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58796-3_51 · Cited by 2 · cited 1×
“[28] is another mobile application which provides audio descriptions whilst the user explores a tactile image.”
Background
Research works printed but not linked: 1
- gardner, 2006, Scientific diagrams made easy with IVEO™, Proc Int Conf Comput Handicapped Persons, 1243
Cited by
Hamideh Kerdar, S., Bächler, L., & Kirchhoff, B. M. (2024) · Discover Computing · doi:10.1007/s10791-024-09460-7 · Cited by 41
“A blind participant in Zeinullin and Hersh’s study [55] found the lack of clarity in navigation to be a problem: “I wish the app guided me while I was exploring images.”
Jiang, C., Kuang, E., & Fan, M. (2025) · ACM Transactions on Accessible Computing · doi:10.1145/3711931 · Cited by 52
TacNote: Tactile and Audio Note-Taking for Non-Visual Access
Lee, W.-C., Hung, C.-W., Ting, C.-H., Chi, P., & Chen, B. (2023) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3586183.3606784 · Cited by 11
“Finally, with the support from sighted people on pre-made tactile graphics and digital markings, several researchers have shown that BVI people increase their exploration [43, 56].”
BackgroundMapIO: A Gestural and Conversational Interface for Tactile Maps
Manzoni, M., Mascetti, S., Ahmetovic, D., Crabb, R., & Coughlan, J. M. (2025) · IEEE Access · doi:10.1109/access.2025.3566286 · Cited by 14
“For 2D models, this solution was adopted using standard RGB cameras [18], [19] or RGBD (color plus depth) cameras [20].”
Narcisi, A., Shen, H., Ahmetovic, D., Mascetti, S., & Coughlan, J. M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-62846-7_30 · Cited by 7
“However, the increasing availability of powerful hand tracking software has enabled the implementation of touch-based interfaces 5 [13, 10]; these natural interfaces are both convenient and facilitate natural exploration of a tactile graphic or 3D model, which is often done using many fngers on one…”
BackgroundMethod
Metadata
- Authors
- Zeinullin, M., & Hersh, M.
- Affiliations
- University of Glasgow (GB)
- Venue
- IEEE Access
- Published
- 2022
- Volume
- 10
- Pages
- 122074-122091
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W4312850663
- Cited by
- 22
- References
- 46
- Citations by year
- 2026: 4 · 2025: 10 · 2024: 6 · 2023: 2
- FWCI
- 2.32
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) (acceptedVersion, cc-by-sa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Center for International Programs “Bolashak.”
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Keywords
- tactile graphics, audio description, visual impairment, assistive technology, accessible learning materials, mobile application, blind students, accessibility evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.