CoChat

A comprehensive review on NUI, multi-sensory interfaces and UX design for applications and devices for visually impaired users

Open access

The DOI matches its Crossref record; 56 of the 57 references it cites were found in a registry or an index.

Abstract

In today’s world, there has been a significant increase in the use of devices, gadgets, and mobile applications in our daily activities. Although this has had a significant impact on the lives of the general public, people who are Partially Visually Impaired SPVI, which includes a much broader range of vision loss that includes mild to severe impairments, and Completely Visually Impaired (CVI), who have no light perception, still face significant obstacles when trying to access and use these technologies. This review article aims to provide an overview of the NUI, Multi-sensory Interfaces and UX Design (NMUD) of apps and devices specifically tailored CVI and PVI individuals. The article begins by emphasizing the importance of accessible technology for the visually impaired and the need for a human-centered design approach. It presents a taxonomy of essential design components that were considered during the development of applications and gadgets for individuals with visual impairments. Furthermore, the article sheds light on the existing challenges that need to be addressed to improve the design of apps and devices for CVI and PVI individuals. These challenges include usability, affordability, and accessibility issues. Some common problems include battery life, lack of user control, system latency, and limited functionality. Lastly, the article discusses future research directions for the design of accessible apps and devices for visually impaired individuals. It emphasizes the need for more user-centered design approaches, adherence to guidelines such as the Web Content Accessibility Guidelines, the application of e-accessibility principles, the development of more accessible and affordable technologies, and the integration of these technologies into the wider assistive technology ecosystem.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3389/fpubh.2024.1357160

Cites

56 of 56 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 (a) Human based elements in the device design for visually impaired; (b) human based elements in the app design for visually impaired.
Figure 1 (a) Human based elements in the device design for visually impaired; (b) human based elements in the app design for visually impaired.CC BY · PubMed Central
Figure 2 (a) Search string used in this review; (b) PRISMA flow diagram for the selection process of the research articles used in this review.
Figure 2 (a) Search string used in this review; (b) PRISMA flow diagram for the selection process of the research articles used in this review.CC BY · PubMed Central
Figure 3 (a) Trend of studies on NMUD design of apps and devices for visually impaired over time; (b) trend of studies on NMUD design of apps and devices for visually impaired by continent.
Figure 3 (a) Trend of studies on NMUD design of apps and devices for visually impaired over time; (b) trend of studies on NMUD design of apps and devices for visually impaired by continent.CC BY · PubMed Central
Figure 4 (a) Open challenges—NMUD of devices for visually impaired; (b) open challenges—NMUD of apps for visually impaired.
Figure 4 (a) Open challenges—NMUD of devices for visually impaired; (b) open challenges—NMUD of apps for visually impaired.CC BY · PubMed Central
Figure 5 Future research directions.
Figure 5 Future research directions.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 38

  1. Pohjolainen S. (2020). Usability and user experience evaluation model for investigating coordinated assistive technologies with blind and visually impaired (Doctoral dissertation, Master's thesis, University of Oulu).
  2. Torres-Carazo M. I., Rodriguez-Fortiz M. J., Hurtado M. V. (2016). "Analysis and review of apps and serious games on mobile devices intended for people with visual impairment. " 2016 IEEE international conference on serious games and applications for health (SeGAH), serious games and applications for health (SeGAH), 1-8.
  3. Kim W. J., Kim I. K., Jeon M. K., Kim J. (2016). "UX design guideline for health Mobile application to improve accessibility for the visually impaired. " 2016 international conference on platform technology and service (PlatCon), platform technology and service (PlatCon), 1-5.
  4. Crow KL. Universal design principles: An overview. Annual Proceedings Anaheim. (2007) 2:99.
  5. Buzzi Marina, Leporini Barbara, Meattini Clara. (2018). Simple smart HomesWeb interfaces for blind people. 223-230.
  6. Helal A., Moore S. E., Ramachandran B. (2001). "Drishti: an integrated navigation system for visually impaired and disabled. " Proceedings fifth international symposium on wearable computers, wearable computers, 2001. Proceedings. Fifth International Symposium on, Wearable Computers, 149-156.
  7. Harjumaa M., Isomursu M., Muuraiskangas S., Konttila A. (2011). "HearMe: a touch-to-speech UI for medicine identification. " 2011 5th international conference on pervasive computing Technologies for Healthcare (PervasiveHealth) and workshops, pervasive computing Technologies for Healthcare (PervasiveHealth), 85-92.
  8. Devkar S., Lobo S., Doke P. (2015). "A grounded theory approach for designing communication and collaboration system for visually impaired chess players. " In Universal access in human-computer interaction. Access to Today's technologies: 9th international conference, UAHCI 2015, held as part of HCI international 2015, Los Angeles, CA, USA, august 2-7, 2015, proceedings, part I 9 (pp. 415-425). Springer International Publishing.
  9. Aiordachioae A., Schipor O.-A., Vatavu R.-D. (2020). "An inventory of voice input commands for users with visual impairments and assistive smart glasses applications. " 2020 international conference on development and application systems (DAS), development and application systems (DAS), 146-150.
  10. Chen H.-E., Chen C.-H., Lin Y.-Y., Wang I.-F. (2015). "BlindNavi: a navigation app for the visually impaired smartphone user. " Conference on Human Factors in Computing Systems -Proceedings, 18, 19-24.
  11. Landazabal N. P., Andres Mendoza Rivera O., Martınez M.H, Uchida B. T. (2019). "Design and implementation of a mobile app for public transportation services of persons with visual impairment (TransmiGuia). " 2019 22nd symposium on image, signal processing and artificial vision, STSIVA 2019 -conference proceedings.
  12. Albraheem L., Almotiry H., Abahussain H., AlHammad L., Alshehri M. (2014). "Toward designing efficient application to identify objects for visually impaired. " In 2014 IEEE international conference on computer and information technology (pp. 345-350). IEEE
  13. Al-Busaidi A., Kumar P., Jayakumari C., Kurian P. (2017). "User experiences system design for visually impaired and blind users in Oman. " In 2017 6th international conference on information and communication technology and accessibility (ICTA) (pp. 1-5). IEEE.
  14. Liimatainen J., Nousiainen T., Kankaanranta M. (2012). "A mobile application concept to encourage independent mobility for blind and visually impaired students. " In Computers helping people with special needs: 13th international conference, ICCHP 2012, Linz, Austria, July 11-13, 2012, proceedings, part II 13 (pp. 552-559). Springer Berlin Heidelberg.
  15. Ferati M., Vogel B., Kurti A., Raufi B., Astals D. S. (2016). "Web accessibility for visually impaired people: requirements and design issues. " In Usability-and accessibility- focused requirements engineering: First international workshop, UsARE 2012, held in conjunction with ICSE 2012, Zurich, Switzerland, June 4, 2012 and second international workshop, UsARE 2014, held in conjunction with RE 2014, Karlskrona, Sweden, august 25, 2014, revised selected papers 1 (pp. 79-96). Springer International Publishing.
  16. Alvarez Robles T, Sanchez Orea A., Alvarez Rodriguez F. J. (2019). "User eXperience (UX) evaluation of a Mobile geolocation system for people with visual impairments. " 2019 international conference on inclusive technologies and education (CONTIE), inclusive technologies and education (CONTIE), 28-286.
  17. Francis H., Al-Jumeily D., Lund T. O. (2013). "A framework to support ECommerce development for people with visual impairment. " 2013 sixth international conference on developments in ESystems engineering, developments in ESystems engineering (DeSE), 2010, 335-341.
  18. Matusiak K., Skulimowski P., Strumillo P. (2013). "Object recognition in a mobile phone application for visually impaired users. " 2013 6th international conference on human system interactions (HSI), human system interaction (HSI), 479-484.
  19. Garg S., Singh R. K., Saxena R. R., Kapoor R. (2014). "Doppler effect: UIInput method using gestures for the visually impaired. " 2014 Texas Instruments India educators' conference (TIIEC), India educators' conference (TIIEC), 86-92.
  20. Pandey D., Pandey K. (2021). "An assistive technology-based approach towards helping visually impaired people." 2021 9th international conference on reliability, Infocom technologies and optimization (trends and future directions) (ICRITO), 1-5.
  21. Mon C. S., Meng Yap K., Ahmad A. (2019). "A preliminary study on requirements of olfactory, haptic and audio enabled application for visually impaired in edutainment. " 2019 IEEE 9th symposium on computer applications & industrial electronics (ISCAIE), computer applications & industrial electronics (ISCAIE), 249-253.
  22. Zouhaier L., Hlaoui Y. B., Ben Ayed L. J. (2017). "Users interfaces adaptation for visually impaired users based on meta-model transformation. " 2017 IEEE 41st annual computer software and applications conference (COMPSAC), computer software and applications conference (COMPSAC), 881-886.
  23. Rizan T., Siriwardena V., Raleen M., Perera L., Kasthurirathna D. (2021). "Guided vision: a high efficient and low latent Mobile app for visually impaired. " 2021 3rd international conference on advancements in computing (ICAC), advancements in computing (ICAC), 246-251.
  24. Rose M. M., Ghazali M. (2023). Improving navigation for blind people in the developing countries: A UI/UX perspective. Journal of Human Centered Technology.
  25. Kasthuri R., Nivetha B., Shabana S., Veluchamy M., Sivakumar S. (2017). "Smart device for visually impaired people. " In 2017 third international conference on Science Technology Engineering & Management (ICONSTEM) (pp. 54-59). IEEE.
  26. Huppert F., Hoelzl G., Kranz M. (2021). "GuideCopter-A precise drone based haptic guidance interface for blind or visually impaired people. " In Proceedings of the 2021 CHI conference on human factors in computing systems (pp. 1-14).
  27. Vanderheiden G., Tobias J. (2000). "Universal design of consumer products: current industry practice and perceptions. " In Proceedings of the human factors and ergonomics society annual meeting (Vol. 44, pp. 6-19). Sage CA: Los Angeles, CA: SAGE Publications.
  28. Power C., Pimenta Freire A., Petrie H., Swallow D. (2012). Guidelines are only half of the story: Accessibility problems encountered by blind users on the web. Association for Computing Machinery, CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2012. 433-442.
  29. Stein V., Nebelrath R., Alexandersson J. (2011). "Designing with and for the visually impaired: vocabulary, spelling and the screen reader. " CSEDU 2011 -proceedings of the 3rd international conference on computer supported education, 2, 462-467.
  30. Russ K. C. W. (2017). "An assistive mobile application i-AIM app with accessibleUI implementation for visually-impaired and aging users." 2017 6th international conference on information and communication technology and accessibility (ICTA), 1-6.
  31. Marvin E. (2020). "Digital assistant for the visually impaired. " 2020 international conference on artificial intelligence in information and communication (ICAIIC), 723-728.
  32. Wang R, Yu C, He W, Shi Y, Yang X.-D. (2019). "Eartouch: facilitating smartphone use for visually impaired people in mobile and public scenarios. " Conference on Human Factors in Computing Systems Proceedings.
  33. Zhang M. R., Wang R. (2021). "Voicemoji: emoji entry using voice for visually impaired people." Conference on Human Factors in Computing Systems - Proceedings. 100.
  34. Yusril AN. E-accessibility analysis in user experience for people with disabilities.
  35. Sierra J. S., Togores J. (2012). "Designing mobile apps for visually impaired and blind users. " In The fifth international conference on advances in computer-human interactions (pp. 47-52). 112. Liu K.-C., Wu C.-H., Tseng S.-Y., Tsai Y.-T. (2015). "Voice helper: a Mobile assistive system for visually impaired persons." 2015 IEEE international conference on computer and information technology; ubiquitous computing and communications; dependable, autonomic and secure computing; pervasive intelligence and computing, computer and information technology; ubiquitous computing and communications; dependable, autonomic and secure computing; pervasive intelligence and computing (CIT/IUCC/DASC/PICOM), 1400-1405. 113.
  36. Ghidini E., Almeida W. D. L., Manssour I. H., Silveira M. S. (2016). "Developing apps for visually impaired people: lessons learned from practice. " Proceedings of the annual Hawaii international conference on system sciences. 114.
  37. Jakhete S. A., Bagmar P., Dorle A., Rajurkar A., Pimplikar P. (2019). "Object recognition app for visually impaired. " 2019 IEEE Pune section international conference (PuneCon), Pune section international conference (PuneCon), 2019 IEEE, 1-4. 115.
  38. Calabro, 2010, Book4All: A tool to make an e-book more accessible to students with vision/visual-impairments, 236

Cited by

See all 25

Metadata

Authors
Arora, L., Choudhary, A., Bhatt, M., Kaliappan, J., & Srinivasan, K.
Affiliations
Vellore Institute of Technology University (IN)
Corresponding author
Kaliappan, Jayakumar
Venue
Frontiers in Public Health
Published
2024-10-25
Volume
12
Pages
1357160-1357160
ISSN
2296-2565 (ISSN-L)
OpenAlex
W4403779250
Cited by
22
References
57
Citations by year
2026: 13 · 2025: 9
FWCI
4.13
Type
journal article
Language
en
Open access
Locations
  • Frontiers in Public Health (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Funders
VIT University
Topics
  • Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
  • Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
Keywords
user experience design, visual impairment, accessible technology, assistive technology, human-centered design, Web Content Accessibility Guidelines, digital accessibility, usability, affordability
MeSH terms
Equipment Design, Humans, Self-Help Devices, User-Computer Interface, Persons with Visual Disabilities, Mobile Applications

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.