Creating Accessible Online Floor Plans for Visually Impaired Readers
Open accessThe DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
Abstract
We present a generic model for providing blind and severely vision-impaired readers with access to online information graphics. The model supports fully and semi-automatic transcription and allows the reader a choice of presentation mediums. We evaluate the model through a case study: online house floor plans. To do so, we conducted a formative user study with severely vision impaired users to determine what information they would like from an online floor plan and how to present the floor plan as a text-only description, tactile graphic, and on a touchscreen with audio feedback. We then built an automatic transcription tool using specialized graphics recognition algorithms. Finally, we measured the quality of system recognition as well as conducted a second user study to evaluate the usefulness of the accessible graphics produced by the tool for each of the three formats. The results generally support the design of the generic model and the usefulness of the tool we have produced. However, they also reveal the inability of current graphics recognition algorithms to handle unforeseen graphical conventions. This highlights the need for automatic transcription systems to return a level of confidence in the recognized components and to present this to the end-user so they can have an appropriate level of trust.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Labeling images with a computer game
von Ahn, L., & Dabbish, L. (2004) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/985692.985733 · Cited by 2,204
VizWiz: nearly real-time answers to visual questions
Bigham, J. P., Jayant, C., Ji, H., Little, G., Miller, A., Miller, R. C., Miller, R., Tatarowicz, A., White, B., White, S., et al. (2010) · Proceedings of the 23nd annual ACM symposium on User interface software and technology · doi:10.1145/1866029.1866080 · Cited by 601
Proceedings of the 21st International Conference on Pattern Recognition, ICPR 2012
Wilkinson, M. H. F., & Jaap, O. (2012) · Cited by 580
A robust algorithm for text string separation from mixed text/graphics images
Fletcher, L. A., & Kasturi, R. (1988) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.9112 · Cited by 572
Development of Soft-Actuator-Based Wearable Tactile Display
Koo, I. M., Jung, K., Koo, J. C., Nam, J.-D., Lee, Y. K., & Choi, H. R. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.921561 · Cited by 277
Phantom-based haptic interaction with virtual objects
Salisbury, J. K., & Srinivasan, M. A. (1997) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.1997.1626171 · Cited by 230
Real versus Template-Based Natural Language Generation: A False Opposition?
Deemter, K. V., Theune, M., & Krahmer, E. (2005) · Computational Linguistics · doi:10.1162/0891201053630291 · Cited by 199
A complete system for the analysis of architectural drawings
Dosch, P., Tombre, K., Ah-Soon, C., & Masini, G. (2000) · International Journal on Document Analysis and Recognition · doi:10.1007/pl00010901 · Cited by 165
Remote usability evaluations with disabled people.
Petrie, H., Hamilton, F., King, N., & Pavan, P. (2006) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124942 · Cited by 157 · cited 1×
“As discussed by Petrie et al. [58], finding participants for studies is difficult, in part because of the difficulty that blind people face in traveling.”
BackgroundImproving accessibility of the web with a computer game
von Ahn, L., Ginosar, S., Kedia, M., Liu, R., & Blum, M. (2006) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124785 · Cited by 156
Research works printed but not linked: 12
- 10.5555/3043802.3043942 · doi:10.5555/3043802.3043942
- 10.5555/839288.842247 · doi:10.5555/839288.842247
- Lluís-Pere de las Heras , David Fernández Mota , Alicia Fornés , Ernest Valveny , Gemma Sánchez , and Josep Lladós . 2013 . Runlength histogram image signature for perceptual retrieval of architectural floor plans . In Proceedings of the International Workshop on Graphics Recognition. Springer, 135--146 . Lluís-Pere de las Heras, David Fernández Mota, Alicia Fornés, Ernest Valveny, Gemma Sánchez, and Josep Lladós. 2013. Runlength histogram image signature for perceptual retrieval of architectural floor plans. In Proceedings of the International Workshop on Graphics Recognition. Springer, 135--146.
- Max Feltes , Sheraz Ahmed , Andreas Dengel , and Marcus Liwicki . 2013 . Improved contour-based corner detection for architectural floor plans . In Proceedings of the International Workshop on Graphics Recognition. Springer, 191--203 . Max Feltes, Sheraz Ahmed, Andreas Dengel, and Marcus Liwicki. 2013. Improved contour-based corner detection for architectural floor plans. In Proceedings of the International Workshop on Graphics Recognition. Springer, 191--203.
- 10.5555/2042053.2042060 · doi:10.5555/2042053.2042060
- 10.5555/1795896 · doi:10.5555/1795896
- Steven Landau and Lesley Wells . 2003 . Merging tactile sensory input and audio data by means of the talking tactile tablet . In Proc. Eurohaptics , Vol. 3. 414 -- 418 . Steven Landau and Lesley Wells. 2003. Merging tactile sensory input and audio data by means of the talking tactile tablet. In Proc. Eurohaptics, Vol. 3. 414--418.
- Helen Petrie , Chandra Harrison , and Sundeep Dev . 2005 . Describing images on the web: A survey of current practice and prospects for the future . In Proceedings of Human-computer Interaction International Conference (HC’05) . Helen Petrie, Chandra Harrison, and Sundeep Dev. 2005. Describing images on the web: A survey of current practice and prospects for the future. In Proceedings of Human-computer Interaction International Conference (HC’05).
- 10.5555/646269.684337 · doi:10.5555/646269.684337
- Jonathan Rowell and Simon Ungar . 2005 . Feeling our way: Tactile map user requirements—A survey . In Proceedings of the International Cartographic Conference. Jonathan Rowell and Simon Ungar. 2005. Feeling our way: Tactile map user requirements—A survey. In Proceedings of the International Cartographic Conference.
- 10.5555/839278.840175 · doi:10.5555/839278.840175
- 10.5555/1880751.1880831 · doi:10.5555/1880751.1880831
Cited by
Image Accessibility for Screen Reader Users: A Systematic Review and a Road Map
Oh, U., Joh, H., & Lee, Y. (2021) · Electronics · doi:10.3390/electronics10080953 · Cited by 37
Knowledge-driven description synthesis for floor plan interpretation
Goyal, S., Chattopadhyay, C., & Bhatnagar, G. (2021) · International Journal on Document Analysis and Recognition (IJDAR) · doi:10.1007/s10032-021-00367-3 · Cited by 21
Jain, G., Hindi, B., Courtien, C., Xu, X. Y. T., Wyrick, C., Malcolm, M., & Smith, B. A. (2023) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3586183.3606830 · Cited by 25
Developing dynamic audio navigation uis to pinpoint elements in tactile graphics
Ramôa, G., Schmidt, V., & König, P. (2022) · Multimodal Technologies and Interaction · doi:10.3390/mti6120113 · Cited by 14
Towards Accessible Sports Broadcasts for Blind and Low-Vision Viewers
Jain, G., Hindi, B., Courtien, C., Wyrick, C., Xu, X. Y. T., Malcolm, M., & Smith, B. A. (2023) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3544549.3585610 · Cited by 16
Strobel, L., Gerling, K., & Rixen, J. O. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713414 · Cited by 12
Improving Human-Centric Software Defect Evaluation, Reporting, and Fixing
Huynh, K., Benarivo, J., Xuan, C. D., Sharma, G. G., Kang, J., Madugalla, A. K., & Grundy, J. (2021) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac51774.2021.00064 · Cited by 10
Self-citationMethods and Applications of Space Understanding in Indoor Environment—A Decade Survey
Pokuciński, S., & Mrozek, D. (2024) · Applied Sciences · doi:10.3390/app14103974 · Cited by 6
Ramôa, G., Schmidt, V., Schwarz, T., Stiefelhagen, R., & König, P. (2024) · Frontiers in Rehabilitation Sciences · doi:10.3389/fresc.2024.1368983 · Cited by 5
Listening first: egocentric textual descriptions of indoor spaces for people with blindness
Constantinescu, A., Neumann, E.-M., Müller, K., Jaworek, G., & Stiefelhagen, R. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-08648-9_28 · Cited by 4
Ramôa, G., & Müller, K. (2025) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3663547.3746398 · Cited by 4
Trinh, V. Q., Manduchi, R., & Giudice, N. A. (2023) · ACM Transactions on Accessible Computing · doi:10.1145/3590775 · Cited by 5
Automated Translation of UML Class Diagrams
Gambe, B., & Thomas, A. (2024) · International Conference on Artificial Intelligence, Big Data, Computing and Data Communication Systems (icABCD) · doi:10.1109/icabcd62167.2024.10645283 · Cited by 2
Split it up: allocentric descriptions of indoor maps for people with visual impairments
Anken, J., Rosenthal, D., Müller, K., Jaworek, G., & Stiefelhagen, R. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-08648-9_13 · Cited by 1
Madugalla, A. K., Huang, Y., Grundy, J., Cho, M. H., Gamage, L. K., Lau, Y. P., Leao, T., & Thiele, S. (2025) · Empirical Software Engineering · doi:10.1007/s10664-025-10715-0 · Cited by 7
Self-citationCorrea, M. L., Vitoriano, M. A. V., & Llanos, C. H. (2025) · Informatics · doi:10.3390/informatics12030063
An End-to-End Pipeline to Generate Augmented Tactile Maps from Floor Plans
Quach, M., Coughlan, J. M., Ahmetovic, D., Manzoni, M., Mascetti, S., & Manduchi, R. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-31308-9_58
Metadata
- Authors
- Madugalla, A., Marriott, K., Marinai, S., Capobianco, S., & Goncu, C.
- Affiliations
- Monash University (AU)
- University of Florence (IT)
- Venue
- ACM Transactions on Accessible Computing
- Published
- 2020-10-15
- Volume
- 13
- Issue
- 4
- Pages
- 1-37
- ISSN
- 1936-7228 (ISSN-L)
- 1936-7236
- OpenAlex
- W3095351757
- Semantic Scholar
- db59e9c69a40923a1f7522e0412aeaad0c860fcb
- Cited by
- 17
- References
- 63
- Citations by year
- 2026: 1 · 2025: 4 · 2024: 3 · 2023: 3 · 2022: 3 · 2021: 3
- FWCI
- 4.05
- Type
- journal article
- Language
- en
- Open access
- green
- figshare.com
- Locations
- ACM Transactions on Accessible Computing (publishedVersion)
- Figshare (submittedVersion, cc-by)
- Florence Research (University of Florence) (submittedVersion)
- Funders
- Australian Research Council through Linkage Project (LP170100026)
- Discovery Early Career Researcher Award (DE180100057)
- Australian Government through the Department of Communications and the Australian Research Council through the ICT Centre for Excellence Program
- Data 61 and CSIRO
- Topics
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Keywords
- floor plans, visual impairment, blind users, automatic transcription, graphics recognition, tactile graphics, audio feedback
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.