The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
Creating Accessible Online Floor Plans for Visually Impaired Readers
Open accessAbstract
We present a generic model for providing blind and severely vision-impaired readers with access to online information graphics. The model supports fully and semi-automatic transcription and allows the reader a choice of presentation mediums. We evaluate the model through a case study: online house floor plans. To do so, we conducted a formative user study with severely vision impaired users to determine what information they would like from an online floor plan and how to present the floor plan as a text-only description, tactile graphic, and on a touchscreen with audio feedback. We then built an automatic transcription tool using specialized graphics recognition algorithms. Finally, we measured the quality of system recognition as well as conducted a second user study to evaluate the usefulness of the accessible graphics produced by the tool for each of the three formats. The results generally support the design of the generic model and the usefulness of the tool we have produced. However, they also reveal the inability of current graphics recognition algorithms to handle unforeseen graphical conventions. This highlights the need for automatic transcription systems to return a level of confidence in the recognized components and to present this to the end-user so they can have an appropriate level of trust.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Labeling images with a computer game
von Ahn, L., & Dabbish, L. (2004) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/985692.985733 · Cited by 2,204
VizWiz: nearly real-time answers to visual questions
Bigham, J. P., Jayant, C., Ji, H., Little, G., Miller, A., Miller, R. C., Miller, R., Tatarowicz, A., White, B., White, S., et al. (2010) · Proceedings of the 23nd annual ACM symposium on User interface software and technology · doi:10.1145/1866029.1866080 · Cited by 601
Proceedings of the 21st International Conference on Pattern Recognition, ICPR 2012
Wilkinson, M. H. F., & Jaap, O. (2012) · Cited by 580
A robust algorithm for text string separation from mixed text/graphics images
Fletcher, L. A., & Kasturi, R. (1988) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.9112 · Cited by 572
Development of Soft-Actuator-Based Wearable Tactile Display
Koo, I. M., Jung, K., Koo, J. C., Nam, J.-D., Lee, Y. K., & Choi, H. R. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.921561 · Cited by 277
Phantom-based haptic interaction with virtual objects
Salisbury, J. K., & Srinivasan, M. A. (1997) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.1997.1626171 · Cited by 230
Real versus Template-Based Natural Language Generation: A False Opposition?
Deemter, K. V., Theune, M., & Krahmer, E. (2005) · Computational Linguistics · doi:10.1162/0891201053630291 · Cited by 199
A complete system for the analysis of architectural drawings
Dosch, P., Tombre, K., Ah-Soon, C., & Masini, G. (2000) · International Journal on Document Analysis and Recognition · doi:10.1007/pl00010901 · Cited by 165
Remote usability evaluations with disabled people.
Petrie, H., Hamilton, F., King, N., & Pavan, P. (2006) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124942 · Cited by 157 · cited 1×
“As discussed by Petrie et al. [58], finding participants for studies is difficult, in part because of the difficulty that blind people face in traveling.”
BackgroundImproving accessibility of the web with a computer game
von Ahn, L., Ginosar, S., Kedia, M., Liu, R., & Blum, M. (2006) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124785 · Cited by 156
Automatic reconstruction of 3D building models from scanned 2D floor plans
Gimenez, L., Robert, S., Suard, F., & Zreik, K. (2015) · Automation in Construction · doi:10.1016/j.autcon.2015.12.008 · Cited by 142
Dodge, S., Xu, J., & Stenger, B. (2017) · Machine Vision Applications · doi:10.23919/mva.2017.7986875 · Cited by 140
NLG vs. TemplatesPreprint
Reiter, E. (1995) · arXiv (Cornell University) · doi:10.48550/arxiv.cmp-lg/9504013 · Cited by 135
Data Sonification for Users with Visual Impairment: A Case Study with Georeferenced Data
Zhao, H., Catherine Plaisant, B., Shneiderman, B., & Lazar, J. K. (2008) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1352782.1352786 · Cited by 133
A system to detect rooms in architectural floor plan images
Macé, S., Locteau, H., Valveny, E., & Tabbone, S. (2010) · IAPR International Workshop on Document Analysis Systems (DAS) · doi:10.1145/1815330.1815352 · Cited by 129
Improved Automatic Analysis of Architectural Floor Plans
Ahmed, S., Liwicki, M., Weber, M., & Dengel, A. R. (2011) · IAPR International Conference on Document Analysis and Recognition (ICDAR) · doi:10.1109/icdar.2011.177 · Cited by 129
Statistical segmentation and structural recognition for floor plan interpretation
Heras, L.-P. D. L., Ahmed, S., Liwicki, M., Valveny, E., & Sánchez, G. (2013) · International Journal on Document Analysis and Recognition (IJDAR) · doi:10.1007/s10032-013-0215-2 · Cited by 124
Timbremap: enabling the visually-impaired to use maps on touch-enabled devices
Su, J., Rosenzweig, A., Goel, A., de Lara, E., & Truong, K. N. (2010) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1851600.1851606 · Cited by 121
CubiCasa5K: A Dataset and an Improved Multi-task Model for Floorplan Image Analysis
Kalervo, A., Ylioinas, J., Häikiö, M., Karhu, A., & Kannala, J. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-20205-7_3 · Cited by 120
Gravvitas: generic multi-touch presentation of accessible graphics
Goncu, C., & Marriott, K. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-23774-4_5 · Cited by 112
Self-citationAutomatic Room Detection and Room Labeling from Architectural Floor Plans
Ahmed, S., Liwicki, M., Weber, M., & Dengel, A. R. (2012) · IAPR International Workshop on Document Analysis Systems (DAS) · doi:10.1109/das.2012.22 · Cited by 108
Kennel, A. R. (1996) · doi:10.1145/228347.228357 · Cited by 104
Automated tactile graphics translation: in the field
Jayant, C., Renzelmann, M., Wen, D., Krisnandi, S., Ladner, R. E., & Comden, D. (2007) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/1296843.1296858 · Cited by 95
CVC-FP and SGT: a new database for structural floor plan analysis and its groundtruthing tool
Heras, L.-P. D. L., Terrades, O. R., Robles, S., & Sánchez, G. (2015) · International Journal on Document Analysis and Recognition (IJDAR) · doi:10.1007/s10032-014-0236-5 · Cited by 91
Automatic visual to tactile translation. II. Evaluation of the TACTile image creation system
Way, T., & Barner, K. E. (1997) · IEEE Transactions on Rehabilitation Engineering · doi:10.1109/86.559354 · Cited by 88
Customizable 3D Printed Tactile Maps as Interactive Overlays
Taylor, B., Dey, A., Siewiorek, D., & Smailagic, A. (2016) · Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/2982142.2982167 · Cited by 84 · cited 1×
“The annotated tactile map system (ATMap) [78, 79] and that of Taylor et al. [71] provide similar functionality.”
MethodUncovering information needs for independent spatial learning for users who are visually impaired
Banović, N., Franz, R. L., Truong, K. N., Mankoff, J. C., & Dey, A. K. (2013) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/2513383.2513445 · Cited by 83
Improving accessibility to statistical graphs
Ferres, L., Verkhogliad, P., Lindgaard, G., Boucher, L., Chretien, A., & Lachance, M. (2007) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/1296843.1296857 · Cited by 73
Automatic analysis and integration of architectural drawings
Lü, T., Yang, H., Yang, R., & Cai, S. (2006) · International Journal on Document Analysis and Recognition (IJDAR) · doi:10.1007/s10032-006-0029-6 · Cited by 66
Object Detection in Floor Plan Images
Ziran, Z., & Marinai, S. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-99978-4_30 · Cited by 57
Self-citationTowards Automatically Generated Tactile Detail Maps by 3D Printers for Blind Persons
Götzelmann, T., & Pavkovic, A. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-08599-9_1 · Cited by 54
Scientific diagrams made easy with iveotm
Gardner, J. A., & Bulatov, V. (2006) · Lecture Notes in Computer Science · doi:10.1007/11788713_179 · Cited by 49
TeDUB: A System for Presenting and Exploring Technical Drawings for Blind People
Petrie, H., Schlieder, C., Blenkhorn, P., Evans, G., King, A., O’Neill, A.-M., Ioannidis, G. T., Gallagher, B., Crombie, D., Mager, R., et al. (2002) · Lecture notes in computer science · doi:10.1007/3-540-45491-8_102 · Cited by 44
Chemical structure recognition: a rule-based approach
Sadawi, N., Sexton, A. P., & Sorge, V. (2011) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.912185 · Cited by 44
Indoor navigation for people who are blind or vision impaired: where are we and where are we going?
Gallagher, T. J., Wise, E., Yam, H. C., Li, B., Ramsey-Stewart, E., Dempster, A. G., & Rizos, C. (2014) · Journal of Location Based Services · doi:10.1080/17489725.2014.895062 · Cited by 41
SmartTactMaps: a smartphone-based approach to support blind persons in exploring tactile maps
Götzelmann, T., & Winkler, K. (2015) · International Conference on PErvasive Technologies Related to Assistive Environments (PETRA) · doi:10.1145/2769493.2769497 · Cited by 37
Fast and independent access to map directions for people who are blind
Wang, Z., Li, N., & Li, B. (2012) · Interacting with Computers · doi:10.1016/j.intcom.2012.02.002 · Cited by 35
End-to-end solution for accessible chemical diagrams
Sorge, V., Lee, M. G., & Wilkinson, S. (2015) · International Web for All Conference (W4A) · doi:10.1145/2745555.2746667 · Cited by 34
Accessible on-line floor plans.
Goncu, C., Madugalla, A., Marinai, S., & Marriott, K. (2015) · Proceedings of the 24th International Conference on World Wide Web · doi:10.1145/2736277.2741660 · Cited by 31 · cited 2×
“A preliminary version of this article appeared in Reference [27].”
BackgroundMethodSelf-citationATMap: Annotated Tactile Maps for the Visually Impaired
Zeng, L., & Weber, G. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-34584-5_25 · Cited by 29
Visual to Tactile Conversion of Vector Graphics
Krufka, S. E., Barner, K. E., & Aysal, T. C. (2007) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2007.897029 · Cited by 25
InteractiveSIGHT: textual access to simple bar charts
Demir, Ş., Oliver, D., Schwartz, E. J., Elzer, S., Carberry, S., McCoy, K. F., & Chester, D. L. (2010) · New Review of Hypermedia and Multimedia · doi:10.1080/13614568.2010.534186 · Cited by 21
Automatic image conversion to tactile graphic
Ferro, T. J., & Pawluk, D. T. V. (2013) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/2513383.2513406 · Cited by 20
Some features of alt texts associated with images in Web pages
Craven, T. C. (2006) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 17
Electrotactile display composed of two-dimensionally and densely distributed microneedle electrodes
Tezuka, M., Ishimaru, K., & Miki, N. (2017) · Sensors and Actuators A Physical · doi:10.1016/j.sna.2017.02.021 · Cited by 17
A University Indoors Audio-Tactile Mobility Aid for Individuals with Blindness
Papadopoulos, K. S., Barouti, M., & Charitakis, K. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-08599-9_17 · Cited by 16
Creating eBooks with Accessible Graphics Content
Goncu, C., & Marriott, K. (2015) · ACM Symposium on Document Engineering (DocEng) · doi:10.1145/2682571.2797076 · Cited by 13
Self-citationEvaluation of a non-visual molecule browser
Brown, A., Pettifer, S. R., & Stevens, R. (2003) · ACM SIGACCESS Accessibility and Computing · doi:10.1145/1029014.1028639 · Cited by 12
Training Strategies for CNN-based Models to Parse Complex Floor Plans
Zhu, R., Shen, J., Deng, X., Walldén, M., & Ino, F. (2020) · International Conference on Software and Computer Applications (ICSCA) · doi:10.1145/3384544.3384566 · Cited by 12
Papadopoulos, K. S., Charitakis, K., Kartasidou, L., Κουρουπέτρογλου, Γ., Gümüş, S. S., Stylianidis, E., Stiefelhagen, R., Müller, K., Yılmaz, E., Jaworek, G., et al. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-41267-2_23 · Cited by 11
Automatic Pre-Journey Indoor Map Generation Using AutoCAD Floor Plan
Hao Tang, A., Tsering, N., Hu, F., & Zhu, Z. (2016) · Cited by 9
Partitioning Open Plan Areas in Floor Plans
Madugalla, A. K., Marriott, K., & Marinai, S. (2017) · IAPR International Conference on Document Analysis and Recognition (ICDAR) · doi:10.1109/icdar.2017.17 · Cited by 9
Self-citationAccessible Information: An Overview
Hersh, M. A., & Johnson, M. A. (2008) · Springer eBooks · doi:10.1007/978-1-84628-867-8_12 · Cited by 8
Paladugu, D. A., Tian, Q., Maguluri, H. B., & Li, B. (2015) · Cyber-Physical Systems · doi:10.1080/23335777.2016.1141801 · Cited by 8
New tools for automating tactile geographic map translation
Bouhlel, N., & Rojbi, A. (2014) · doi:10.1145/2661334.2661335 · Cited by 7
Redeke, I. (2002) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2001.959168 · Cited by 6
Instrument for Haptic Image Exploration
Lareau, D., & Lang, J. (2013) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2013.2277538 · Cited by 6
Providing interactive access to architectural floorplans for blind people
Petrie, H., King, N., Burn, A., & Pavan, P. S. S. (2006) · British Journal of Visual Impairment · doi:10.1177/0264619606060010 · Cited by 6
Automatic Floor Plan Analysis for Adaptive Indoor Wi-Fi Positioning System
Zhang, X., Wong, A. K.-S., & Lea, C. (2016) · International Conference on Computational Science and Computational Intelligence (CSCI) · doi:10.1109/csci.2016.0169 · Cited by 6
Braille-Embedded Tactile Graphics Editor with Infty System
Kanahori, T., Masayuki, N., & Suzuki, M. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-70540-6_138 · Cited by 3
Automated description generation for indoor floor maps
Paladugu, D. A., Maguluri, H. B., Tian, Q., & Li, B. (2012) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/2384916.2384958 · Cited by 3
Spatial Preposition Use in Indoor Scene Descriptions
Doore, S. A., Beard, K. M., & Giudice, N. A. (2016) · International Conference on GIScience Short Paper Proceedings · doi:10.21433/b3115h00g1xs · Cited by 2
Electronics lend a helping hand to young and old [products for assisted living]
Hayes, C. J. (2017) · Engineering & Technology · doi:10.1049/et.2017.0102 · Cited by 1
Research works printed but not linked: 12
- 10.5555/3043802.3043942 · doi:10.5555/3043802.3043942
- 10.5555/839288.842247 · doi:10.5555/839288.842247
- Lluís-Pere de las Heras , David Fernández Mota , Alicia Fornés , Ernest Valveny , Gemma Sánchez , and Josep Lladós . 2013 . Runlength histogram image signature for perceptual retrieval of architectural floor plans . In Proceedings of the International Workshop on Graphics Recognition. Springer, 135--146 . Lluís-Pere de las Heras, David Fernández Mota, Alicia Fornés, Ernest Valveny, Gemma Sánchez, and Josep Lladós. 2013. Runlength histogram image signature for perceptual retrieval of architectural floor plans. In Proceedings of the International Workshop on Graphics Recognition. Springer, 135--146.
- Max Feltes , Sheraz Ahmed , Andreas Dengel , and Marcus Liwicki . 2013 . Improved contour-based corner detection for architectural floor plans . In Proceedings of the International Workshop on Graphics Recognition. Springer, 191--203 . Max Feltes, Sheraz Ahmed, Andreas Dengel, and Marcus Liwicki. 2013. Improved contour-based corner detection for architectural floor plans. In Proceedings of the International Workshop on Graphics Recognition. Springer, 191--203.
- 10.5555/2042053.2042060 · doi:10.5555/2042053.2042060
- 10.5555/1795896 · doi:10.5555/1795896
- Steven Landau and Lesley Wells . 2003 . Merging tactile sensory input and audio data by means of the talking tactile tablet . In Proc. Eurohaptics , Vol. 3. 414 -- 418 . Steven Landau and Lesley Wells. 2003. Merging tactile sensory input and audio data by means of the talking tactile tablet. In Proc. Eurohaptics, Vol. 3. 414--418.
- Helen Petrie , Chandra Harrison , and Sundeep Dev . 2005 . Describing images on the web: A survey of current practice and prospects for the future . In Proceedings of Human-computer Interaction International Conference (HC’05) . Helen Petrie, Chandra Harrison, and Sundeep Dev. 2005. Describing images on the web: A survey of current practice and prospects for the future. In Proceedings of Human-computer Interaction International Conference (HC’05).
- 10.5555/646269.684337 · doi:10.5555/646269.684337
- Jonathan Rowell and Simon Ungar . 2005 . Feeling our way: Tactile map user requirements—A survey . In Proceedings of the International Cartographic Conference. Jonathan Rowell and Simon Ungar. 2005. Feeling our way: Tactile map user requirements—A survey. In Proceedings of the International Cartographic Conference.
- 10.5555/839278.840175 · doi:10.5555/839278.840175
- 10.5555/1880751.1880831 · doi:10.5555/1880751.1880831
Cited by
Image Accessibility for Screen Reader Users: A Systematic Review and a Road Map
Oh, U., Joh, H., & Lee, Y. (2021) · Electronics · doi:10.3390/electronics10080953 · Cited by 37
Knowledge-driven description synthesis for floor plan interpretation
Goyal, S., Chattopadhyay, C., & Bhatnagar, G. (2021) · International Journal on Document Analysis and Recognition (IJDAR) · doi:10.1007/s10032-021-00367-3 · Cited by 21
Jain, G., Hindi, B., Courtien, C., Xu, X. Y. T., Wyrick, C., Malcolm, M., & Smith, B. A. (2023) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3586183.3606830 · Cited by 24
Developing dynamic audio navigation uis to pinpoint elements in tactile graphics
Ramôa, G., Schmidt, V., & König, P. (2022) · Multimodal Technologies and Interaction · doi:10.3390/mti6120113 · Cited by 14
Towards Accessible Sports Broadcasts for Blind and Low-Vision Viewers
Jain, G., Hindi, B., Courtien, C., Wyrick, C., Xu, X. Y. T., Malcolm, M., & Smith, B. A. (2023) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3544549.3585610 · Cited by 14
Metadata
- Authors
- Madugalla, A., Marriott, K., Marinai, S., Capobianco, S., & Goncu, C.
- Affiliations
- Monash University (AU)
- University of Florence (IT)
- Venue
- ACM Transactions on Accessible Computing
- Published
- 2020-10-15
- Volume
- 13
- Issue
- 4
- Pages
- 1-37
- ISSN
- 1936-7228 (ISSN-L)
- 1936-7236
- OpenAlex
- W3095351757
- Semantic Scholar
- db59e9c69a40923a1f7522e0412aeaad0c860fcb
- Cited by
- 17
- References
- 63
- Citations by year
- 2026: 1 · 2025: 4 · 2024: 3 · 2023: 3 · 2022: 3 · 2021: 3
- FWCI
- 4.05
- Type
- journal article
- Language
- en
- Open access
- green
- figshare.com
- Locations
- ACM Transactions on Accessible Computing (publishedVersion)
- Figshare (submittedVersion, cc-by)
- Florence Research (University of Florence) (submittedVersion)
- Funders
- Australian Research Council through Linkage Project (LP170100026)
- Discovery Early Career Researcher Award (DE180100057)
- Australian Government through the Department of Communications and the Australian Research Council through the ICT Centre for Excellence Program
- Data 61 and CSIRO
- Topics
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Keywords
- floor plans, visual impairment, blind users, automatic transcription, graphics recognition, tactile graphics, audio feedback
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.