Facade: Auto-generating Tactile Interfaces to Appliances
Abstract
Common appliances have shifted toward flat interface panels, making them inaccessible to blind people. Although blind people can label appliances with Braille stickers, doing so generally requires sighted assistance to identify the original functions and apply the labels. We introduce Facade - a crowdsourced fabrication pipeline to help blind people independently make physical interfaces accessible by adding a 3D printed augmentation of tactile buttons overlaying the original panel. Facade users capture a photo of the appliance with a readily available fiducial marker (a dollar bill) for recovering size information. This image is sent to multiple crowd workers, who work in parallel to quickly label and describe elements of the interface. Facade then generates a 3D model for a layer of tactile and pressable buttons that fits over the original controls. Finally, a home 3D printer or commercial service fabricates the layer, which is then aligned and attached to the interface by the blind person. We demonstrate the viability of Facade in a study with 11 blind participants.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Computer vision has been applied to the analysis of static and dynamically changing layouts and to the guiding of manual inputs via auditory feedback.
“More recently, computer vision has been applied to the analysis of static and dynamically changing layouts [3,8] and the guiding of manual inputs via auditory feedback [6].”
From Pressing a Button You Cannot See: Evaluating Visual Designs to Assist Persons with Low Vision through Augmented Reality (2021) · cites this paper as [8]
It is possible to know user intention using voice commands, crowd-sourcing platforms, and computer vision, as demonstrated by StateLens.
“This is possible using voice commands, crowd-sourcing platforms, and computer vision, as Guo et al. demonstrate with StateLens [8]”
From Pressing a Button You Cannot See: Evaluating Visual Designs to Assist Persons with Low Vision through Augmented Reality (2021) · cites this paper as [8]
Increasing tactile feedback and tangible interaction on touchscreens can improve their accessibility.
“Increasing tactile feedback and tangible interaction on touchscreens can improve their accessibility.”
From Interactiles: 3D Printed Tactile Interfaces to Enhance Mobile Touchscreen Accessibility (2018) · cites this paper as [13]
Cites
Fischler, M. A., & Bolles, R. C. (1981) · Communications of the ACM · doi:10.1145/358669.358692 · Cited by 25,893 · see citing works
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1994) · Psychological Review · doi:10.1037/0033-295x.101.2.343 · Cited by 17,469 · see citing works
SURF: Speeded Up Robust Features
Bay, H., Tuytelaars, T., & Van Gool, L. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_32 · Cited by 14,955 · see citing works
FAST APPROXIMATE NEAREST NEIGHBORS WITH AUTOMATIC ALGORITHM CONFIGURATION
(2009) · Proceedings of the Fourth International Conference on Computer Vision Theory and Applications · doi:10.5220/0001787803310340 · Cited by 2,640 · see citing works
VizWiz: nearly real-time answers to visual questions
Bigham, J. P., Jayant, C., Ji, H., Little, G., Miller, A., Miller, R. C., Miller, R., Tatarowicz, A., White, B., White, S., et al. (2010) · Proceedings of the 23nd annual ACM symposium on User interface software and technology · doi:10.1145/1866029.1866080 · Cited by 601 · see citing works
Self-citationBigham, J. P., Jayant, C., Ji, H., Little, G., Miller, A. E., Miller, R. C., Tatarowicz, A., White, B., White, S., & YEH, T. P. (2010) · International Cross-Disciplinary Conference on Web Accessibility (W4A) · doi:10.1145/1805986.1806020 · Cited by 536 · see citing works
Self-citationGenerating remote control interfaces for complex appliances
Nichols, J. W., Myers, B. A., Higgins, M., et al. (2002) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/571985.572008 · Cited by 326 · see citing works
Visual challenges in the everyday lives of blind people
Brady, E. L., Morris, M. R., Zhong, Y., White, S., & Bigham, J. P. (2013) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2481291 · Cited by 236 · see citing works
Self-citationBuehler, E., Branham, S. M., Ali, A. X., Chang, J., Hofmann, M. K., Hurst, A. K., & Kane, S. K. (2015) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702525 · Cited by 216 · see citing works
Jayant, C., Ji, H., White, S., & Bigham, J. P. (2011) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/2049536.2049573 · Cited by 168 · see citing works
Self-citationCollaborative Accessibility: How Blind and Sighted Companions Co-Create Accessible Home Spaces
Branham, S. M., & Kane, S. K. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702511 · Cited by 159 · see citing works
Buehler, E., Kane, S. K., & Hurst, A. K. (2014) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/2661334.2661365 · Cited by 142 · see citing works
VizWiz::LocateIt - enabling blind people to locate objects in their environment
Bigham, J. P., Jayant, C., Miller, A. E., White, B., & YEH, T. P. (2010) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2010.5543821 · Cited by 137 · see citing works
Self-citationMapSense: Multi-Sensory Interactive Maps for Children Living with Visual Impairments
Brule, E., Bailly, G., Brock, A., Valentin, F., Denis, G., & Jouffrais, C. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858375 · Cited by 122 · see citing works
Ramakers, R., Anderson, F., Grossman, T., & Fitzmaurice, G. W. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858485 · Cited by 110 · see citing works
VizTouch: automatically generated tactile visualizations of coordinate spaces
Brown, C., & Hurst, A. (2012) · Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction · doi:10.1145/2148131.2148160 · Cited by 106 · see citing works
Kane, S. K., & Bigham, J. P. (2014) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/2538862.2538975 · Cited by 106 · see citing works
Self-citationReading embossed capital letters: An fMRI study in blind and sighted individuals
Burton, H., McLaren, D. G., & Sinclair, R. J. (2005) · Human Brain Mapping · doi:10.1002/hbm.20188 · Cited by 101 · see citing works
VizLens: A Robust and Interactive Screen Reader for Interfaces in the Real World
Guo, A., Chen, X. '., Qi, H., White, S., Ghosh, S., Asakawa, C., & Bigham, J. P. (2016) · Proceedings of the 29th Annual Symposium on User Interface Software and Technology · doi:10.1145/2984511.2984518 · Cited by 99 · see citing works
Self-citationBuehler, E., Hurst, A. K., & Hofmann, M. K. (2014) · doi:10.1145/2661334.2661345 · Cited by 98 · see citing works
Chen, X. '., Kim, J., Mankoff, J. C., Grossman, T., Coros, S., & Hudson, S. E. (2016) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2984511.2984512 · Cited by 87 · see citing works
Self-citationLucentMaps: 3D Printed Audiovisual Tactile Maps for Blind and Visually Impaired People
Götzelmann, T. (2016) · Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/2982142.2982163 · Cited by 86 · see citing works
Customizable 3D Printed Tactile Maps as Interactive Overlays
Taylor, B., Dey, A., Siewiorek, D., & Smailagic, A. (2016) · Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/2982142.2982167 · Cited by 84 · see citing works
Hofmann, M. K., Harris, J., Hudson, S. E., & Mankoff, J. C. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858340 · Cited by 77 · see citing works
Self-citationMcDonald, S., Comrie, N., Buehler, E., Carter, N., Dubin, B., Gordes, K. L., McCombe-Waller, S., & Hurst, A. K. (2016) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/2982142.2982162 · Cited by 76 · see citing works
Answering visual questions with conversational crowd assistants
Lasecki, W. S., Thiha, P., Zhong, Y., Brady, E. L., & Bigham, J. P. (2013) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/2513383.2517033 · Cited by 70 · see citing works
Self-citationMapSense: Multi-Sensory Interactive Maps for Children Living with Visual Impairments
Brulé, É., Bailly, G., Brock, A., et al. (2016) · HAL (Le Centre pour la Communication Scientifique Directe) · Cited by 69 · see citing works
Shi, L., Zelzer, I., Feng, C., & Azenkot, S. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858507 · Cited by 69 · see citing works
Zhong, Y., Lasecki, W. S., Brady, E. L., & Bigham, J. P. (2015) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702437 · Cited by 68 · see citing works
Self-citationToward 3D-Printed Movable Tactile Pictures for Children with Visual Impairments
Kim, J., & Yeh, T. (2015) · doi:10.1145/2702123.2702144 · Cited by 65 · see citing works
Self-citationHuman-Computer Interaction and Collective Intelligence
Bigham, J. P., Bernstein, M. S., & Adar, E. (2018) · Figshare · doi:10.1184/r1/6470123 · Cited by 64 · see citing works
Self-citationChen, X. '., Coros, S., Mankoff, J. C., et al. (2015) · doi:10.1145/2807442.2807498 · Cited by 55 · see citing works
Self-citationde Freitas, A. A., Nebeling, M., Chen, X. '., et al. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858177 · Cited by 55 · see citing works
Self-citationTowards Automatically Generated Tactile Detail Maps by 3D Printers for Blind Persons
Götzelmann, T., & Pavkovic, A. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-08599-9_1 · Cited by 54 · see citing works
Swaminathan, S., Roumen, T. J., Kovács, R., Stangl, D., Mueller, S., & Baudisch, P. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858245 · Cited by 53 · see citing works
Lafreniere, B. J., Grossman, T., Anderson, F., Matejka, J., Kerrick, H., Nagy, D., Vasey, L., Atherton, E., Beirne, N., Coelho, M., et al. (2016) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2984511.2984553 · Cited by 47 · see citing works
An Assisted Photography Framework to Help Visually Impaired Users Properly Aim a Camera
Vázquez, M., & Steinfeld, A. M. (2014) · ACM Transactions on Computer-Human Interaction · doi:10.1145/2651380 · Cited by 46 · see citing works
Manduchi, R., & Coughlan, J. M. (2014) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557328 · Cited by 43 · see citing works
Real time object scanning using a mobile phone and cloud-based visual search engine
Zhong, Y., Garrigues, P. J., & Bigham, J. P. (2013) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/2513383.2513443 · Cited by 42 · see citing works
Self-citationTactile aids for visually impaired graphical design education
McDonald, S., Dutterer, J., Abdolrahmani, A., Kane, S. K., & Hurst, A. K. (2014) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/2661334.2661392 · Cited by 39 · see citing works
White, S., Ji, H., & Bigham, J. P. (2010) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/1866218.1866244 · Cited by 35 · see citing works
Self-citationCrowdsourcing Accessibility: Human-Powered Access Technologies
Brady, E. L., & Bigham, J. P. (2015) · now publishers, Inc. eBooks · doi:10.1561/9781680830354 · Cited by 15 · see citing works
Self-citationGuo, A., Chen, X., & Bigham, J. P. (2015) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2702613.2732755 · Cited by 9 · see citing works
Self-citationGuo, A., Kim, J., Chen, X., YEH, T. P., Hudson, S. E., Mankoff, J. C., & Bigham, J. P. (2016) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/2982142.2982187 · Cited by 4 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
StateLens: A Reverse Engineering Solution for Making Existing Dynamic Touchscreens Accessible
Guo, A., Kong, J., Rivera, M., Xu, F. F., & Bigham, J. P. (2019) · Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3332165.3347873 · Cited by 35 · see citing works
Self-citationZhang, X., Tran, T., Sun, Y., Culhane, I., Jain, S., Fogarty, J., & Mankoff, J. (2018) · ASSETS '18 · doi:10.1145/3234695.3236349 · Cited by 30 · see citing works
Self-citationLang, F., & Machulla, T. (2021) · Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology · doi:10.1145/3489849.3489873 · Cited by 26 · see citing works
“Other options to increase the accessibility of touchscreens are the addition of tactile feedback by creating physical overlays [7, 14, 20] or active haptic feedback devices to accommodate interface changes [12, 31].”
BackgroundHe, L., Wan, Z., Findlater, L., & Froehlich, J. E. (2017) · Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3132525.3134818 · Cited by 26 · see citing works
- Authors
- Guo, A., Kim, J., Chen, X. '., Yeh, T., Hudson, S. E., Mankoff, J., & Bigham, J. P.
- Affiliations
- Carnegie Mellon University (US)
- University of Colorado Boulder (US)
- ORCID
- Venue
- Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2017-05-02
- Pages
- 5826-5838
- OpenAlex
- W2610299746
- Cited by
- 122
- References
- 44
- Citations by year
- 2026: 2 · 2025: 4 · 2024: 54 · 2023: 9 · 2022: 10 · 2021: 8 · 2020: 4 · 2019: 10 · 2018: 16 · 2017: 5
- FWCI
- 26.30
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Funders
- National Science Foundation
- National Institute on Disability, Independent Living, and Rehabilitation Research
- Topics
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Keywords
- fiducial markers, 3D model reconstruction, assistive technology, home 3D printing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
