The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
VizWiz: nearly real-time answers to visual questions
Open accessAbstract
The lack of access to visual information like text labels, icons, and colors can cause frustration and decrease independence for blind people. Current access technology uses automatic approaches to address some problems in this space, but the technology is error-prone, limited in scope, and quite expensive. In this paper, we introduce VizWiz, a talking application for mobile phones that offers a new alternative to answering visual questions in nearly real-time - asking multiple people on the web. To support answering questions quickly, we introduce a general approach for intelligently recruiting human workers in advance called quikTurkit so that workers are available when new questions arrive. A field deployment with 11 blind participants illustrates that blind people can effectively use VizWiz to cheaply answer questions in their everyday lives, highlighting issues that automatic approaches will need to address to be useful. Finally, we illustrate the potential of using VizWiz as part of the participatory design of advanced tools by using it to build and evaluate VizWiz::LocateIt, an interactive mobile tool that helps blind people solve general visual search problems.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“As highlighted in prior research, tools like accessibility overlays have been criticized for creating new barriers rather than resolving existing ones, further emphasizing the need for developer-led interventions [6,34].”
From From Cluttered to Clear: Improving the Web Accessibility Design for Screen Reader Users in E-commerce With Generative AI (2025) · cites this paper as [6]
In the citing paper
“We join Bennett, Das, and collaborators in suggesting that advocacy is integral to creating access by shining the light on the understated work done by people with disabilities to create and facilitate access [6,15].”
From Advocacy as Access Work: How People with Visual Impairments Gain Access to Digital Banking in India (2023) · cites this paper as [6]
Citations
Cites
Speeded-Up Robust Features (SURF)
Bay, H., Ess, A., Tuytelaars, T., & Van Gool, L. (2008) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2007.09.014 · Cited by 13,557
Labeling images with a computer game
von Ahn, L., & Dabbish, L. (2004) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/985692.985733 · Cited by 2,204 · cited 1×
“The ESP Game was originally motivated (in part) by the desire to provide descriptions of web images for blind people [38].”
BackgroundCrowdsourcing user studies with Mechanical Turk
Kittur, A., Chi, E. H., & Suh, B. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357127 · Cited by 1,923 · cited 1×
“Mechanical Turk makes outsourcing small paid jobs practical [1] and has been used for a wide variety of purposes, including large user studies [15], labeling image data sets [30], and determining political sentiments in blog snippets [10].”
BackgroundAmazon Mechanical Turk: Gold Mine or Coal Mine?
Fort, K., Adda, G., & Cohen, K. B. (2011) · Computational Linguistics · doi:10.1162/coli_a_00057 · Cited by 761
Utility data annotation with Amazon Mechanical Turk
Sorokin, A., & Forsyth, D. (2008) · 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2008.4562953 · Cited by 616 · cited 1×
“Mechanical Turk makes outsourcing small paid jobs practical [1] and has been used for a wide variety of purposes, including large user studies [15], labeling image data sets [30], and determining political sentiments in blog snippets [10].”
BackgroundWhat do people ask their social networks, and why?: a survey study of status message q&a behavior
Morris, M. R., Teevan, J., & Panovich, K. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753587 · Cited by 606 · cited 2×
“One option may be to send questions to one’s social network [26] or even to more personal contacts via picture text messaging.”
BackgroundThe anatomy of a large-scale social search engine
Horowitz, D., & Kamvar, S. D. (2010) · Proceedings of the 19th international conference on World wide web · doi:10.1145/1772690.1772735 · Cited by 425 · cited 1×
“[28] VizWiz and quikTurkit explore how to use microtask marketplaces like Amazon’s Mechanical Turk to get answers back even faster.”
BackgroundKane, S. K., Jayant, C., Wobbrock, J. O., & Ladner, R. E. (2009) · Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/1639642.1639663 · Cited by 383 · cited 1×
“Applications for general-purpose smartphones are beginning to replace special-purpose devices, but blind people still carry devices such as GPS-powered navigation aids, barcode readers, light detectors, color identifiers, and compasses [13].”
BackgroundSelf-citationKane, S. K., Bigham, J. P., & Wobbrock, J. O. (2008) · Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/1414471.1414487 · Cited by 374 · cited 1×
“Touchscreen devices like the iPhone were once assumed to be inaccessible to blind users, but well-designed, multitouch interfaces leverage the spatial layout of the screen and can even be preferred by blind people [12].”
BackgroundSelf-citationTurKit: human computation algorithms on mechanical turk
Little, G., Chilton, L. B., Goldman, M., & Miller, R. C. (2010) · Proceedings of the 23nd annual ACM symposium on User interface software and technology · doi:10.1145/1866029.1866040 · Cited by 307 · cited 2×
“…along with a specific script that we have developed for this purpose 2 . quikTurkit is an abstraction layer on top of the TurKit Mechanical Turk API [19]. quikTurkit primarily achieves low latency by queuing workers before they are needed, but also encapsulates heuristics to help its Human…”
BackgroundSelf-citation
Research works printed but not linked: 12
- }} Amazon Mechanical Turk . http://www.mturk.com/ . 2010 . }}Amazon Mechanical Turk. http://www.mturk.com/. 2010.
- }} Amazon Remembers . http://www.amazon.com/gp/ . 2010 . }}Amazon Remembers. http://www.amazon.com/gp/. 2010.
- }} Chacha . http://www.chacha.com/ . 2010 . }}Chacha. http://www.chacha.com/. 2010.
- }} Eyes -free. http://code.google.com/p/eyes-free/ . 2010 . }}Eyes-free. http://code.google.com/p/eyes-free/. 2010.
- 10.5555/1564131.1564137 · doi:10.5555/1564131.1564137
- }} Intel reader. http://www.intel.com/healthcare/reader/ . 2009 . }}Intel reader. http://www.intel.com/healthcare/reader/. 2009.
- }}16. kNFB reader. knfb Reading Technology , Inc ., 2008 . http://www.knfbreader.com/. }}16. kNFB reader. knfb Reading Technology, Inc., 2008. http://www.knfbreader.com/.
- }} Knocking live video. ustream , 2010 . http://knockinglive.com/. }}Knocking live video. ustream, 2010. http://knockinglive.com/.
- }} Mobile speak screen readers . Code Factory , 2008 . http://www.codefactory.es/en/products.asp?id=16. }}Mobile speak screen readers. Code Factory, 2008. http://www.codefactory.es/en/products.asp?id=16.
- }} Talking signs. http://www.talkingsigns.com/ , 2008 . }}Talking signs. http://www.talkingsigns.com/, 2008.
- }}U Stream . ustream , 2010 . http://www.ustream.tv/. }}UStream. ustream, 2010. http://www.ustream.tv/.
- }} Voiceover : Macintosh OS X , 2007 . http://www.apple.com/accessibility/voiceover/. }}Voiceover: Macintosh OS X, 2007. http://www.apple.com/accessibility/voiceover/.
Cited by
Multimodal Machine Learning: A Survey and Taxonomy
Baltrusaitis, T., Ahuja, C., & Morency, L.-P. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2798607 · Cited by 5,018
VQA: Visual Question Answering
Antol, S., Agrawal, A., Lu, J., Mitchell, M., Batra, D., Zitnick, C. L., & Parikh, D. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.279 · Cited by 4,487
Kittur, A., Nickerson, J. V., Bernstein, M., Gerber, E., Shaw, A., Zimmerman, J., Lease, M., & Horton, J. (2013) · Proceedings of the 2013 conference on Computer supported cooperative work · doi:10.1145/2441776.2441923 · Cited by 1,034
Visual7W: Grounded Question Answering in Images
Zhu, Y., Groth, O., Bernstein, M., & Fei-Fei, L. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.540 · Cited by 794
“Visual question answering is a natural extension to the captioning tasks, but is more interactive and has a stronger connection to real-world applications [3].”
BackgroundHuman computation: a survey and taxonomy of a growing field
Quinn, A. J., & Bederson, B. B. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979148 · Cited by 801
Metadata
- Authors
- Bigham, J. P., Jayant, C., Ji, H., Little, G., Miller, A., Miller, R. C., Miller, R., Tatarowicz, A., White, B., White, S., & Yeh, T.
- Affiliations
- University of Rochester (US)
- University of Washington (US)
- Massachusetts Institute of Technology (US)
- University of Central Florida (US)
- University of Maryland, College Park (US)
- Venue
- Proceedings of the 23nd annual ACM symposium on User interface software and technology
- Publisher
- ACM
- Published
- 2010-10-03
- Pages
- 333-342
- OpenAlex
- W2090048052
- Cited by
- 601
- References
- 21
- Citations by year
- 2026: 34 · 2025: 51 · 2024: 56 · 2023: 34 · 2022: 29 · 2021: 33 · 2020: 37 · 2019: 38 · 2018: 44 · 2017: 44 · 2016: 33 · 2015: 47 · 2014: 43 · 2013: 44 · 2012: 19
- FWCI
- 48.66
- Type
- conference paper
- Language
- en
- Open access
- Locations
- ACM Symposium on User Interface Software and Technology (UIST) (publishedVersion)
- Journal of International Crisis and Risk Communication Research (submittedVersion)
- Topics
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- visual question answering, blind users, accessibility, assistive technology, mobile application, crowdsourcing, visual search, participatory design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: VizWiz: nearly real-time answers to visual questions. https://app.cochat.ai/papers/10.1145/1866029.1866080
- The paper
- Bigham, J. P., Jayant, C., Ji, H., Little, G., Miller, A., Miller, R. C., Miller, R., Tatarowicz, A., White, B., White, S., & Yeh, T. (2010). VizWiz: nearly real-time answers to visual questions. Proceedings of the 23nd annual ACM symposium on User interface software and technology. https://doi.org/10.1145/1866029.1866080
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.