LiSee: A Headphone that Provides All-day Assistance for Blind and Low-vision Users to Reach Surrounding Objects
Abstract
Reaching surrounding target objects is difficult for blind and low-vision (BLV) users, affecting their daily life. Based on interviews and exchanges, we propose an unobtrusive wearable system called LiSee to provide BLV users with all-day assistance. Following a user-centered design method, we carefully designed the LiSee prototype, which integrates various electronic components and is disguised as a neckband headphone such that it is an extension of the existing headphone. The top-level software includes a series of seamless image processing algorithms to solve the challenges brought by the unconstrained wearable form so as to ensure excellent real-time performance. Moreover, users are provided with a personalized guidance scheme so that they can use LiSee quickly based on their personal expertise. Finally, a system evaluation and a user study were completed in the laboratory and participants' homes. The results show that LiSee works robustly, indicating that it can meet the daily needs of most participants to reach surrounding objects.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
These previous studies have found many successes of the technology.
“These studies have found many successes of the technology.”
From An investigation into the effectiveness of using acoustic touch to assist people who are blind (2023) · cites this paper as [64]
Multiple similar previous works [64-67] have explored using the YOLOv5 (or similar) deep learning model on a smartphone for the computer vision of smart glasses.
“Multiple similar previous works [64–67] have explored using the YOLOv5 (or similar) deep learning model on a smartphone for the computer vision of smart glasses.”
From An investigation into the effectiveness of using acoustic touch to assist people who are blind (2023) · cites this paper as [64]
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589 · see citing works
MobileNetV2: Inverted Residuals and Linear Bottlenecks
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., & Chen, L.-C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00474 · Cited by 28,755 · see citing works
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105 · see citing works
ORB: An efficient alternative to SIFT or SURF
Rublee, E., Rabaud, V., Konolige, K., & Bradski, G. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126544 · Cited by 11,037 · see citing works
Co-creation and the new landscapes of design
Sanders, E. B.-N., & Stappers, P. J. (2008) · CoDesign · doi:10.1080/15710880701875068 · Cited by 5,561 · see citing works
CutMix: Regularization Strategy to Train Strong Classifiers With Localizable Features
Yun, S., Han, D., Chun, S., Oh, S. J., Yoo, Y., & Choe, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00612 · Cited by 5,400 · see citing works
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
Wang, A., Singh, A., Michael, J., Hill, F., Levy, O., & Bowman, S. (2018) · Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP · doi:10.18653/v1/w18-5446 · Cited by 4,222 · see citing works
Speed/Accuracy Trade-Offs for Modern Convolutional Object Detectors
Huang, J., Rathod, V., Sun, C., Zhu, M., Korattikara, A., Fathi, A., Fischer, I., Wojna, Z., Song, Y., Guadarrama, S., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.351 · Cited by 2,743 · see citing works
Accurate and Efficient Stereo Processing by Semi-Global Matching and Mutual Information
Hirschmüller, H. (2005) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2005.56 · Cited by 1,731 · see citing works
Enhanced Computer Vision With Microsoft Kinect Sensor: A Review
Han, J., Shao, L., Xu, D., & Shotton, J. (2013) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2013.2265378 · Cited by 1,366 · see citing works
VizWiz: nearly real-time answers to visual questions
Bigham, J. P., Jayant, C., Ji, H., Little, G., Miller, A., Miller, R. C., Miller, R., Tatarowicz, A., White, B., White, S., et al. (2010) · Proceedings of the 23nd annual ACM symposium on User interface software and technology · doi:10.1145/1866029.1866080 · Cited by 601 · see citing works
Abras, C., Maloney-Krichmar, D., & Preece, J. J. (2004) · Cited by 498 · see citing works
Calculating Dense Disparity Maps from Color Stereo Images, an Efficient Implementation
Mühlmann, K., Maier, D., Hesser, J., & Männer, R. (2002) · International Journal of Computer Vision · doi:10.1023/a:1014581421794 · Cited by 282 · see citing works
A Two-Streamed Network for Estimating Fine-Scaled Depth Maps from Single RGB Images
Li, J., Klein, R., & Yao, A. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.365 · Cited by 264 · see citing works
Understanding Human Hands in Contact at Internet Scale
Shan, D., Geng, J., Shu, M., & Fouhey, D. F. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00989 · Cited by 261 · see citing works
Collaborative Accessibility: How Blind and Sighted Companions Co-Create Accessible Home Spaces
Branham, S. M., & Kane, S. K. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702511 · Cited by 159 · see citing works
The AT Effect: How Disability Affects the Perceived Social Acceptability of Head-Mounted Display Use
Profita, H., Albaghli, R., Findlater, L., Jaeger, P., & Kane, S. K. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858130 · Cited by 131 · see citing works
Zhang (2020) · doi:10.1145/3432192 · Cited by 126 · see citing works
CueSee: exploring visual cues for people with low vision to facilitate a visual search task
Zhao, Y., Szpiro, S., Knighten, J., & Azenkot, S. (2016) · Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2971648.2971730 · Cited by 111 · see citing works
Time-of-Flight and Depth Imaging. Sensors, Algorithms, and Applications
Grzegorzek, M., Theobalt, C., Koch, R., & Kolb, A. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-44964-2 · Cited by 109 · see citing works
Indoor navigation by blind people: behaviors and challenges in unfamiliar spaces and buildings
Jeamwatthanachai, W., Wald, M., & Wills, G. (2019) · British Journal of Visual Impairment · doi:10.1177/0264619619833723 · Cited by 105 · see citing works
UAV-Based Stereo Vision for Rapid Aerial Terrain Mapping
Stefanik, K. V., Gassaway, J., Kochersberger, K. B., & Abbott, A. L. (2011) · GIScience & Remote Sensing · doi:10.2747/1548-1603.48.1.24 · Cited by 81 · see citing works
Satpute, S. A., Canady, R., Klatzky, R. L., & Stetten, G. (2019) · IEEE Transactions on Haptics · doi:10.1109/toh.2019.2945561 · Cited by 77 · see citing works
Dementyev, A., & Holz, C. (2017) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3053330 · Cited by 72 · see citing works
Winberg, F., & Bowers, J. (2004) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/1031607.1031662 · Cited by 68 · see citing works
Chen, W., Chen, L., Huang, Y., Zhang, X., Wang, L., Ruby, R., & Wu, K. (2019) · ACM Annual International Conference on Mobile Computing and Networking (MobiCom) · doi:10.1145/3300061.3300124 · Cited by 68 · see citing works
Self-citationPrakash, J., Yang, Z., Wei, Y., Hassanieh, H., & Choudhury, R. R. (2020) · ACM Annual International Conference on Mobile Computing and Networking (MobiCom) · doi:10.1145/3372224.3419197 · Cited by 67 · see citing works
SRHandNet: Real-Time 2D Hand Pose Estimation With Simultaneous Region Localization
Wang, Y., Zhang, B., & Peng, C. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2955280 · Cited by 64 · see citing works
Third Eye: A Shopping Assistant for the Visually Impaired
Zientara, P. A., Lee, S., Smith, G. H., Brenner, R., Itti, L., Rosson, M. B., Carroll, J. M., Irick, K. M., & Narayanan, V. (2017) · Computer · doi:10.1109/mc.2017.36 · Cited by 59 · see citing works
Ananthanarayan, S., Sheh, M., Chien, A. Y.-C., Profita, H. P., & Siek, K. A. (2013) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2466161 · Cited by 52 · see citing works
Gomes, K. R., Hernández‐López, D., Ballesteros, R., & Moreno, M. Á. (2016) · Biosystems Engineering · doi:10.1016/j.biosystemseng.2016.09.014 · Cited by 48 · see citing works
Battery-Free Eye Tracker on Glasses
Li, T., & Zhou, X. (2018) · ACM Annual International Conference on Mobile Computing and Networking (MobiCom) · doi:10.1145/3241539.3241578 · Cited by 47 · see citing works
Yang, Z., Wei, Y., Shen, S., & Choudhury, R. R. (2020) · ACM Annual International Conference on Mobile Computing and Networking (MobiCom) · doi:10.1145/3372224.3419213 · Cited by 46 · see citing works
Gosselin-Kessiby, N., Kalaska, J. F., & Messier, J. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.2374-08.2009 · Cited by 46 · see citing works
GuideCopter - A Precise Drone-Based Haptic Guidance Interface for Blind or Visually Impaired People
Huppert, F., Hoelzl, G., & Kranz, M. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445676 · Cited by 43 · see citing works
Boldú, R., Dancu, A., Matthies, D. J. C., Buddhika, T., Siriwardhana, S., & Nanayakkara, S. C. (2018) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3264904 · Cited by 39 · see citing works
Yuan, C. W., Hanrahan, B. V., Lee, S., Rosson, M. B., & Carroll, J. M. (2019) · Universal Access in the Information Society · doi:10.1007/s10209-017-0577-1 · Cited by 38 · cited 1× · see citing works
“Although relevant interview studies on BLV users’ shopping [23, 81], indoor navigation [43], privacy concerns [15], social interaction [44], and family collaboration [24, 77] have been conducted, there is still no in-depth insight into reaching surrounding target objects.”
BackgroundZhang, X., Gui, X., Kou, Y., & Li, Y. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415213 · Cited by 38 · see citing works
Cordourier-Maruri, H., Lopez‐Meyer, P., Huang, J., Beltman, W. M., Nachman, L., & Lu, H. (2018) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3287058 · Cited by 38 · see citing works
A Literature Survey on Blur Detection Algorithms for Digital Imaging
Koik, B. T., & Ibrahim, H. (2013) · International Conference on Artificial Intelligence, Modelling and Simulation (AIMS) · doi:10.1109/aims.2013.50 · Cited by 36 · see citing works
Toward User-Driven Sound Recognizer Personalization with People Who Are d/Deaf or Hard of Hearing
Goodman, S. M., Liu, P., Jain, D., McDonnell, E. J., Froehlich, J. E., & Findlater, L. (2021) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3463501 · Cited by 33 · see citing works
Acoustic-based Upper Facial Action Recognition for Smart Eyewear
Xie, W., Zhang, Q., & Zhang, J. (2021) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3448105 · Cited by 31 · see citing works
Boldú, R., Matthies, D. J. C., Zhang, H., & Nanayakkara, S. C. (2020) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3432196 · Cited by 29 · see citing works
Khambadkar, V., & Folmer, E. (2013) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2501988.2502047 · Cited by 28 · see citing works
Avila, M., & Funk, M. (2018) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3234695.3241019 · Cited by 27 · see citing works
Huang, Y., Chen, K., Wang, L., Dong, Y., Huang, Q., & Wu, K. (2021) · ACM Annual International Conference on Mobile Computing and Networking (MobiCom) · doi:10.1145/3447993.3483246 · Cited by 25 · see citing works
Self-citationFitting in or Feeling Excluded: The Experiences of High School Students with Visual Impairments
Jessup, G. M., Bundy, A. C., Broom, A. F., & Hancock, N. (2018) · Journal of Visual Impairment & Blindness · doi:10.1177/0145482x1811200305 · Cited by 21 · see citing works
Motion blur detection based on lowest directional high-frequency energy
Chen, X., Yang, J., Wu, Q., & Zhao, J. (2010) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2010.5652935 · Cited by 20 · see citing works
Chwalek, P., Ramsay, D. B., & Paradiso, J. (2021) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3478079 · Cited by 19 · see citing works
Shih, M.-L., Chen, Y., Tung, C.-Y., Sun, C. J., Cheng, C.-J., Chan, L., Varadarajan, S., & Sun, M. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593711 · Cited by 16 · see citing works
Self-citationChang, Y., Zhao, Y., Dong, M., Wang, Y., Lu, Y., Lv, Q., Dick, R. P., Lu, T., Gu, N., & Shang, L. (2021) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3463509 · Cited by 15 · see citing works
Kaul, O. B., Behrens, K., & Rohs, M. (2021) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3411763.3451611 · Cited by 12 · see citing works
Yagi, T., Nishiyasu, T., Kawasaki, K., Matsuki, M., & Sato, Y. (2021) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3397481.3450664 · Cited by 12 · see citing works
Kim, W., Lee, S., Kim, S., Jo, S., Yoo, C., HWANG, I., Kang, S., & Song, J. (2020) · Open Access System for Information Sharing (Pohang University of Science and Technology) · Cited by 11 · see citing works
Jin, L., Zhang, H., Shen, Y., & Ye, C. (2020) · IEEE International Conference on Human-Machine Systems (ICHMS) · doi:10.1109/ichms49158.2020.9209377 · Cited by 7 · see citing works
A Wearable Robotic Object Manipulation Aid for the Visually Impaired
Liu, X., Zhang, H., Jin, L., & Ye, C. (2018) · IEEE International Conference on Micro/Nano Sensors for AI, Healthcare, and Robotics (NSENS) · doi:10.1109/nsens.2018.8713628 · Cited by 5 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
An investigation into the effectiveness of using acoustic touch to assist people who are blind
Zhu, H. Y., Hossain, S. N., Jin, C., Singh, A. K., Nguyen, M. T. D., Deverell, L., Nguyen, V., Gates, F. S., Fernandez, I. G., Melencio, M. V., et al. (2023) · PLoS ONE · doi:10.1371/journal.pone.0290431 · Cited by 16 · see citing works
LiT: Fine-grained Toothbrushing Monitoring with Commercial LED Toothbrush
Chen, K., Wang, L., Huang, Y., Wu, K., & Wang, L. (2023) · ACM Annual International Conference on Mobile Computing and Networking (MobiCom) · doi:10.1145/3570361.3613287 · Cited by 14 · see citing works
Self-citationLocatAR: An AR Object Search Assistance System for a Shared Space
Oshimi, H., Perusquía-Hernández, M., Isoyama, N., Uchiyama, H., & Kiyokawa, K. (2023) · Augmented Humans International Conference (AHs) · doi:10.1145/3582700.3582712 · Cited by 10 · see citing works
MR-Sense: A Mixed Reality Environment Search Assistant for Blind and Visually Impaired People
Schieber, H., Kleinbeck, C., Theelke, L., Kraft, M., Kreimeier, J., & Roth, D. (2024) · IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR) · doi:10.1109/aixvr59861.2024.00029 · Cited by 7 · see citing works
Vinci: A Real-time Smart Assistant Based on Egocentric Vision-language Model for Portable Devices
Huang, Y., Xu, J., Pei, B., Yang, L., Zhang, M., He, Y., Guo, C., Chen, X., Wang, Y., Nie, Z., et al. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3749513 · Cited by 12 · see citing works
Self-citationSingSprite: Non-Tactile Appliance Interaction for the Blind through Power-Supply Acoustic Signatures
Yang, L., Wang, W., Zhang, Y., Liu, Y., Chen, Y.-C., Xue, G., & Ali, A. (2026) · doi:10.1145/3774906.3800505 · Cited by 3 · see citing works
Self-citationOptical Sensing-Based Intelligent Toothbrushing Monitoring System
Chen, K., Wang, L., Huang, Y., Wu, K., & Wang, L. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3479455 · Cited by 1 · see citing works
Self-citationRe-imagining sensory substitution through gestural control: Point-To-Tell 2
Ruan, L., Hamilton-Fletcher, G., Beheshti, M., Hudson, T. E., Porfiri, M., & Rizzo, J. (2025) · Disability and Rehabilitation Assistive Technology · doi:10.1080/17483107.2025.2590679 · Cited by 1 · see citing works
Understanding the Feasibility of Auditory Hand-Steering Guidance for Blind and Low-Vision People
Abe, Y., Lin, R. X., Hara, K., & Sakamoto, D. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790782 · Cited by 1 · see citing works
Navigating the challenges of remotely supporting blind riders in ridesharing
Ohn-Bar, E., Zhu, R., Zhang, J., & Zhang, L. (2025) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2025.103594
PIT+: A Smart Toothbrush With View-Adaptive Plaque Visualization
Chen, K., Xiang, J., Huang, Y., Toro, U. S., Xie, Q., Wang, L., Che, Y., Wu, K., & Wang, L. (2026) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2026.3684206
Self-citationFrom Coarse Search to Precise Alignment: Auditory Guidance for Non-Visual Target Acquisition in VR
Tanaka, K., Ribeiro, R. A., Guerreiro, J., Takagi, H., Ochiai, Y., & Asakawa, C. (2026) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3797867.3828980
- Authors
- Chen, K., Huang, Y., Chen, Y., Zhong, H., Lin, L., Wang, L., & Wu, K.
- Affiliations
- Shenzhen University (CN)
- Venue
- Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Published
- 2022-09-06
- Volume
- 6
- Issue
- 3
- Pages
- 1-30
- ISSN
- 2474-9567 (ISSN-L)
- OpenAlex
- W4294892001
- Cited by
- 12
- References
- 57
- Citations by year
- 2026: 4 · 2025: 3 · 2024: 2 · 2023: 3
- FWCI
- 3.22
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies (publishedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- Topics
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
- Keywords
- blind and visually impaired users, wearable assistive technology, individual guidance, user-centered design, real-time object detection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
