Fingersight: Fingertip haptic sensing of the visual environment
Open accessAbstract
We present a novel device mounted on the fingertip for acquiring and transmitting visual information through haptic channels. In contrast to previous systems in which the user interrogates an intermediate representation of visual information, such as a tactile display representing a camera generated image, our device uses a fingertip-mounted camera and haptic stimulator to allow the user to feel visual features directly from the environment. Visual features ranging from simple intensity or oriented edges to more complex information identified automatically about objects in the environment may be translated in this manner into haptic stimulation of the finger. Experiments using an initial prototype to trace a continuous straight edge have quantified the user's ability to discriminate the angle of the edge, a potentially useful feature for higher levels analysis of the visual scene.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The Senses Considered as Perceptual Systems
West, C. K., & Gibson, J. J. (1969) · Journal of Aesthetic Education · doi:10.2307/3331482 · Cited by 6,344 · see citing works
Lederman, S. J., & Klatzky, R. L. (2009) · Attention, Perception & Psychophysics · doi:10.3758/app.71.7.1439 · Cited by 1,108 · see citing works
Self-citationAn experimental system for auditory image representations
Meijer, P. B. L. (1992) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.121642 · Cited by 900 · see citing works
Roco, M. C., & Bainbridge, W. S. (2003) · Cited by 663 · see citing works
What is the set of images of an object under all possible lighting conditions?
Belhumeur, P. N., & Kriegman, D. (1996) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1996.517085 · Cited by 380 · see citing works
Information transmission with a multifinger tactual display
Tan, H. Z., Durlach, N. I., Reed, C. M., & Rabinowitz, W. M. (1999) · Perception & Psychophysics · doi:10.3758/bf03207608 · Cited by 159 · see citing works
Applied Spatial Cognition: From Research to Cognitive Technology
(2020) · Psychology Press eBooks · doi:10.4324/9781003064350 · Cited by 159 · see citing works
Chapter 16. Sensory substitution
Lenay, C., Gapenne, O., Hanneton, S., Marque, C. K., & Genouëlle, C. (2003) · Advances in consciousness research · doi:10.1075/aicr.53.22len · Cited by 150 · see citing works
The Senses Considered as Perceptual Systems.
Hamlyn, D. W., & Gibson, J. J. (1968) · The Philosophical Review · doi:10.2307/2183575 · Cited by 146 · see citing works
Retention of high tactile acuity throughout the life span in blindness
Legge, G. E., MADISON, C., VAUGHN, B. N., Cheong, A. M. Y., & MILLER, J. C. (2008) · Perception & Psychophysics · doi:10.3758/pp.70.8.1471 · Cited by 135 · see citing works
Stated Preferences for Components of a Personal Guidance System for Nonvisual Navigation
Golledge, R. G., Marston, J. R., Loomis, J. M., & Klatzky, R. L. (2004) · Journal of Visual Impairment & Blindness · doi:10.1177/0145482x0409800304 · Cited by 113 · see citing works
Self-citationElectronic Spatial Sensing for the Blind
Warren, D. H. D., & Strelow, E. R. (1985) · Springer eBooks · doi:10.1007/978-94-017-1400-6 · Cited by 111 · see citing works
Assistive Technology for Blindness and Low Vision
(2018) · CRC Press eBooks · doi:10.1201/9781315216935 · Cited by 107 · see citing works
Technology and perception: the contribution of sensory substitution systems
Lenay, C., Canu, S., & Villon, P. (2002) · International Conference on Cognitive Technology (CT) · doi:10.1109/ct.1997.617681 · Cited by 68 · see citing works
Postma, A., Zuidhoek, S., Noordzij, M. L., & Kappers, A. M. L. (2008) · Perception & Psychophysics · doi:10.3758/pp.70.7.1197 · Cited by 67 · see citing works
Vibrotactile Pattern Perception: Extraordinary Observers
Craig, J. C. (1977) · Science · doi:10.1126/science.850791 · Cited by 65 · see citing works
Assisting Wayfinding in Visually Impaired Travelers
Loomis, J. M., Golledge, R. G., Klatzky, R. L., et al. (2020) · Psychology Press eBooks · doi:10.4324/9781003064350-7 · Cited by 62 · see citing works
Self-citationHaptic Pictures: Fit Judgments Predict Identification, Recognition Memory, and Confidence
Kennedy, J. M., & Bai, J. (2002) · Perception · doi:10.1068/p3259 · Cited by 49 · see citing works
A compact tactile display for the blind with shape memory alloys
Velázquez, R., Pissaloux, E. E., & Wiertlewski, M. (2006) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2006.1642300 · Cited by 49 · see citing works
Distal Attribution and Distance Perception in Sensory Substitution
Siegle, J. H., & Warren, W. H. (2010) · Perception · doi:10.1068/p6366 · Cited by 44 · see citing works
Issues of Using Tactile Mice by Individuals Who Are Blind and Visually Impaired
Rastogi, R., Pawluk, D. T. V., & Ketchum, J. M. (2010) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2010.2045008 · Cited by 27 · see citing works
Navigating a Portable Robotic Device by a 3D imaging sensor
Ye, C. (2010) · Proceedings of IEEE Sensors/Proceedings of IEEE Sensors ... · doi:10.1109/icsens.2010.5690750 · Cited by 24 · see citing works
james j. gibson ,The Senses Considered as Perceptual Systems
Edgerton, S. Y. (1969) · The Art Bulletin · doi:10.1080/00043079.1969.10790296 · Cited by 24 · see citing works
Bach‐y‐Rita, P., & Me, T. (2000) · PubMed · Cited by 19 · see citing works
Using multiple contacts with texture-enhanced graphics
Burch, D., & Pawluk, D. T. V. (2011) · IEEE World Haptics Conference (WHC) · doi:10.1109/whc.2011.5945500 · Cited by 18 · see citing works
Fingersight: Fingertip Visual Haptic Sensing and Control
Stetten, G., Klatzky, R., Nichol, B., et al. (2007) · doi:10.1109/have.2007.4371592 · Cited by 16 · see citing works
Self-citationBurch, D. S., & Pawluk, D. T. V. (2009) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/1639642.1639682 · Cited by 14 · see citing works
Maingreaud, F., Pissaloux, E. E., Velázquez, R., Gaunet, F., Hafez, M., & Alexandre, J.-M. (2005) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/iembs.2005.1616095 · Cited by 12 · see citing works
Galeotti, J., Horvath, S., Klatzky, R. L., et al. (2008) · doi:10.1145/1401615.1401631 · Cited by 8 · see citing works
Self-citationAn experimental study on target recognition using white canes
Nunokawa, K., & Ino, S. (2010) · Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society · doi:10.1109/iembs.2010.5627121 · Cited by 7 · see citing works
Bentzen, B. L., Crandall, W. F., & Myers, L. (1997) · Journal of Visual Impairment & Blindness · doi:10.1177/0145482x9709100409 · Cited by 4 · see citing works
Fingertip Vibratory Transducer for Detecting Optical Edges Using Regenerative Feedback
Zawrotny, K., Craig, A. E., Weiser, D., Klatzky, R. L., & Stetten, G. (2006) · Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems · doi:10.1109/haptic.2006.1627136 · Cited by 3 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 2
- [6]6. C. Lenay, O. Gapenne, S. Hanneton, C. Marque, and C. Genouelle, ''Sensory substitution: Limits and perspectives,'' in Touching For Knowing: Cognitive Psychology Of Haptic Manual Perception, Y. Hatwell, A. Steri, and E. Gentaz, Eds. Amsterdam, The Netherlands: John Benjamins, 2003, pp. 275-292.
- [22]22. J. Galeotti, S. Horvath, R. Klatzky, B. Nichol, M. Siegel, and G. Stetten, ''FingerSight: Fingertip control and haptic sensing of the visual environment,'' SIGGRAPH New Tech. Demos, Los Angeles, CA, USA, Aug. 2008, pp. 11-15.
Cited by
Sorted by citations
Pantoguide: a haptic and audio guidance system to support tactile graphics exploration.
Chase, E. D. Z., Siu, A. F., Boadi-Agyemang, A., Kim, G. S.-H., Gonzalez, E. J., & Follmer, S. (2020) · Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3373625.3418023 · Cited by 25 · see citing works
Developing dynamic audio navigation uis to pinpoint elements in tactile graphics
Ramôa, G., Schmidt, V., & König, P. (2022) · Multimodal Technologies and Interaction · doi:10.3390/mti6120113 · Cited by 14 · see citing works
Ramôa, G., Schmidt, V., Schwarz, T., Stiefelhagen, R., & König, P. (2024) · Frontiers in Rehabilitation Sciences · doi:10.3389/fresc.2024.1368983 · Cited by 5 · see citing works
- Authors
- Horvath, S., Galeotti, J., Wu, B., Klatzky, R., Siegel, M., & Stetten, G.
- Affiliations
- Carnegie Mellon University (US)
- Arizona State University (US)
- University of Pittsburgh (US)
- Corresponding author
- Stetten, George
- Venue
- IEEE Journal of Translational Engineering in Health and Medicine
- Published
- 2014
- Volume
- 2
- Pages
- 1-9
- ISSN
- 2168-2372 (ISSN-L)
- PMC
- PMC4848062
- OpenAlex
- W1989977220
- Semantic Scholar
- 11545d136f00b3ceb3f817ac45a230930bbafaf1
- Cited by
- 28
- References
- 32
- Citations by year
- 2026: 2 · 2025: 2 · 2024: 1 · 2023: 1 · 2022: 1 · 2021: 2 · 2020: 4 · 2019: 2 · 2018: 2 · 2017: 4 · 2016: 3 · 2015: 3 · 2014: 1
- FWCI
- 2.05
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Journal of Translational Engineering in Health and Medicine (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- D-Scholarship@Pitt (University of Pittsburgh) (acceptedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- NIH (1R01EY021641)
- NSF GRFP (0946825)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Physical Sciences › Engineering › Mechanical Engineering › Teleoperation and Haptic Systems
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Keywords
- haptic stimulation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
