The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
GelSight: High-Resolution Robot Tactile Sensors for Estimating Geometry and Force
Open accessAbstract
Tactile sensing is an important perception mode for robots, but the existing tactile technologies have multiple limitations. What kind of tactile information robots need, and how to use the information, remain open questions. We believe a soft sensor surface and high-resolution sensing of geometry should be important components of a competent tactile sensor. In this paper, we discuss the development of a vision-based optical tactile sensor, GelSight. Unlike the traditional tactile sensors which measure contact force, GelSight basically measures geometry, with very high spatial resolution. The sensor has a contact surface of soft elastomer, and it directly measures its deformation, both vertical and lateral, which corresponds to the exact object shape and the tension on the contact surface. The contact force, and slip can be inferred from the sensor’s deformation as well. Particularly, we focus on the hardware and software that support GelSight’s application on robot hands. This paper reviews the development of GelSight, with the emphasis in the sensing principle and sensor design. We introduce the design of the sensor’s optical system, the algorithm for shape, force and slip measurement, and the hardware designs and fabrication of different sensor versions. We also show the experimental evaluation on the GelSight’s performance on geometry and force measurement. With the high-resolution measurement of shape and contact force, the sensor has successfully assisted multiple robotic tasks, including material perception or recognition and in-hand localization for robot manipulation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Tactile Sensing—From Humans to Humanoids
Dahiya, R. S., Metta, G., Valle, M., & Sandini, G. (2010) · IEEE Transactions on Robotics · doi:10.1109/tro.2009.2033627 · Cited by 1,851
Iteratively reweighted least squares minimization for sparse recovery
Daubechies, I., DeVore, R., Fornasier, M., & Güntürk, C. S. (2010) · Communications on Pure and Applied Mathematics · doi:10.1002/cpa.20303 · Cited by 1,295
Tactile sensing for dexterous in-hand manipulation in robotics—A review
Yousef, H., Boukallel, M., & Althoefer, K. (2011) · Sensors and Actuators A: Physical · doi:10.1016/j.sna.2011.02.038 · Cited by 784
Tactile sensing in dexterous robot hands — Review
Kappassov, Z., Corrales, J.-A., & Perdereau, V. (2015) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2015.07.015 · Cited by 782
Extracting object properties through haptic exploration
Lederman, S. J., & Klatzky, R. L. (1993) · Acta Psychologica · doi:10.1016/0001-6918(93)90070-8 · Cited by 401
Biomimetic tactile sensor array
Wettels, N., Santos, V. J., Johansson, R. S., & Loeb, G. E. (2008) · Advanced Robotics · doi:10.1163/156855308x314533 · Cited by 348
Measurement of shear and slip with a GelSight tactile sensor
Yuan, W., Li, R., Srinivasan, M. A., & Adelson, E. H. (2015) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2015.7139016 · Cited by 278
Self-citationHigh-Resolution Thin-Film Device to Sense Texture by Touch
Maheshwari, V., & Saraf, R. F. (2006) · Science · doi:10.1126/science.1126216 · Cited by 277
Localization and manipulation of small parts using GelSight tactile sensing
Li, R., Platt, R., Yuan, W., ten Pas, A., Roscup, N., Srinivasan, M. A., & Adelson, E. (2014) · 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2014.6943123 · Cited by 250
Self-citationTactual perception of material properties
Bergmann Tiest, W. M. (2010) · Vision Research · doi:10.1016/j.visres.2010.10.005 · Cited by 240
Improved GelSight tactile sensor for measuring geometry and slip
Dong, S., Yuan, W., & Adelson, E. H. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8202149 · Cited by 225
Self-citationImproved GelSight tactile sensor for measuring geometry and slipPreprint
Dong, S., Yuan, W., & Adelson, E. H. (2017) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 216
Self-citationVision-based sensor for real-time measuring of surface traction fields
Kamiyama, K., Vlack, K., Mizota, T., Kajimoto, H., Kawakami, K., & Tachi, S. (2005) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2005.27 · Cited by 191
Shape-independent hardness estimation using deep learning and a GelSight tactile sensor
Yuan, W., Zhu, C., Owens, A., Srinivasan, M. A., & Adelson, E. H. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989116 · Cited by 177
Self-citationDevelopment of a tactile sensor based on biologically inspired edge encoding
Chorley, C., Melhuish, C., Pipe, T., & Rossiter, J. M. (2009) · International Conference on Advanced Robotics (ICAR) · Cited by 175
Finger-Shaped GelForce: Sensor for Measuring Surface Traction Fields for Robotic Hand
Sato, K., Kamiyama, K., Kawakami, N., & Tachi, S. (2010) · IEEE Transactions on Haptics · doi:10.1109/toh.2009.47 · Cited by 172
Connecting Look and Feel: Associating the Visual and Tactile Properties of Physical Materials
Yuan, W., Wang, S., Dong, S., & Adelson, E. H. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.478 · Cited by 167
Self-citationSensing and Recognizing Surface Textures Using a GelSight Sensor
Li, R., & Adelson, E. H. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.164 · Cited by 160
Self-citationPlanar and finger-shaped optical tactile sensors for robotic applications
Begej, S. (1988) · IEEE Journal on Robotics and Automation · doi:10.1109/56.20431 · Cited by 155
Shape-independent hardness estimation using deep learning and a GelSight tactile sensor
Yuan, W., Zhu, C., Owens, A., Srinivasan, M. A., & Adelson, E. H. (2017) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 154
Self-citationMittendorfer, P., Yoshida, E., & Cheng, G. (2015) · Advanced Robotics · doi:10.1080/01691864.2014.952493 · Cited by 133
Reconstructing the Shape of a Deformable Membrane from Image Data
Ferrier, N., & Brockett, R. W. (2000) · The International Journal of Robotics Research · doi:10.1177/02783640022067184 · Cited by 112
Microgeometry capture using an elastomeric sensor
Johnson, M. K., Cole, F., Raj, A., & Adelson, E. H. (2011) · ACM SIGGRAPH Conference Papers (SIGGRAPH) · doi:10.1145/1964921.1964941 · Cited by 109
Self-citationExploratory Tactile Servoing With Active Touch
Lepora, N. F., Aquilina, K., & Cramphorn, L. (2017) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2017.2662071 · Cited by 88
Tracking objects with point clouds from vision and touch
Izatt, G., Mirano, G. J., Adelson, E. H., & Tedrake, R. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989460 · Cited by 75
Self-citationTactile Manipulation With a TacThumb Integrated on the Open-Hand M2 Gripper
Ward-Cherrier, B., Cramphorn, L., & Lepora, N. F. (2016) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2016.2514420 · Cited by 61
Retrographic sensing for the measurement of surface texture and shape
Johnson, M. K., & Adelson, E. H. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206534 · Cited by 61
Self-citationAn optical tactile sensor for manipulators
Schneiter, J. L., & Sheridan, T. B. (1984) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/0736-5845(84)90081-4 · Cited by 55
A new design of a fingertip for the iCub hand
Jamali, N., Maggiali, M., Giovannini, F., Giorgio Metta, B., & Natale, L. (2015) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353747 · Cited by 48
Cutkosky, M. R., & Provancher, W. R. (2016) · Springer handbooks · doi:10.1007/978-3-319-32552-1_28 · Cited by 45
Addition of a Biomimetic Fingerprint on an Artificial Fingertip Enhances Tactile Spatial Acuity
Cramphorn, L., Ward-Cherrier, B., & Lepora, N. F. (2017) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2017.2665690 · Cited by 37
Vision-Based Tactile Sensing and Shape Estimation Using a Fluid-Type Touchpad
Ito, Y., Kim, Y., Nagai, C., & Obinata, G. (2012) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2012.2206075 · Cited by 27
Cited by
Technology Roadmap for Flexible Sensors
Luo, Y., Abidian, M. R., Ahn, J.-H., Akinwande, D., Andrews, A. M., Antonietti, M., Bao, Z., Berggren, M., Berkey, C. A., Bettinger, C. J., et al. (2023) · ACS Nano · doi:10.1021/acsnano.2c12606 · Cited by 1,383
Trends and challenges in robot manipulation
Billard, A., & Kragic, D. (2019) · Science · doi:10.1126/science.aat8414 · Cited by 993
Toward Perceptive Soft Robots: Progress and Challenges
Wang, H., Totaro, M., & Beccai, L. (2018) · Advanced Science · doi:10.1002/advs.201800541 · Cited by 753
Soft magnetic skin for super-resolution tactile sensing with force self-decoupling
Yan, Y., Hu, Z., Yang, Z., Yuan, W., Song, C., Pan, J., & Shen, Y. (2021) · Science Robotics · doi:10.1126/scirobotics.abc8801 · Cited by 556
Self-citationLambeta, M., Chou, P.-W., Tian, S., Yang, B., Maloon, B., Most, V. R., Stroud, D., Santos, R., Byagowi, A., Kammerer, G., et al. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2977257 · Cited by 553
Metadata
- Authors
- Yuan, W., Dong, S., & Adelson, E.
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2017-11-29
- Volume
- 17
- Issue
- 12
- Pages
- 2762
- ISSN
- 1424-8220 (ISSN-L)
- OpenAlex
- W2775635818
- Cited by
- 1,166
- References
- 33
- FWCI
- 21.52
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.