Learning the signatures of the human grasp using a scalable tactile glove
The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
Humans can feel, weigh and grasp diverse objects, and simultaneously infer their material properties while applying the right amount of force-a challenging set of tasks for a modern robot 1 . Mechanoreceptor networks that provide sensory feedback and enable the dexterity of the human grasp 2 remain difficult to replicate in robots. Whereas computer-vision-based robot grasping strategies 3-5 have progressed substantially with the abundance of visual data and emerging machine-learning tools, there are as yet no equivalent sensing platforms and large-scale datasets with which to probe the use of the tactile information that humans rely on when grasping objects. Studying the mechanics of how humans grasp objects will complement vision-based robotic object handling. Importantly, the inability to record and analyse tactile signals currently limits our understanding of the role of tactile information in the human grasp itself-for example, how tactile maps are used to identify objects and infer their properties is unknown 6 . Here we use a scalable tactile glove and deep convolutional neural networks to show that sensors uniformly distributed over the hand can be used to identify individual objects, estimate their weight and explore the typical tactile patterns that emerge while grasping objects. The sensor array (548 sensors) is assembled on a knitted glove, and consists of a piezoresistive film connected by a network of conductive thread electrodes that are passively probed. Using…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For medical robotics, CNNs can be applied to textile-based tactile sensors to classify human poses, motions, and other user interactions (Figure 11A–11C).[160,444]”
From Flexible Electronics and Devices as Human–Machine Interfaces for Medical Robotics (2022) · cites this paper as [160]
In the citing paper
“There have been many outstanding examples of exploiting machine learning in the field of sensors and actuators, such as extracting motion intent from electrophysiological signals,[287,610] using haptics to identify object categories,[160,611] decoupling multimodal signals from cross-reactive sensor arrays,[231,612] and controlling soft robots[613,614].”
From Flexible Electronics and Devices as Human–Machine Interfaces for Medical Robotics (2022) · cites this paper as [160]
In the citing paper
“Compared with the simulated feelings of sight, hearing, and smell, virtual tactile sense is much more difficult to be realized because it requires a fast-response, high-resolution, bio-friendly, and large-sized tactile stimulation technique”
From Self-powered electro-tactile system for virtual tactile experiences (2021) · cites this paper as [3]
In the citing paper
“As illustrated in Fig. 9a (Sundaram et al. 2019), Sundaram et al. propose an affordable and scalable tactile glove (STAG) capable of object identification, weight estimation, and hand pose recognition.”
From Artificial intelligence enhanced sensors - enabling technologies to next-generation healthcare and biomedical platform (2023) · cites this paper as Sundaram et al. 2019
In the citing paper
“The STAG comprises a sensing sleeve with 584 piezoresistive sensors, a knit glove, and readout electronics that utilize the ResNet-18 architecture to train the model and ultimately recognize 26 distinct objects.”
From Artificial intelligence enhanced sensors - enabling technologies to next-generation healthcare and biomedical platform (2023) · cites this paper as Sundaram et al. 2019
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
(2008) · Journal of Machine Learning Research · Cited by 33,051
(2017) · Cited by 11,625
Circos: An information aesthetic for comparative genomics
Krzywinski, M., Schein, J., Birol, İ., Connors, J., Gascoyne, R., Horsman, D., Jones, S. J., & Marra, M. A. (2009) · Genome Research · doi:10.1101/gr.092759.109 · Cited by 10,964
Pursuing prosthetic electronic skin
Chortos, A., Liu, J., & Bao, Z. (2016) · Nature Materials · doi:10.1038/nmat4671 · Cited by 2,396
Coding and use of tactile signals from the fingertips in object manipulation tasks
Johansson, R. S., & Flanagan, J. R. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2621 · Cited by 2,063
Hand movements: A window into haptic object recognition
Lederman, S. J., & Klatzky, R. L. (1987) · Cognitive Psychology · doi:10.1016/0010-0285(87)90008-9 · Cited by 2,016
80 Million Tiny Images: A Large Data Set for Nonparametric Object and Scene Recognition
Torralba, A., Fergus, R., & Freeman, W. T. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.128 · Cited by 1,921
Self-citationTHE PREHENSILE MOVEMENTS OF THE HUMAN HAND
Napier, J. R. (1956) · The Journal of Bone and Joint Surgery. British volume · doi:10.1302/0301-620x.38b4.902 · Cited by 1,571
Research works printed but not linked: 1
- Marzke, M. Precision grips, hand morphology, and tools. Am. J. Phys. Anthropol. 102, 91–110 (1997). · DOI · Paper page
Cited by
Technology Roadmap for Flexible Sensors
Luo, Y., Abidian, M. R., Ahn, J.-H., Akinwande, D., Andrews, A. M., Antonietti, M., Bao, Z., Berggren, M., Berkey, C. A., Bettinger, C. J., et al. (2023) · ACS Nano · doi:10.1021/acsnano.2c12606 · Cited by 1,383
Skin-integrated wireless haptic interfaces for virtual and augmented reality
Yu, X., Xie, Z., Yu, Y., Lee, J., Vazquez-Guardado, A., Luan, H., Ruban, J., Ning, X., Akhtar, A., Li, D., et al. (2019) · Nature · doi:10.1038/s41586-019-1687-0 · Cited by 1,025
Edge artificial intelligence for 6g: vision, enabling technologies, and applications
Letaief, K. B., Shi, Y., Lu, J., & Lu, J. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126076 · Cited by 829
“…[121] aims at delivering the skill set (e.g., the manipulation skills representation learned from the multisensory tactile and visual data [318], and the signatures of the human grasp learned using a tactile glove [319]) over the Tactile Internet in an ultra-reliable and low-latency manner.”
BackgroundBai, N., Wang, L., Wang, Q., Deng, J., Wang, Y., Lu, P., Huang, J., Li, G., Zhang, Y., Yang, J., et al. (2020) · Nature Communications · doi:10.1038/s41467-019-14054-9 · Cited by 810
Zhu, M., Sun, Z., Zhang, Z., Shi, Q., He, T., Liu, H., Chen, T., & Lee, C. (2020) · Science Advances · doi:10.1126/sciadv.aaz8693 · Cited by 784
Metadata
- Authors
- Sundaram, S., Kellnhofer, P., Li, Y., Zhu, J.-Y., Torralba, A., & Matusik, W.
- Affiliations
- Boston University (US)
- MIT Computer Science and Artificial Intelligence Laboratory (US)
- Corresponding author
- Sundaram, Subramanian
- Venue
- Nature
- Published
- 2019-05
- Volume
- 569
- Issue
- 7758
- Pages
- 698-702
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2947434510
- Semantic Scholar
- f1fa776dcd4720103837da7591cd021d7d81595e
- Cited by
- 1,162
- References
- 45
- Citations by year
- 2026: 108 · 2025: 177 · 2024: 190 · 2023: 192 · 2022: 203 · 2021: 150 · 2020: 115 · 2019: 27
- FWCI
- 68.53
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Physical Sciences › Engineering › Biomedical Engineering › Soft Robotics and Applications
- Keywords
- tactile sensing, tactile glove, mechanoreceptors, piezoresistive sensors, tactile dataset, object recognition, object weight estimation, hand kinematics, deep convolutional neural networks, robotic grasping, human-robot interaction, prosthetics
- MeSH terms
- Data Analysis, Clothing, Hand, Humans, Man-Machine Systems, Touch, Neural Networks, Computer, Hand Strength, Datasets as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Learning the signatures of the human grasp using a scalable tactile glove. https://app.cochat.ai/papers/10.1038/s41586-019-1234-z
- The paper
- Sundaram, S., Kellnhofer, P., Li, Y., Zhu, J.-Y., Torralba, A., & Matusik, W. (2019). Learning the signatures of the human grasp using a scalable tactile glove. Nature. https://doi.org/10.1038/s41586-019-1234-z
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.