GESTO: A Glove for Enhanced Sensing and Touching Based on Inertial and Magnetic Sensors for Hand Tracking and Cutaneous Feedback
Open accessThe DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
The human hand represents a complex fascinating system with highly sensitive sensory capabilities and dexterous grasping and manipulation functionalities. As a consequence, estimating the hand pose and at the same time having the capability to provide haptic feedback in a wearable way may benefit areas such as rehabilitation, human-robot interaction, gaming, and many more. Existing solutions allow us to accurately measure the hand configuration and provide effective force feedback to the user. However, they have limited wearability/portability. In this paper, we present the wearable sensing/actuation system glove for enhanced sensing and touching (GESTO). It is based on inertial and magnetic sensors for hand tracking, coupled with cutaneous devices for the force feedback rendering. Unlike vision-based tracking systems, the sensing glove does not suffer from occlusion problems and lighting conditions. We properly designed the cutaneous devices in order to reduce possible interferences with the magnetic sensors and performed an experimental validation on ten healthy subjects. In order to measure the estimation accuracy of GESTO, we used a high-precision optical tracker. A comparison between using the glove with and without the haptic devices shows that the presence of them does not induce a statistically significant increase in the estimation error. Experimental results revealed the effectiveness of the proposed approach. The accuracy of our system, 3.32° mean estimation error in the worst case, is comparable with the human ability of discriminating finger joint angle.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Citations
Cites
Estimation of IMU and MARG orientation using a gradient descent algorithm
Madgwick, S. O. H., Harrison, A. J. L., & Vaidyanathan, R. (2011) · 2011 IEEE International Conference on Rehabilitation Robotics · doi:10.1109/icorr.2011.5975346 · Cited by 2,068
Nonlinear Complementary Filters on the Special Orthogonal Group
Mahony, R., Hamel, T., & Pflimlin, J.-M. (2008) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2008.923738 · Cited by 1,751
Human–Robot Interaction: A Survey
Goodrich, M. A., & Schultz, A. C. (2008) · Foundations and Trends® in Human–Computer Interaction · doi:10.1561/1100000005 · Cited by 1,541
Human-Robot Interaction: A Survey
Goodrich, M. A., & Schultz, A. C. (2007) · now publishers, Inc. eBooks · doi:10.1561/9781601980939 · Cited by 1,095
Efficient model-based 3D tracking of hand articulations using Kinect
Oikonomidis, I., Kyriazis, N., & Argyros, A. (2011) · Procedings of the British Machine Vision Conference 2011 · doi:10.5244/c.25.101 · Cited by 874
Human motion tracking for rehabilitation-A survey
Zhou, H., & Hu, H. (2008) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2007.09.001 · Cited by 813
(2009) · Cited by 701
A Survey of Glove-Based Systems and Their Applications
Dipietro, L., Sabatini, A. M., & Dario, P. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2008.923862 · Cited by 691
An extended Kalman filter for quaternion-based orientation estimation using MARG sensors
Marins, J. L., Yun, X., Bachmann, E. R., McGhee, R. B., & Zyda, M. J. (2002) · Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180) · doi:10.1109/iros.2001.976367 · Cited by 499
Realtime and Robust Hand Tracking from Depth
Qian, C., Sun, X., Wei, Y., Tang, X., & Sun, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.145 · Cited by 470
Estimating Three-Dimensional Orientation of Human Body Parts by Inertial/Magnetic Sensing
Sabatini, A. M. (2011) · Sensors · doi:10.3390/s110201489 · Cited by 349
Model-based analysis of hand posture
Lee, J., & Kunii, T. L. (1995) · IEEE Computer Graphics and Applications · doi:10.1109/38.403831 · Cited by 334
Towards Wearability in Fingertip Haptics: A 3-DoF Wearable Device for Cutaneous Force Feedback
Prattichizzo, D., Chinello, F., Pacchierotti, C., & Malvezzi, M. (2013) · IEEE Transactions on Haptics · doi:10.1109/toh.2013.53 · Cited by 292
Self-citationTIKL: Development of a Wearable Vibrotactile Feedback Suit for Improved Human Motor Learning
Lieberman, J., & Breazeal, C. (2007) · IEEE Transactions on Robotics · doi:10.1109/tro.2007.907481 · Cited by 272 · cited 1×
“Vibrotactile stimuli are usually generated by dc motors with eccentric masses, which can be easily integrated in devices like suits [22], bracelets [23], shoes [24], gloves, etc.”
BackgroundScalar calibration of vector magnetometers
Merayo, J. M. G., Brauer, P., Primdahl, F., Petersen, J. R., & Nielsen, O. V. (2000) · Measurement Science and Technology · doi:10.1088/0957-0233/11/2/304 · Cited by 241
Cutaneous Feedback of Fingertip Deformation and Vibration for Palpation in Robotic Surgery
Pacchierotti, C., Prattichizzo, D., & Kuchenbecker, K. J. (2016) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2015.2455932 · Cited by 235
Self-citationSrinivasan, M. A., & Dandekar, K. (1996) · Journal of Biomechanical Engineering · doi:10.1115/1.2795945 · Cited by 202
Assessment of hand kinematics using inertial and magnetic sensors
Kortier, H. G., Sluiter, V. I., Roetenberg, D., & Veltink, P. H. (2014) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/1743-0003-11-70 · Cited by 173
Gentner, R., & Claßen, J. (2008) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2008.11.005 · Cited by 169
RML Glove—An Exoskeleton Glove Mechanism With Haptics Feedback
MA, Z., & Ben-Tzvi, P. (2015) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2014.2305842 · Cited by 163
A low cost instrumented glove for extended monitoring and functional hand assessment
Simone, L. K., Sundarrajan, N., Luo, X., Jia, Y., & Kamper, D. G. (2007) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2006.09.021 · Cited by 154
A structural model of the forced compression of the fingertip pulp
Serina, E. R., Mockensturm, E. M., Mote, C. D., & Rempel, D. (1998) · Journal of Biomechanics · doi:10.1016/s0021-9290(98)00067-0 · Cited by 150
Rao, S. K., Llombart, N., Moradi, E., Koski, K., Björninen, T., Sydanheimo, L. T., Rabaey, J. M., Carmena, J. M., Rahmat‐Samii, Y., & Ukkonen, L. (2014) · IEEE Antennas and Propagation Magazine · doi:10.1109/map.2014.6821799 · Cited by 145
Sensorized Glove for Measuring Hand Finger Flexion for Rehabilitation Purposes
Borghetti, M., Sardini, E., & Serpelloni, M. (2013) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2013.2272848 · Cited by 123
A structural fingertip model for simulating of the biomechanics of tactile sensation
Wu, J. Z., Dong, R. G., Rakheja, S., Schopper, A. W., & Smutz, W. P. (2003) · Medical Engineering & Physics · doi:10.1016/j.medengphy.2003.09.004 · Cited by 114
Assessing assumptions in kinematic hand models: A review
Bullock, I. M., Borràs, J., & Dollar, A. M. (2012) · 2022 9th IEEE RAS/EMBS International Conference for Biomedical Robotics and Biomechatronics (BioRob) · doi:10.1109/biorob.2012.6290879 · Cited by 90
Minamizawa, K., Kajimoto, H., Kawakami, N., & Tachi, S. (2007) · IEEE World Haptics Conference (WHC) · doi:10.1109/whc.2007.15 · Cited by 90
A New Wearable Input Device: SCURRY
Kim, Y. S., Soh, B. S., & Lee, S. G. (2005) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2005.858736 · Cited by 75
A remote guidance system for blind and visually impaired people via vibrotactile haptic feedback
Scheggi, S., Talarico, A., & Prattichizzo, D. (2014) · 22nd Mediterranean Conference on Control and Automation · doi:10.1109/med.2014.6961320 · Cited by 73
Self-citationVibrotactile force feedback system for minimally invasive surgical procedures
Schoonmaker, R. E., & Cao, C. G. L. (2006) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2006.385233 · Cited by 70
An efficient real-time human posture tracking algorithm using low-cost inertial and magnetic sensors
Gallagher, A., Matsuoka, Y., & Ang, W.-T. (2005) · 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566) · doi:10.1109/iros.2004.1389860 · Cited by 69
Enhanced interactive gaming by blending full-body tracking and gesture animation
Bleiweiss, A., Eshar, D., Kutliroff, G., Lerner, A., Oshrat, Y., & Yanai, Y. (2010) · ACM SIGGRAPH ASIA 2010 Sketches · doi:10.1145/1899950.1899984 · Cited by 64
Scheggi, S., Meli, L., Pacchierotti, C., & Prattichizzo, D. (2015) · ACM SIGGRAPH 2015 Posters · doi:10.1145/2787626.2792651 · Cited by 58
Self-citationLow-cost, fast and accurate reconstruction of robotic and human postures via IMU measurements
Santaera, G., Luberto, E., Serio, A., Gabiccini, M., & Bicchi, A. (2015) · 2015 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2015.7139569 · Cited by 56
Hernandez-Rebollar, J. L., Kyriakopoulos, N., & Lindeman, R. W. (2002) · ACM SIGGRAPH Conference Abstracts and Applications · doi:10.1145/1242073.1242272 · Cited by 54
Cooperative human-robot haptic navigation
Scheggi, S., Aggravi, M., Morbidi, F., & Prattichizzo, D. (2014) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2014.6907245 · Cited by 53
Self-citationHuman-Robot Formation Control via Visual and Vibrotactile Haptic Feedback
Scheggi, S., Morbidi, F., & Prattichizzo, D. (2014) · IEEE Transactions on Haptics · doi:10.1109/toh.2014.2332173 · Cited by 47
Self-citationDiscrimination and identification of finger joint-angle position using active motion
Tan, H. Z., Srinivasan, M. A., Reed, C. M., & Durlach, N. I. (2007) · ACM Transactions on Applied Perception · doi:10.1145/1265957.1265959 · Cited by 45
An exoskeleton master hand for controlling DLR/HIT hand
Fang, H., Xie, Z., & Liu, H. (2009) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2009.5354624 · Cited by 42
Development of a soft-fingertip and its modeling based on force distribution
Park, K. C., Kim, B., & Hirai, S. (2004) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2003.1242078 · Cited by 40
Whole hand modeling using 8 wearable sensors
Hrabia, C.-E., Wolf, K., & Wilhelm, M. (2013) · Augmented Human International Conference · doi:10.1145/2459236.2459241 · Cited by 39
Wearable haptics and hand tracking via an RGB-D camera for immersive tactile experiences
Meli, L., Scheggi, S., Pacchierotti, C., & Prattichizzo, D. (2014) · ACM SIGGRAPH Posters · doi:10.1145/2614217.2614262 · Cited by 38
Self-citationSoft finger tactile rendering for wearable haptics
Pérez, Á. G., Lobo, D., Chinello, F., Cirio, G., Malvezzi, M., Martín, J. S., Prattichizzo, D., & Otaduy, M. Á. (2015) · IEEE World Haptics Conference (WHC) · doi:10.1109/whc.2015.7177733 · Cited by 32
Self-citationUsing Postural Synergies to Animate a Low-Dimensional Hand Avatar in Haptic Simulation
Mulatto, S., Formaglio, A., Malvezzi, M., & Prattichizzo, D. (2012) · IEEE Transactions on Haptics · doi:10.1109/toh.2012.13 · Cited by 30
Self-citationUsing inertial and magnetic sensors for hand tracking and rendering in wearable haptics
Baldi, T. L., Mohammadi, M., Scheggi, S., & Prattichizzo, D. (2015) · IEEE World Haptics Conference (WHC) · doi:10.1109/whc.2015.7177742 · Cited by 22
Self-citationExploiting hand kinematic synergies and wearable under-sensing for hand functional grasp recognition
Bianchi, M., Carbonaro, N., Battaglia, E., Lorussi, F., Bicchi, A., Rossi, D. D., & Tognetti, A. (2014) · Wireless Mobile Communication and Healthcare · doi:10.4108/icst.mobihealth.2014.257228 · Cited by 19
Exploiting hand kinematic synergies and wearable under-sensing for hand functional grasp recognition
Bianchi, M., Carbonaro, N., Battaglia, E., et al. (2014) · CINECA IRIS Institutial research information system (University of Pisa) · doi:10.1109/mobihealth.2014.7015937 · Cited by 14
Evaluation of a predictive approach in steering the human locomotion via haptic feedback
Aggravi, M., Scheggi, S., & Prattichizzo, D. (2015) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353433 · Cited by 14
Self-citation
Research works printed but not linked: 1
- cobos, 2007, Constraints for realistic hand manipulation, Proc Presence, 369
Cited by
Flexible Electronics and Devices as Human–Machine Interfaces for Medical Robotics
Heng, W., Solomon, S., & Gao, W. (2022) · Advanced Materials · doi:10.1002/adma.202107902 · Cited by 609
Challenges in Haptic Communications Over the Tactile Internet
Van Den Berg, D., Glans, R., De Koning, D., Kuipers, F. A., Lugtenburg, J., Polachan, K., Venkata, P. T., Singh, C., Turkovic, B., & Van Wijk, B. (2017) · IEEE Access · doi:10.1109/access.2017.2764181 · Cited by 119
Demolder, C., Molina, A., Hammond, F. L., & Yeo, W. (2021) · Biosensors and Bioelectronics · doi:10.1016/j.bios.2021.113443 · Cited by 125
Sun, Z., Zhu, M., & Lee, C. (2021) · Nanoenergy Advances · doi:10.3390/nanoenergyadv1010005 · Cited by 105
Visual-inertial hand motion tracking with robustness against occlusion, interference, and contact
Lee, Y., Do, W., Yoon, H., Heo, J., Lee, W., & Lee, D. (2021) · Science Robotics · doi:10.1126/scirobotics.abe1315 · Cited by 97
Metadata
- Authors
- Baldi, T. L., Scheggi, S., Meli, L., Mohammadi, M., & Prattichizzo, D.
- Affiliations
- University of Siena (IT)
- University of Twente (NL)
- Venue
- IEEE Transactions on Human-Machine Systems
- Published
- 2017-12
- Volume
- 47
- Issue
- 6
- Pages
- 1066-1076
- ISSN
- 2168-2291 (ISSN-L)
- 2168-2305
- OpenAlex
- W2738073041
- Cited by
- 96
- References
- 48
- Citations by year
- 2026: 6 · 2025: 10 · 2024: 15 · 2023: 11 · 2022: 11 · 2021: 17 · 2020: 11 · 2019: 9 · 2018: 5 · 2017: 1
- FWCI
- 8.79
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Locations
- IEEE Transactions on Human-Machine Systems (publishedVersion)
- Use Siena air (University of Siena) (submittedVersion, cc-by)
- Funders
- European Union Seventh Framework Programme (FP7/2007-2013)
- WEARHAP—WEARable HxAPtics for humans and robots (601165)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Hand Gesture Recognition Systems
- Physical Sciences › Engineering › Mechanical Engineering › Teleoperation and Haptic Systems
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Keywords
- hand tracking, cutaneous feedback, haptic feedback, hand pose estimation, wearable haptic device, magnetic interference, finger joint angles, rehabilitation, human-robot interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.