The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Latern: Dynamic Continuous Hand Gesture Recognition Using FMCW Radar Sensor
Abstract
Recently, hand gesture recognition systems have become increasingly interesting to researchers in the field of human-computer interfaces. Real-world systems for human dynamic hand gesture recognition is challenging as: 1) the system must be robust to various conditions; 2) there is a rich diversity in how people perform hand gestures, making hand gesture recognition difficult; and 3) the system must detect and recognize hand gestures continuously using unsegmented input streams in order to avoid noticeable lag between performing a gesture and its classification. In this paper, to address these challenges, we present Latern, a novel system for dynamic continuous hand gesture recognition based on a frequency-modulated continuous wave radar sensor. The radar system does not depend on lighting, noise, or atmospheric conditions. We employ a recurrent 3-D convolutional neural network to perform the classification of dynamic hand gestures. To enhance the processing performance, a connectionist temporal classification algorithm is used to train the network to predict class labels from inprogress gestures in unsegmented input streams. The experimental results show that Latern is able to achieve high recognition rates of 96%, which is higher than state-of-the-art hand gesture recognition systems. In addition, the conclusion in this paper can be used for a real-time hand gesture recognition system design.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
Learning Spatiotemporal Features with 3D Convolutional Networks
Tran, D., Bourdev, L., Fergus, R., Torresani, L., & Paluri, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.510 · Cited by 9,593
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., et al. (2016) · arXiv · doi:10.48550/arxiv.1603.04467 · Cited by 9,408
(2010) · Cited by 8,261
3D Convolutional Neural Networks for Human Action Recognition
Ji, S., Xu, W., Yang, M., & Yu, K. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.59 · Cited by 6,235
Graves, A., Fernández, S., Gomez, F., & Schmidhuber, J. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143891 · Cited by 5,370
On the difficulty of training recurrent neural networks
Pascanu, R., Mikolov, T., & Bengio, Y. (2012) · arXiv · doi:10.48550/arxiv.1211.5063 · Cited by 4,310
A Critical Review of Recurrent Neural Networks for Sequence Learning
Lipton, Z. C., Berkowitz, J. A., & Elkan, C. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.00019 · Cited by 1,996
Soli: ubiquitous gesture sensing with millimeter wave radar
Lien, J., Gillian, N., Karagozler, M. E., Amihood, P., Schwesig, C., Olson, E., Raja, H., & Poupyrev, I. (2016) · ACM Transactions on Graphics · doi:10.1145/2897824.2925953 · Cited by 957 · cited 1×
“Several techniques such as the use of vision-based sensors [1]–[3], motion-based sensors [4], [5], capacitive sensors [6], and radar-based sensors [7]–[14] have been developed to capture hand gestures.”
BackgroundLearning to Estimate 3D Hand Pose from Single RGB Images
Zimmermann, C., & Brox, T. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.525 · Cited by 761
Wang, S., Song, J., Lien, J., Poupyrev, I., & Hilliges, O. (2016) · Proceedings of the 29th Annual Symposium on User Interface Software and Technology · doi:10.1145/2984511.2984565 · Cited by 433
Hand Gesture Recognition Using Micro-Doppler Signatures With Convolutional Neural Network
Kim, Y., & Toomajian, B. (2016) · IEEE Access · doi:10.1109/access.2016.2617282 · Cited by 378
Multimodal Gesture Recognition Using 3-D Convolution and Convolutional LSTM
Zhu, G., Zhang, L., Shen, P., & Song, J. (2017) · IEEE Access · doi:10.1109/access.2017.2684186 · Cited by 270
Finger-writing with Smartwatch: A Case for Finger and Hand Gesture Recognition using Smartwatch
Xu, C., Pathak, P. H., & Mohapatra, P. (2015) · Proceedings of the 16th International Workshop on Mobile Computing Systems and Applications · doi:10.1145/2699343.2699350 · Cited by 235
Short-range FMCW monopulse radar for hand-gesture sensing
Molchanov, P., Gupta, S., Kim, K., & Pulli, K. (2015) · 2015 IEEE Radar Conference (RadarCon) · doi:10.1109/radar.2015.7131232 · Cited by 220
Wireless Hand Gesture Recognition Based on Continuous-Wave Doppler Radar Sensors
Fan, T., Ma, C., Gu, Z., Lv, Q., Chen, J., Ye, D., Huangfu, J., Sun, Y., Li, C., & Ran, L. (2016) · IEEE Transactions on Microwave Theory and Techniques · doi:10.1109/tmtt.2016.2610427 · Cited by 158
Humantenna: using the body as an antenna for real-time whole-body interaction
Cohn, G. A., Morris, D., Patel, S., & Tan, D. S. (2012) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208330 · Cited by 152
Understanding Everyday Hands in Action from RGB-D Images
Rogez, G., Supančič, J. S., & Ramanan, D. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.443 · Cited by 147
A real-time high resolution passive WiFi Doppler-radar and its applications
Tan, B., Woodbridge, K., & Chetty, K. (2014) · International Radar Conference (RADAR) · doi:10.1109/radar.2014.7060359 · Cited by 86
Whole-home gesture recognition using wireless signals (demo)
Pu, Q., Jiang, S., & Gollakota, S. (2013) · ACM SIGCOMM Conference (SIGCOMM) · doi:10.1145/2486001.2491687 · Cited by 85
Operational assessment and adaptive selection of micro‐Doppler features
Gürbüz, S. Z., Erol, B., Çağlıyan, B., & Tekeli, B. (2015) · IET Radar Sonar & Navigation · doi:10.1049/iet-rsn.2015.0144 · Cited by 77
Zhao, C., Chen, K.-Y., Aumi, M. T. I., Patel, S., & Reynolds, M. S. (2014) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2642918.2647380 · Cited by 62
Inviz: Low-power personalized gesture recognition using wearable textile capacitive sensor arrays
Singh, G., Nelson, A., Robucci, R., et al. (2015) · IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom.2015.7146529 · Cited by 53
Kim, Y., & Toomajian, B. (2017) · European Conference on Antennas and Propagation · doi:10.23919/eucap.2017.7928465 · Cited by 53
An FMCW radar sensor for human gesture recognition in the presence of multiple targets
Peng, Z., Li, C., Muñoz‐Ferreras, J., & Gómez‐García, R. (2017) · IEEE MTT-S International Microwave Biomedical Conference (IMBioC) · doi:10.1109/imbioc.2017.7965798 · Cited by 53
Hidden Markov model-based gesture recognition with FMCW radar
Malysa, G., Wang, D., Netsch, L., & Ali, M. (2016) · IEEE Global Conference on Signal and Information Processing · doi:10.1109/globalsip.2016.7905995 · Cited by 51
A Collaborative Filtering Approach to Real-Time Hand Pose Estimation
Choi, C., Sinha, A., Choi, J. H., Jang, S., & Ramani, K. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.269 · Cited by 49
Action recognition using micro-Doppler signatures and a recurrent neural network
Craley, J., Murray, T. S., Mendat, D. R., & Andreou, A. G. (2017) · Conference on Information Sciences and Systems · doi:10.1109/ciss.2017.7926181 · Cited by 18
Feature-based gesture classification by means of high resolution radar measurements
Fink, J., Guissouma, H., & Jondral, F. K. (2017) · International Radar Symposium · doi:10.23919/irs.2017.8008239 · Cited by 7
Cited by
Federated Learning With Cooperating Devices: A Consensus Approach for Massive IoT Networks
Savazzi, S., Nicoli, M., & Rampa, V. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2964162 · Cited by 431
Human-Machine Interaction Sensing Technology Based on Hand Gesture Recognition: A Review
Guo, L., Lu, Z., & Yao, L. (2021) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2021.3086003 · Cited by 340
A Survey of Deep Learning-Based Human Activity Recognition in Radar
Li, X., He, Y., & Jing, X. (2019) · Remote Sensing · doi:10.3390/rs11091068 · Cited by 290
IMU Sensor-Based Hand Gesture Recognition for Human-Machine Interfaces
Kim, M., Cho, J., Lee, S., & Jung, Y. (2019) · Sensors · doi:10.3390/s19183827 · Cited by 169
BodyCompass: Monitoring Sleep Posture with Wireless Signals
Yue, S., Yang, Y., Wang, H., Rahul, H., & Katabi, D. (2020) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3397311 · Cited by 112
Metadata
- Authors
- Zhang, Z., Tian, Z., & Zhou, M.
- Venue
- IEEE Sensors Journal
- Published
- 2018-04-15
- Volume
- 18
- Issue
- 8
- Pages
- 3278-3289
- ISSN
- 1530-437X (ISSN-L)
- 1558-1748
- 2379-9153
- OpenAlex
- W2789648429
- Cited by
- 333
- References
- 30
- FWCI
- 33.13
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.