The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
SignFi: Sign Language Recognition Using WiFi
Abstract
We propose SignFi to recognize sign language gestures using WiFi. SignFi uses Channel State Information (CSI) measured by WiFi packets as the input and a Convolutional Neural Network (CNN) as the classification algorithm. Existing WiFi-based sign gesture recognition technologies are tested on no more than 25 gestures that only involve hand and/or finger gestures. SignFi is able to recognize 276 sign gestures, which involve the head, arm, hand, and finger gestures, with high accuracy. SignFi collects CSI measurements to capture wireless signal characteristics of sign gestures. Raw CSI measurements are pre-processed to remove noises and recover CSI changes over sub-carriers and sampling time. Pre-processed CSI measurements are fed to a 9-layer CNN for sign gesture classification. We collect CSI traces and evaluate SignFi in the lab and home environments. There are 8,280 gesture instances, 5,520 from the lab and 2,760 from the home, for 276 sign gestures in total. For 5-fold cross validation using CSI traces of one user, the average recognition accuracy of SignFi is 98.01%, 98.91%, and 94.81% for the lab, home, and lab+home environment, respectively. We also run tests using CSI traces from 5 different users in the lab environment. The average recognition accuracy of SignFi is 86.66% for 7,500 instances of 150 sign gestures performed by 5 different users.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Fundamentals of Wireless Communication
Tse, D., & Viswanath, P. (2005) · doi:10.1017/cbo9780511807213 · Cited by 13,162
(2016) · Cited by 11,679
Tool release: gathering 802.11n traces with channel state information
Halperin, D., Hu, W., Sheth, A., & Wetherall, D. (2011) · ACM SIGCOMM Computer Communication Review · doi:10.1145/1925861.1925870 · Cited by 1,761
Whole-home gesture recognition using wireless signals
Pu, Q., Gupta, S., Gollakota, S., & Patel, S. (2013) · Proceedings of the 19th annual international conference on Mobile computing & networking - MobiCom '13 · doi:10.1145/2500423.2500436 · Cited by 1,109
Soli: ubiquitous gesture sensing with millimeter wave radar
Lien, J., Gillian, N., Karagozler, M. E., Amihood, P., Schwesig, C., Olson, E., Raja, H., & Poupyrev, I. (2016) · ACM Transactions on Graphics · doi:10.1145/2897824.2925953 · Cited by 957
(1996) · Choice Reviews Online · doi:10.5860/choice.34-2461 · Cited by 762
WiGest: A ubiquitous WiFi-based gesture recognition system
Abdelnasser, H., Youssef, M., & Harras, K. A. (2015) · 2015 IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom.2015.7218525 · Cited by 552
Sign Language Recognition Using Convolutional Neural Networks
Pigou, L., Dieleman, S., Kindermans, P.-J., & Schrauwen, B. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-16178-5_40 · Cited by 499
2015 IEEE Conference on Computer Communications (INFOCOM)
(2015) · doi:10.1109/infocom30874.2015 · Cited by 410
FingerIO: Using Active Sonar for Fine-Grained Finger Tracking
Nandakumar, R., Iyer, V., Tan, D., & Gollakota, S. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858580 · Cited by 408
Device-free gesture tracking using acoustic signals
Wang, W., Liu, A. X., & Sun, K. (2016) · Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking · doi:10.1145/2973750.2973764 · Cited by 378
American sign language recognition with the kinect
Zafrulla, Z., Brashear, H., Starner, T., Hamilton, H., & Presti, P. (2011) · Proceedings of the 13th international conference on multimodal interfaces · doi:10.1145/2070481.2070532 · Cited by 376
RF-IDraw: virtual touch screen in the air using RF signals
Wang, J., Vasisht, D., & Katabi, D. (2014) · Proceedings of the 2014 ACM conference on SIGCOMM · doi:10.1145/2619239.2626330 · Cited by 359
SoundWave: using the doppler effect to sense gestures
Gupta, S., Morris, D., Patel, S., & Tan, D. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208331 · Cited by 353
Furman, N., Goldberg, D., & Lusin, N. (2008) · adfl · doi:10.1632/adfl.39.2.66 · Cited by 346
Sign Language Recognition using 3D convolutional neural networks
Huang, J., Zhou, W., Li, H., & Li, W. (2015) · 2015 IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2015.7177428 · Cited by 317
WiDraw: Enabling Hands-free Drawing in the Air on Commodity WiFi Devices
Sun, L., Sen, S., Koutsonikolas, D., & Kim, K.-H. (2015) · Proceedings of the 21st Annual International Conference on Mobile Computing and Networking · doi:10.1145/2789168.2790129 · Cited by 299
ASL-LEX: A lexical database of American Sign Language
Caselli, N. K., Sehyr, Z. S., Cohen-Goldberg, A. M., & Emmorey, K. (2017) · Behavior Research Methods · doi:10.3758/s13428-016-0742-0 · Cited by 282
WiFinger: talk to your smart devices with finger-grained gesture
Li, H., Yang, W., Wang, J., Xu, Y., & Huang, L. (2016) · Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2971648.2971738 · Cited by 276
Position and Orientation Agnostic Gesture Recognition Using WiFi
Virmani, A., & Shahzad, M. (2017) · Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3081333.3081340 · Cited by 258
WiFinger: leveraging commodity WiFi for fine-grained finger gesture recognition
Tan, S., & Yang, J. (2016) · Proceedings of the 17th ACM International Symposium on Mobile Ad Hoc Networking and Computing · doi:10.1145/2942358.2942393 · Cited by 255
Ishfaq Ahmad, D., Al‐Ayyoub, A., Avdelas, G. G., Avresky, D. R., Buyya, R., Cortés, T., de Sturler, E., Martino, B. D., Dickens, P. M., Drira, K., et al. (1999) · Cited by 249
Strata: Fine-Grained Acoustic-based Device-Free Tracking
Yun, S., Chen, Y.-C., Zheng, H., Qiu, L., & Mao, W. (2017) · Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3081333.3081356 · Cited by 246
Bringing gesture recognition to all devices
Kellogg, B., Talla, V., & Gollakota, S. (2014) · doi:10.5555/2616448.2616477 · Cited by 240
Multi-sensor system for driver's hand-gesture recognition
Molchanov, P., Gupta, S., Kim, K., & Pulli, K. (2015) · 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2015.7163132 · Cited by 238
Finger-writing with Smartwatch: A Case for Finger and Hand Gesture Recognition using Smartwatch
Xu, C., Pathak, P. H., & Mohapatra, P. (2015) · Proceedings of the 16th International Workshop on Mobile Computing Systems and Applications · doi:10.1145/2699343.2699350 · Cited by 235
American Sign Language Recognition Using Leap Motion Sensor
Chuan, C.-H., Regina, E., & Guardino, C. (2014) · 2014 13th International Conference on Machine Learning and Applications · doi:10.1109/icmla.2014.110 · Cited by 223
Chan, L., Liang, R.-H., Tsai, M.-C., Cheng, K.-Y., Su, C.-H., Chen, M. Y., Cheng, W.-H., & Chen, B. (2013) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2501988.2502016 · Cited by 192
Serendipity: Finger Gesture Recognition using an Off-the-Shelf Smartwatch
Wen, H., Ramos Rojas, J., & Dey, A. K. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858466 · Cited by 182
uTrack: 3D input using two magnetic sensors
Chen, K.-Y., Lyons, K., White, S., & Patel, S. (2013) · Proceedings of the 26th annual ACM symposium on User interface software and technology · doi:10.1145/2501988.2502035 · Cited by 170
Chen, K.-Y., Patel, S., & Keller, S. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858125 · Cited by 162
Ruan, W., Sheng, Q. Z., Yang, L., et al. (2016) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2971648.2971736 · Cited by 153
Leveraging directional antenna capabilities for fine-grained gesture recognition
Melgarejo, P., Zhang, X., Ramanathan, P., & Chu, D. C. Y. (2014) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2632048.2632095 · Cited by 136
Park, T., Lee, J., Hwang, I., Yoo, C., Nachman, L., & Song, J. (2011) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/2070942.2070969 · Cited by 122
DeepASL: Enabling Ubiquitous and Non-Intrusive Word and Sentence-Level Sign Language Translation
Fang, B., Co, J., & Zhang, M. (2017) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3131672.3131693 · Cited by 120
Bringing cross-layer MIMO to today's wireless LANs
Kumar, S., Cifuentes, D., Gollakota, S., & Katabi, D. (2013) · ACM SIGCOMM Conference (SIGCOMM) · doi:10.1145/2486001.2486034 · Cited by 88
Real-Time American Sign Language Recognition System Using Surface EMG Signal
Savur, C., & Sahin, F. (2015) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2015.212 · Cited by 87
Latent Support Vector Machine Modeling for Sign Language Recognition with Kinect
Sun, C., Zhang, T., & Xu, C. (2015) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2629481 · Cited by 62
Zhao, C., Chen, K.-Y., Aumi, M. T. I., Patel, S., & Reynolds, M. S. (2014) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2642918.2647380 · Cited by 62
Mudra: User-friendly Fine-grained Gesture Recognition using WiFi Signals
Zhang, O., & Srinivasan, K. (2016) · ACM International Conference on emerging Networking EXperiments and Technologies (CoNEXT) · doi:10.1145/2999572.2999582 · Cited by 60
A Robust Sign Language Recognition System with Multiple Wi-Fi Devices
Shang, J., & Wu, J. (2017) · Mobility in the Evolving Internet Architecture · doi:10.1145/3097620.3097624 · Cited by 54
Sign Language Recognition Using Leap Motion
Quesada, L., López, G., & Guerrero, L. A. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-26401-1_26 · Cited by 17
A recognition method for continuous gestures with an accelerometer
Watanabe, H., Mochizuki, M., Murao, K., & Nishio, N. (2016) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2968219.2968291 · Cited by 6
Cited by
WiFi Sensing with Channel State Information: A Survey
Ma, Y., Zhou, G., & Wang, S. (2020) · ACM Computing Surveys · doi:10.1145/3310194 · Cited by 869
Self-citationZero-Effort Cross-Domain Gesture Recognition with Wi-Fi
Zheng, Y., Zhang, Y., Qian, K., Zhang, G., Liu, Y., Wu, C., & Yang, Z. (2019) · Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3307334.3326081 · Cited by 557
FarSense: Pushing the Range Limit of WiFi-based Respiration Sensing with CSI Ratio of Two Antennas
Zeng, Y., Wu, D., Xiong, J., Yi, E., Gao, R., & Zhang, D. (2019) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3351279 · Cited by 469
Wireless Sensing for Human Activity: A Survey
Liu, J., Liu, H., Chen, Y., Wang, Y., & Wang, C. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2934489 · Cited by 414
Widar3.0: Zero-Effort Cross-Domain Gesture Recognition with Wi-Fi
Zhang, Y., Zheng, Y., Qian, K., Zhang, G., Liu, Y., Wu, C., & Yang, Z. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3105387 · Cited by 312
Metadata
- Authors
- Ma, Y., Zhou, G., Wang, S., Zhao, H., & Jung, W.
- Venue
- Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Published
- 2018-03-26
- Volume
- 2
- Issue
- 1
- Pages
- 1-21
- ISSN
- 2474-9567 (ISSN-L)
- OpenAlex
- W2794843057
- Cited by
- 380
- References
- 44
- FWCI
- 30.71
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.