Whole-home gesture recognition using wireless signals
The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
This paper presents WiSee, a novel gesture recognition system that leverages wireless signals (e.g., Wi-Fi) to enable whole-home sensing and recognition of human gestures. Since wireless signals do not require line-of-sight and can traverse through walls, WiSee can enable whole-home gesture recognition using few wireless sources. Further, it achieves this goal without requiring instrumentation of the human body with sensing devices. We implement a proof-of-concept prototype of WiSee using USRP-N210s and evaluate it in both an office environment and a two- bedroom apartment. Our results show that WiSee can identify and classify a set of nine gestures with an average accuracy of 94%.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Real-time human pose recognition in parts from single depth images
Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., & Blake, A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995316 · Cited by 3,491
Spotlight synthetic aperture radar : signal processing algorithms
Carrara, W. G., Goodman, R., & Majewski, R. M. (1995) · Artech House, Inc. eBooks · Cited by 2,003
Achieving single channel, full duplex wireless communication
Choi, J. I., Jain, M., Srinivasan, K., Levis, P., & Katti, S. (2010) · Proceedings of the sixteenth annual international conference on Mobile computing and networking · doi:10.1145/1859995.1859997 · Cited by 1,524
ArrayTrack: a fine-grained indoor location system
Xiong, J., & Jamieson, K. (2013) · Singapore Management University Institutional Knowledge (InK) (Singapore Management University) · Cited by 1,043
Indoor localization without the pain
Chintalapudi, K., Padmanabha Iyer, A., & Padmanabhan, V. N. (2010) · Proceedings of the sixteenth annual international conference on Mobile computing and networking · doi:10.1145/1859995.1860016 · Cited by 962
Radio Tomographic Imaging with Wireless Networks
Wilson, J., & Patwari, N. (2010) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2009.174 · Cited by 897
Challenges: device-free passive localization for wireless environments
Youssef, M., Mah, M., & Agrawala, A. (2007) · Proceedings of the 13th annual ACM international conference on Mobile computing and networking · doi:10.1145/1287853.1287880 · Cited by 780
Skinput: appropriating the body as an input surface
Harrison, C., Tan, D., & Morris, D. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753394 · Cited by 694
Zigzag decoding: combating hidden terminals in wireless networks
Gollakota, S., & Katabi, D. (2008) · ACM SIGCOMM Computer Communication Review · doi:10.1145/1402946.1402977 · Cited by 529
Self-citationYou are facing the Mona Lisa: spot localization using PHY layer information
Sen, S., Radunovic, B., Choudhury, R. R., & Minka, T. (2012) · Proceedings of the 10th international conference on Mobile systems, applications, and services · doi:10.1145/2307636.2307654 · Cited by 496
Cited by
Understanding and Modeling of WiFi Signal Based Human Activity Recognition
Wang, W., Liu, A. X., Shahzad, M., Ling, K., & Lu, S. (2015) · Proceedings of the 21st Annual International Conference on Mobile Computing and Networking · doi:10.1145/2789168.2790093 · Cited by 1,110
Soli: ubiquitous gesture sensing with millimeter wave radar
Lien, J., Gillian, N., Karagozler, M. E., Amihood, P., Schwesig, C., Olson, E., Raja, H., & Poupyrev, I. (2016) · ACM Transactions on Graphics · doi:10.1145/2897824.2925953 · Cited by 957
“Existing work in RF gesture sensing is limited to tracking rigid single targets such as single limb or body motion [Paradiso 1999; Paradiso et al. 1997; Pu et al. 2013; Kellogg et al. 2014], large scale hand motion [Wan et al.”
BackgroundWiFi Sensing with Channel State Information: A Survey
Ma, Y., Zhou, G., & Wang, S. (2020) · ACM Computing Surveys · doi:10.1145/3310194 · Cited by 869
WiFall: Device-Free Fall Detection by Wireless Networks
Wang, Y., Wu, K., & Ni, L. M. (2017) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2016.2557792 · Cited by 836
E-eyes: device-free location-oriented activity identification using fine-grained WiFi signatures
Wang, Y., Liu, J., Chen, Y., Gruteser, M., Yang, J., & Liu, H. (2014) · Proceedings of the 20th annual international conference on Mobile computing and networking · doi:10.1145/2639108.2639143 · Cited by 817
Through-Wall Human Pose Estimation Using Radio Signals
Zhao, M., Li, T., Alsheikh, M. A., Tian, Y., Zhao, H., Torralba, A., & Katabi, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00768 · Cited by 658
RT-Fall: A Real-Time and Contactless Fall Detection System with Commodity WiFi Devices
Wang, H., Zhang, D., Wang, Y., Ma, J., Wang, Y., & Li, S. (2017) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2016.2557795 · Cited by 640
A Survey on Behavior Recognition Using WiFi Channel State Information
Yousefi, S., Narui, H., Dayal, S., Ermon, S., & Valaee, S. (2017) · IEEE Communications Magazine · doi:10.1109/mcom.2017.1700082 · Cited by 610
Precise Power Delay Profiling with Commodity WiFi
Xie, Y., Li, Z., & Li, M. (2015) · Proceedings of the 21st Annual International Conference on Mobile Computing and Networking · doi:10.1145/2789168.2790124 · Cited by 600
A review of hand gesture and sign language recognition techniques
Cheok, M. J., Omar, Z., & Jaward, M. H. (2019) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-017-0705-5 · Cited by 600
Ten questions concerning occupant behavior in buildings: The big picture
Hong, T., Yan, D., D'Oca, S., & Chen, C.-F. (2017) · Building and Environment · doi:10.1016/j.buildenv.2016.12.006 · Cited by 581
Gait recognition using wifi signals
Wang, W., Liu, A. X., & Shahzad, M. (2016) · Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2971648.2971670 · Cited by 567
Zero-Effort Cross-Domain Gesture Recognition with Wi-Fi
Zheng, Y., Zhang, Y., Qian, K., Zhang, G., Liu, Y., Wu, C., & Yang, Z. (2019) · Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3307334.3326081 · Cited by 557
“Due to complexity of human activity, existing approaches extract signal features, either statistical [14, 15, 23, 28, 30, 45, 49] or physical [6, 31, 34, 38, 39, 44, 51, 52] ones, and map them to discrete activities.”
BackgroundWiGest: A ubiquitous WiFi-based gesture recognition system
Abdelnasser, H., Youssef, M., & Harras, K. A. (2015) · 2015 IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom.2015.7218525 · Cited by 552
Keystroke Recognition Using WiFi Signals
Ali, K., Liu, A. X., Wang, W., & Shahzad, M. (2015) · Proceedings of the 21st Annual International Conference on Mobile Computing and Networking · doi:10.1145/2789168.2790109 · Cited by 540
Device-Free Human Activity Recognition Using Commercial WiFi Devices
Wang, W., Liu, A. X., Shahzad, M., Ling, K., & Lu, S. (2017) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2017.2679658 · Cited by 511
3D tracking via body radio reflections
Adib, F., Kabelac, Z., Katabi, D., & Miller, R. C. (2014) · DSpace@MIT (Massachusetts Institute of Technology) · doi:10.5555/2616448.2616478 · Cited by 509
IEA EBC Annex 66: Definition and simulation of occupant behavior in buildings
Yan, D., Hong, T., Dong, B., Mahdavi, A., D’Oca, S., Gaetani, I., & Feng, X. (2017) · Energy and Buildings · doi:10.1016/j.enbuild.2017.09.084 · Cited by 508
Emotion recognition using wireless signals
Zhao, M., Adib, F., & Katabi, D. (2016) · Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking · doi:10.1145/2973750.2973762 · Cited by 461
Capturing the human figure through a wall
Adib, F., Hsu, C.-Y., Mao, H., Katabi, D., & Durand, F. (2015) · ACM Transactions on Graphics · doi:10.1145/2816795.2818072 · Cited by 443
“Some of these systems have demonstrated the potential of using RF signals to recognize a handful of forward-backward gestures by matching them against prior training examples [Pu et al. 2013].”
BackgroundMethodWidar2.0: Passive Human Tracking with a Single Wi-Fi Link
Qian, K., Wu, C., Zhang, Y., Zhang, G., Yang, Z., & Liu, Y. (2018) · Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3210240.3210314 · Cited by 438
Wang, S., Song, J., Lien, J., Poupyrev, I., & Hilliges, O. (2016) · Proceedings of the 29th Annual Symposium on User Interface Software and Technology · doi:10.1145/2984511.2984565 · Cited by 433
Gesture recognition for human-robot collaboration: A review
Liu, H., & Wang, L. (2018) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2017.02.004 · Cited by 422
Wireless Sensing for Human Activity: A Survey
Liu, J., Liu, H., Chen, Y., Wang, Y., & Wang, C. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2934489 · Cited by 414
FingerIO: Using Active Sonar for Fine-Grained Finger Tracking
Nandakumar, R., Iyer, V., Tan, D., & Gollakota, S. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858580 · Cited by 408
Self-citationIndoTrack: Device-Free Indoor Human Tracking with Commodity Wi-Fi
Li, X., Zhang, D., Lv, Q., Xiong, J., Li, S., Zhang, Y., & Mei, H. (2017) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3130940 · Cited by 402
Electronic frog eye: Counting crowd using WiFi
Xi, W., Zhao, J., Li, X.-Y., Zhao, K., Tang, S., Liu, X., & Jiang, Z. (2014) · IEEE INFOCOM 2014 - IEEE Conference on Computer Communications · doi:10.1109/infocom.2014.6847958 · Cited by 398
SignFi: Sign Language Recognition Using WiFi
Ma, Y., Zhou, G., Wang, S., Zhao, H., & Jung, W. (2018) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3191755 · Cited by 380
Zhao, M., Tian, Y., Zhao, H., Alsheikh, M. A., Li, T., Hristov, R., Kabelac, Z., Katabi, D., & Torralba, A. (2018) · Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication · doi:10.1145/3230543.3230579 · Cited by 379
Device-free gesture tracking using acoustic signals
Wang, W., Liu, A. X., & Sun, K. (2016) · Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking · doi:10.1145/2973750.2973764 · Cited by 378
Intelligent metasurface imager and recognizer
Li, L., Shuang, Y., Ma, Q., Li, H., Zhao, H., Wei, M., Liu, C., Hao, C., Qiu, C.-W., & Cui, T. J. (2019) · Light: Science & Applications · doi:10.1038/s41377-019-0209-z · Cited by 376
WiWho: WiFi-Based Person Identification in Smart Spaces
Zeng, Y., Pathak, P. H., & Mohapatra, P. (2016) · 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN) · doi:10.1109/ipsn.2016.7460727 · Cited by 374
RF-IDraw: virtual touch screen in the air using RF signals
Wang, J., Vasisht, D., & Katabi, D. (2014) · Proceedings of the 2014 ACM conference on SIGCOMM · doi:10.1145/2619239.2626330 · Cited by 359
Non-Invasive Detection of Moving and Stationary Human With WiFi
Wu, C., Yang, Z., Zhou, Z., Liu, X., Liu, Y., & Cao, J. (2015) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2015.2430294 · Cited by 354
Intelligent metasurfaces: control, communication and computing
Li, L., Zhao, H., Liu, C., Li, L., & Cui, T. J. (2022) · eLight · doi:10.1186/s43593-022-00013-3 · Cited by 347
Dynamic-MUSIC: accurate device-free indoor localization
Li, X., Li, S., Zhang, D., Xiong, J., Wang, Y., & Mei, H. (2016) · Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2971648.2971665 · Cited by 329
Widar: Decimeter-Level Passive Tracking via Velocity Monitoring with Commodity Wi-Fi
Qian, K., Wu, C., Yang, Z., Liu, Y., & Jamieson, K. (2017) · Proceedings of the 18th ACM International Symposium on Mobile Ad Hoc Networking and Computing · doi:10.1145/3084041.3084067 · Cited by 328
Wi-Sleep: Contactless Sleep Monitoring via WiFi Signals
Liu, X., Cao, J., Tang, S., & Wen, J. (2014) · 2014 IEEE Real-Time Systems Symposium · doi:10.1109/rtss.2014.30 · Cited by 326
mD-Track: Leveraging Multi-Dimensionality for Passive Indoor Wi-Fi Tracking
Xie, Y., Xiong, J., Li, M., & Jamieson, K. (2019) · The 25th Annual International Conference on Mobile Computing and Networking · doi:10.1145/3300061.3300133 · Cited by 320
Widar3.0: Zero-Effort Cross-Domain Gesture Recognition with Wi-Fi
Zhang, Y., Zheng, Y., Qian, K., Zhang, G., Liu, Y., Wu, C., & Yang, Z. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3105387 · Cited by 312
Phaser: enabling phased array signal processing on commodity WiFi access points
Gjengset, J., Xiong, J., McPhillips, G., & Jamieson, K. (2014) · Proceedings of the 20th annual international conference on Mobile computing and networking · doi:10.1145/2639108.2639139 · Cited by 301
WiDraw: Enabling Hands-free Drawing in the Air on Commodity WiFi Devices
Sun, L., Sen, S., Koutsonikolas, D., & Kim, K.-H. (2015) · Proceedings of the 21st Annual International Conference on Mobile Computing and Networking · doi:10.1145/2789168.2790129 · Cited by 299
WiFinger: talk to your smart devices with finger-grained gesture
Li, H., Yang, W., Wang, J., Xu, Y., & Huang, L. (2016) · Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2971648.2971738 · Cited by 276
Towards 3D human pose construction using wifi
Jiang, W., Xue, H., Miao, C., Wang, S., Lin, S., Tian, C., Murali, S., Hu, H., Sun, Z., & Su, L. (2020) · Proceedings of the 26th Annual International Conference on Mobile Computing and Networking · doi:10.1145/3372224.3380900 · Cited by 276
Wei, W., Wong, Y., Du, Y., Hu, Y., Kankanhalli, M., & Geng, W. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2017.12.005 · Cited by 274
UbiBreathe: A Ubiquitous non-Invasive WiFi-based Breathing Estimator
Abdelnasser, H., Harras, K. A., & Youssef, M. (2015) · Proceedings of the 16th ACM International Symposium on Mobile Ad Hoc Networking and Computing · doi:10.1145/2746285.2755969 · Cited by 267
Occupancy Estimation Using Only WiFi Power Measurements
Depatla, S., Muralidharan, A., & Mostofi, Y. (2015) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2015.2430272 · Cited by 267
mTrack: High-Precision Passive Tracking Using Millimeter Wave Radios
Wei, T., & Zhang, X. (2015) · Proceedings of the 21st Annual International Conference on Mobile Computing and Networking · doi:10.1145/2789168.2790113 · Cited by 265
Deep learning for edge computing applications: A State-of-the-Art survey
Wang, F., Zhang, M., Wang, X., Ma, X., & Liu, J. (2020) · IEEE Access · doi:10.1109/access.2020.2982411 · Cited by 259
Position and Orientation Agnostic Gesture Recognition Using WiFi
Virmani, A., & Shahzad, M. (2017) · Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3081333.3081340 · Cited by 258
WiFinger: leveraging commodity WiFi for fine-grained finger gesture recognition
Tan, S., & Yang, J. (2016) · Proceedings of the 17th ACM International Symposium on Mobile Ad Hoc Networking and Computing · doi:10.1145/2942358.2942393 · Cited by 255
Information Metamaterials: bridging the physical world and digital world
Ma, Q., & Cui, T. J. (2020) · PhotoniX · doi:10.1186/s43074-020-00006-w · Cited by 231
“The development of the Internet of Things has promoted a series of intelligent devices, especially for the in-door space, where the RF signal is a great medium for locating [114], posture sensing and recognition [115 – 117].”
BackgroundA Survey on Human Behavior Recognition Using Channel State Information
Wang, Z., Jiang, K., Hou, Y., Dou, W., Zhang, C., Huang, Z., & Guo, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2949123 · Cited by 149
“For instance, WiSee [182] implements behavior recognition by exploring the Doppler shift.”
MethodMulti-user activity recognition: Challenges and opportunities
Li, Q., Gravina, R., Li, Y., Alsamhi, S. H., Sun, F., & Fortino, G. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.06.004 · Cited by 140
Towards occupant activity driven smart buildings via WiFi-enabled IoT devices and deep learning
Zou, H., Zhou, Y., Yang, J., & Spanos, C. J. (2018) · Energy and Buildings · doi:10.1016/j.enbuild.2018.08.010 · Cited by 100
Real-time Arm Skeleton Tracking and Gesture Inference Tolerant to Missing Wearable Sensors
Liu, Y., Li, Z., Liu, Z., & Wu, K. (2019) · Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3307334.3326109 · Cited by 71
“In the wearable computing market, many novel HCI designs have emerged recently (e.g., smart home devices andmotion games [51]), and user arms’ gestures are the key inputs of these systems.”
BackgroundInfluentialSenseGAN: Enabling Deep Learning for Internet of Things with a Semi-Supervised Framework
Yao, S., Zhao, Y., Shao, H., Zhang, C., Zhang, A., Hu, S., Liu, D., Liu, S., Su, L., & Abdelzaher, T. (2018) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3264954 · Cited by 54
Liu, Y., Zhang, S., & Gowda, M. (2021) · Proceedings of the International Conference on Internet-of-Things Design and Implementation · doi:10.1145/3450268.3453537 · Cited by 39
“WiSee [51] can detect hand gestures bymeasuring doppler shifts fromWiFi reflections.”
Background
Metadata
- Authors
- Pu, Q., Gupta, S., Gollakota, S., & Patel, S.
- Venue
- Proceedings of the 19th annual international conference on Mobile computing & networking - MobiCom '13
- Publisher
- ACM Press
- Published
- 2013
- Pages
- 27
- OpenAlex
- W2141336889
- Cited by
- 1,109
- References
- 19
- Type
- conference abstract
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.