“Combating replay attacks against voice assistants,”
The DOI matches its Crossref record; 64 of the 66 references it cites were found in a registry or an index.
Abstract
Recently, there has been a surge in the popularity of voice-first devices, such as Amazon Echo, Google Home, etc. While these devices make our life more convenient, they are vulnerable to new attacks, such as voice replay. We develop an end-to-end system to detect replay attacks without requiring a user to wear any wearable device. Our system, called REVOLT, has several distinct features: (i) it intelligently exploits the inherent differences between the spectral characteristics of the original and replayed voice signals, (ii) it exploits both acoustic and WiFi channels in tandem, (iii) it utilizes unique breathing rate extracted from WiFi signal while speaking to test the liveness of human voice. After extensive evaluation, our voice component yields Equal Error Rate (EER) of 0.88% and 10.32% in our dataset and ASV2017 dataset, respectively; and WiFi based breathing detection achieves Breaths Per Minute (BPM) error of 1.8 up to 3m distance. We further combine WiFi and voice based detection and show the overall system offers low false positive and false negative when evaluated against a range of attacks.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Also, replay attacks can be used against voice assistants, which is dangerous especially since most voice assistants are used in the home (Pradhan et al., 2019).”
From Audio deepfakes: A survey (2023) · cites this paper as Pradhan et al., 2019
Citations
Cites
Tool release: gathering 802.11n traces with channel state information
Halperin, D., Hu, W., Sheth, A., & Wetherall, D. (2011) · ACM SIGCOMM Computer Communication Review · doi:10.1145/1925861.1925870 · Cited by 1,761
Principles of Voice Production
Titze, I. R., & Martin, D. W. (1998) · The Journal of the Acoustical Society of America · doi:10.1121/1.424266 · Cited by 1,643
Luger, E., & Sellen, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858288 · Cited by 1,176
SpotFi: Decimeter Level Localization Using WiFi
Kotaru, M., Joshi, K., Bharadia, D., & Katti, S. (2015) · Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication · doi:10.1145/2785956.2787487 · Cited by 1,169
Keras: The Python Deep Learning library
Chollet, F. (2018) · Astrophysics Source Code Library · Cited by 1,002
Smart Homes that Monitor Breathing and Heart Rate
Adib, F., Mao, H., Kabelac, Z., Katabi, D., & Miller, R. C. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702200 · Cited by 916
E-eyes: device-free location-oriented activity identification using fine-grained WiFi signatures
Wang, Y., Liu, J., Chen, Y., Gruteser, M., Yang, J., & Liu, H. (2014) · Proceedings of the 20th annual international conference on Mobile computing and networking · doi:10.1145/2639108.2639143 · Cited by 817
Muda, L., Begam, M. H., & Elamvazuthi, I. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1003.4083 · Cited by 803
Voice Interfaces in Everyday Life
Porcheron, M., Fischer, J. E., Reeves, S., & Sharples, S. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174214 · Cited by 717 · cited 1×
“There are a few avenues to further improve the robustness and generalization of our system.”
BackgroundSpoofing and countermeasures for speaker verification: A survey
Wu, Z., Evans, N., Kinnunen, T., Yamagishi, J., Alegre, F., & Li, H. (2015) · Speech Communication · doi:10.1016/j.specom.2014.10.005 · Cited by 601
An architecture for privacy-sensitive ubiquitous computing
Hong, J. I., & Landay, J. A. (2004) · Proceedings of the 2nd international conference on Mobile systems, applications, and services · doi:10.1145/990064.990087 · Cited by 598
DolphinAttack: Inaudible Voice Commands
Zhang, G., Yan, C., Ji, X., Zhang, T., Zhang, T., & Xu, W. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3134052 · Cited by 568
The ASVspoof 2017 challenge: assessing the limits of replay spoofing attack detection
Kinnunen, T., Sahidullah, M., Delgado, H., Todisco, M., Evans, N., Yamagishi, J., & Lee, K. A. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-1111 · Cited by 535
A novel scheme for speaker recognition using a phonetically-aware deep neural network
Lei, Y., Scheffer, N., Ferrer, L., & McLaren, M. (2014) · 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2014.6853887 · Cited by 496
Tracking Vital Signs During Sleep Leveraging Off-the-shelf WiFi
Liu, J., Wang, Y., Chen, Y., Yang, J., Chen, X., & Cheng, J. (2015) · Proceedings of the 16th ACM International Symposium on Mobile Ad Hoc Networking and Computing · doi:10.1145/2746285.2746303 · Cited by 481
"Alexa is my new BFF": Social Roles, User Satisfaction, and Personification of the Amazon Echo
Purington, A., Taft, J. G., Sannon, S., Bazarova, N. N., & Taylor, S. H. (2017) · Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/3027063.3053246 · Cited by 476
Home automation in the wild: challenges and opportunities
Brush, A. J. B., Lee, B., Mahajan, R., Agarwal, S., Saroiu, S., & Dixon, C. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979249 · Cited by 468
SpotFi: Decimeter Level Localization Using WiFi
Kotaru, M., Joshi, K., Bharadia, D., & Katti, S. (2015) · ACM SIGCOMM Computer Communication Review · doi:10.1145/2829988.2787487 · Cited by 443
Combining evidence from residual phase and MFCC features for speaker recognition
Murty, K. S. R., & Yegnanarayana, B. (2006) · IEEE Signal Processing Letters · doi:10.1109/lsp.2005.860538 · Cited by 416
Understanding the Long-Term Use of Smart Speaker Assistants
Bentley, F., Luvogt, C., Silverman, M., Wirasinghe, R., White, B., & Lottridge, D. (2018) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3264901 · Cited by 316
Deep voice 3: scaling text-to-speech with convolutional sequence learning
Ping, W., Peng, K., Gibiansky, A., Arik, S. O., Kannan, A., Narang, S., Raiman, J., & Miller, J. (2017) · arXiv · doi:10.48550/arxiv.1710.07654 · Cited by 313
Continuous Authentication for Voice Assistants
Feng, H., Fawaz, K., & Shin, K. G. (2017) · Proceedings of the 23rd Annual International Conference on Mobile Computing and Networking · doi:10.1145/3117811.3117823 · Cited by 293 · cited 3×
“Voice is prone to impersonation, synthesis, or replay attacks [62].”
BackgroundInfluentialWiFi-ID: Human Identification Using WiFi Signal
Zhang, J., Wei, B., Hu, W., & Kanhere, S. S. (2016) · 2016 International Conference on Distributed Computing in Sensor Systems (DCOSS) · doi:10.1109/dcoss.2016.30 · Cited by 276
UbiBreathe: A Ubiquitous non-Invasive WiFi-based Breathing Estimator
Abdelnasser, H., Harras, K. A., & Youssef, M. (2015) · Proceedings of the 16th ACM International Symposium on Mobile Ad Hoc Networking and Computing · doi:10.1145/2746285.2755969 · Cited by 267
ASVspoof: The Automatic Speaker Verification Spoofing and Countermeasures Challenge
Wu, Z., Yamagishi, J., Kinnunen, T., Hanilci, C., Sahidullah, M., Sizov, A., Evans, N., Todisco, M., & Delgado, H. (2017) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2017.2671435 · Cited by 229
BackDoor: Making Microphones Hear Inaudible Sounds
Roy, N., Hassanieh, H., & Roy Choudhury, R. (2017) · Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3081333.3081366 · Cited by 220
Howard, D., & Angus, J. (2000) · Routledge eBooks · doi:10.4324/9780080498522 · Cited by 210
Zhang, L., Tan, S., & Yang, J. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3133962 · Cited by 191
WiWho: wifi-based person identification in smart spaces
Zeng, Y., Pathak, P. H., & Mohapatra, P. (2016) · Information Processing in Sensor Networks · doi:10.5555/2959355.2959359 · Cited by 176
VoiceLive: A Phoneme Localization based Liveness Detection for Voice Authentication on Smartphones
Zhang, L., Tan, S., Yang, J., & Chen, Y. (2016) · Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2976749.2978296 · Cited by 174
ResNet and Model Fusion for Automatic Spoofing Detection
Chen, Z., Xie, Z., Zhang, W., & Xu, X. (2017) · Interspeech (USB) · doi:10.21437/interspeech.2017-1085 · Cited by 171
BreathPrint: Breathing Acoustics-based User Authentication
Chauhan, J., Hu, Y., Seneviratne, S., Misra, A., Seneviratne, A., & Lee, Y. (2017) · Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3081333.3081355 · Cited by 170
Audio Replay Attack Detection Using High-Frequency Features
Witkowski, M., Kacprzak, S., Żelasko, P., Kowalczyk, K., & Gałka, J. (2017) · Interspeech (USB) · doi:10.21437/interspeech.2017-776 · Cited by 168
Detection of synthetic speech for the problem of imposture
De Leon, P. L., Hernaez, I., Saratxaga, I., Pucher, M., & Yamagishi, J. (2011) · 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2011.5947440 · Cited by 159
SottoVoce: An Ultrasound Imaging-Based Silent Speech Interaction Using Deep Neural Networks
Kimura, N., Kono, M., & Rekimoto, J. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300376 · Cited by 157
A unified deep neural network for speaker and language recognition
Richardson, F. S., Reynolds, D. A., & Dehak, N. (2015) · Interspeech (USB) · doi:10.21437/interspeech.2015-299 · Cited by 150
Measuring, refining and calibrating speaker and language information extracted from speech
Brümmer, N. (2010) · SUNScholar (Stellenbosch University) · Cited by 145
Lip-Interact: Improving Mobile Device Interaction with Silent Speech Commands
Sun, K., Yu, C., Shi, W., Liu, L., & Shi, Y. (2018) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3242587.3242599 · Cited by 138
You Can Hear But You Cannot Steal: Defending Against Voice Impersonation Attacks on Smartphones
Chen, S., Ren, K., Piao, S., Wang, C., Wang, Q., Weng, J., Su, L., & Mohaisen, A. (2017) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2017.133 · Cited by 130
DolphinAtack: Inaudible Voice CommandsPreprint
Zhang, G., Yan, C., Ji, X., Zhang, T., Zhang, T., & Xu, W. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.09537 · Cited by 127
WiBreathe: Estimating respiration rate using wireless signals in natural settings in the home
Ravichandran, R., Saba, E., Chen, K.-Y., Goel, M., Gupta, S., & Patel, S. N. (2015) · 2015 IEEE International Conference on Pervasive Computing and Communications (PerCom) · doi:10.1109/percom.2015.7146519 · Cited by 110
Kinnunen, T., Sahidullah, M., Falcone, M., Costantini, L., Hautamaki, R. G., Thomsen, D., Sarkar, A., Tan, Z.-H., Delgado, H., Todisco, M., et al. (2017) · 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2017.7953187 · Cited by 105
Markowitz, J. A. (2000) · Communications of the ACM · doi:10.1145/348941.348995 · Cited by 95
WFID: Passive Device-free Human Identification Using WiFi Signal
Hong, F., Wang, X., Yang, Y., Zong, Y., Zhang, Y., & Guo, Z. (2016) · EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services (MobiQuitous) · doi:10.1145/2994374.2994377 · Cited by 94
Hey Google, Can I Ask You Something in Private?
Cho, E. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300488 · Cited by 88 · cited 1×
“We can apply the approach in [50] to detect breathing from each of the users and determine if any user has breathing that is synchronized with the voice.”
MethodAn Extension Of The Music Algorithm To Broadband Scenarios Using Polynomial Eigenvalue Decomposition
Alrmah, M. A., Lambotharan, S., & Weiss, S. (2011) · Strathprints: The University of Strathclyde institutional repository (University of Strathclyde) · doi:10.5281/zenodo.42731 · Cited by 86
WiVo: Enhancing the Security of Voice Control System via Wireless Signal in IoT Environment
Meng, Y., Wang, Z., Zhang, W., Wu, P., Zhu, H., Liang, X., & Liu, Y. (2018) · ACM International Symposium on Mobile Ad Hoc Networking and Computing (MobiHoc) · doi:10.1145/3209582.3209591 · Cited by 76
Ahmad, K. S., Thosar, A., Nirmal, J. H., & Pande, V. (2015) · International Conference on Advances in Pattern Recognition · doi:10.1109/icapr.2015.7050669 · Cited by 73
SilentTalk: Lip reading through ultrasonic sensing on mobile phones
Tan, J., Nguyen, C.-T., & Wang, X. (2017) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom.2017.8057099 · Cited by 66
TinySense: Multi-user respiration detection using Wi-Fi CSI signals
Wang, P., Guo, B., Tong, X. S., Wang, Z., & Yu, Z. (2017) · IEEE International Conference on e-Health Networking, Applications and Services (Healthcom) · doi:10.1109/healthcom.2017.8210837 · Cited by 63
Tan, J., Wang, X., Nguyen, C.-T., & Shi, Y. (2018) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3191768 · Cited by 60
On Real-Time Mean-and-Variance Normalization of Speech Recognition Features
Pujol, P., Macho, D., & Nadeu, C. (2006) · doi:10.1109/icassp.2006.1660135 · Cited by 45
Ensemble Learning for Countermeasure of Audio Replay Spoofing Attack in ASVspoof2017
Ji, Z., Li, Z., Li, P., An, M., Gao, S., Wu, D., & Faru, Z. (2017) · Interspeech (USB) · doi:10.21437/interspeech.2017-1246 · Cited by 45
Fine-grained vital signs estimation using commercial wi-fi devices
Shang, J., & Wu, J. (2016) · doi:10.1145/2987354.2987360 · Cited by 34
StreetWise: Smart Speakers vs Human Help in Public Slum Settings
Pearson, J. S., Robinson, S., Reitmaier, T., Jones, M., Ahire, S., Joshi, A. N., Sahoo, D. R., Maravi, N., & Bhikne, B. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300326 · Cited by 28
EchoSafe: Sonar-based Verifiable Interaction with Intelligent Digital Agents
Alanwar, A., Balaji, B., Tian, Y., Yang, S., & Srivastava, M. B. (2017) · doi:10.1145/3137003.3137014 · Cited by 18
Controlling Fine-Grain Sharing in Natural Language with a Virtual Assistant
Campagna, G., Xu, S., Ramesh, R., Fischer, M., & Lam, M. S. (2018) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3264905 · Cited by 16
Voice Presentation Attack Detection through Text-Converted Voice Command Analysis
Kwak, I., Huh, J. H., Han, S. T., Kim, I., & Yoon, J. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300828 · Cited by 16
Voice authentication using short phrases: Examining accuracy, security and privacy issues
Johnson, R. C., Boult, T. E., & Scheirer, W. J. (2013) · IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS) · doi:10.1109/btas.2013.6712713 · Cited by 12
Speaker identification from the sound of the human breathPreprint
Zhao, W., Gao, Y., & Singh, R. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.00171 · Cited by 10
Research works printed but not linked: 6
- 2018 . Deep Voice 3 : 2000 -Speaker Neural Text-to-Speech. http://research.baidu.com/deep-voice-3-2000-speaker-neural-text-speech/. 2018. Deep Voice 3: 2000-Speaker Neural Text-to-Speech. http://research.baidu.com/deep-voice-3-2000-speaker-neural-text-speech/.
- 2018. Research Finds Automated Voice Imitation Can Fool Humans and Machines. https://cacm.acm.org/careers/192367-research-finds-automated-voice-imitation-can-fool-humans-and-machines/fulltext. 2018. Research Finds Automated Voice Imitation Can Fool Humans and Machines. https://cacm.acm.org/careers/192367-research-finds-automated-voice-imitation-can-fool-humans-and-machines/fulltext.
- Nicholas Carlini , Pratyush Mishra , Tavish Vaidya , Yuankai Zhang , Micah Sherr , Clay Shields , David Wagner , and Wenchao Zhou . 2016 . Hidden voice commands . In 25th USENIX Security Symposium (USENIX Security 16) , Austin, TX. Nicholas Carlini, Pratyush Mishra, Tavish Vaidya, Yuankai Zhang, Micah Sherr, Clay Shields, David Wagner, and Wenchao Zhou. 2016. Hidden voice commands. In 25th USENIX Security Symposium (USENIX Security 16), Austin, TX.
- Li Lu , Jiadi Yux , Yingying Cheny , Hongbo Liuz , Yanmin Zhu , Yunfei Liu , and Minglu Li. {n. d.}. LipPass: Lip Reading-based User Authentication on Smartphones Leveraging Acoustic Signals. In INFOCOM 2018 . Li Lu, Jiadi Yux, Yingying Cheny, Hongbo Liuz, Yanmin Zhu, Yunfei Liu, and Minglu Li. {n. d.}. LipPass: Lip Reading-based User Authentication on Smartphones Leveraging Acoustic Signals. In INFOCOM 2018.
- 10.1145/3191768 · DOI
- Y. Zeng , P. H. Pathak , and P. Mohapatra . 2016 . WiWho: WiFi-Based Person Identification in Smart Spaces. In 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN). 1--12 . Y. Zeng, P. H. Pathak, and P. Mohapatra. 2016. WiWho: WiFi-Based Person Identification in Smart Spaces. In 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN). 1--12.
Cited by
Deepfake Audio Detection via MFCC features using Machine Learning
Hamza, A., Javed, A. R. R., Iqbal, F., Kryvinska, N., Almadhor, A. S., Jalil, Z., & Borghol, R. (2022) · IEEE Access · doi:10.1109/access.2022.3231480 · Cited by 264
Liang, Y., Samtani, S., Guo, B., & Yu, Z. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3004077 · Cited by 214
A Review of Modern Audio Deepfake Detection Methods: Challenges and Future Directions
Almutairi, Z., & Elgibreen, H. (2022) · Algorithms · doi:10.3390/a15050155 · Cited by 187
Khanjani, Z., Watson, G., & Janeja, V. P. (2023) · Frontiers in Big Data · doi:10.3389/fdata.2022.1001063 · Cited by 121
Personal Voice Assistant Security and Privacy—A Survey
Cheng, P., & Roedig, U. (2022) · Proceedings of the IEEE · doi:10.1109/jproc.2022.3153167 · Cited by 122
Metadata
- Authors
- Pradhan, S., Sun, W., Baig, G., & Qiu, L.
- Affiliations
- The University of Texas at Austin (US)
- Venue
- Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Published
- 2019-09-09
- Volume
- 3
- Issue
- 3
- Pages
- 1-26
- ISSN
- 2474-9567 (ISSN-L)
- OpenAlex
- W2973158730
- Cited by
- 67
- References
- 66
- Citations by year
- 2026: 5 · 2025: 5 · 2024: 12 · 2023: 14 · 2022: 13 · 2021: 11 · 2020: 6 · 2019: 1
- FWCI
- 4.90
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Signal Processing › Biometric Identification and Security
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Information Systems › User Authentication and Security Systems
- Keywords
- replay attack detection, voice assistants, voice biometrics, liveness detection, breathing rate detection, WiFi sensing, spectral properties, rebellion, Amazon Echo, Google Home
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.