VoiceHD: Hyperdimensional Computing for Efficient Speech Recognition
The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
In this paper, we propose VoiceHD, a novel speech recognition technique based on brain-inspired hyperdimensional(HD) computing. VoiceHD maps preprocessed voice signals in the frequency domain to random hypervectors and combines them to compute a hypervector (as learned patterns) representing each class. During inference, VoiceHD similarly computes a query hypervector; the classification task is done by checking the similarity of the query hypervector with all learned hypervectors and finding a class with the highest similarity. We further extend VoiceHD to VoiceHD+NN that uses a neural network with a single small hidden layer to improve the similarity measures. This neural network is a small block directly operating on the similarity outputs of VoiceHD to slightly improve the classification accuracy. We evaluate efficiency of VoiceHD and VoiceHD+NN compared to a deep neural network with three large hidden layers over Isolet spoken letter dataset. Our benchmarking results on CPU show that VoiceHD and VoiceHD+NN provide 11.9× and 8.5× higher energy efficiency, 5.3× and 4.0× faster testing time, and 4.6× and 2.9× faster training time compared to the deep neural network, while providing marginally better classification accuracy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893 · cited 2×
“Deep neural networks have also been recently used for highly accurate speech recognition [1], [2].”
BackgroundMethodListen, attend and spell: A neural network for large vocabulary conversational speech recognition
Chan, W., Jaitly, N., Le, Q., & Vinyals, O. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7472621 · Cited by 2,226
(2011) · doi:10.5591/978-1-57735-516-8/ijcai11-210 · Cited by 1,229
CNP: An FPGA-based processor for Convolutional Networks
Farabet, C., Poulet, C., Han, J. Y., & LeCun, Y. (2009) · 2009 International Conference on Field Programmable Logic and Applications · doi:10.1109/fpl.2009.5272559 · Cited by 367 · cited 1×
“Prior work tried to accelerate NNs on GPUs [19], [20], FPGAs [21], [22], and ASICs [23], [24].”
BackgroundA Robust and Energy-Efficient Classifier Using Brain-Inspired Hyperdimensional Computing
Rahimi, A., Kanerva, P., & Rabaey, J. M. (2016) · Proceedings of the 2016 International Symposium on Low Power Electronics and Design · doi:10.1145/2934583.2934624 · Cited by 276 · cited 1×
“Examples include analogy-based reasoning [6], language recognition [7], [8], [9], text classification [10], spoken word classification [11], biosignal electromyography processing [12], brain-computer interfaces [13], and prediction from multimodal sensor fusion [14], [15].”
BackgroundSelf-citation
Cited by
Classification using hyperdimensional computing: a review
Ge, L., & Parhi, K. K. (2020) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2020.2988388 · Cited by 227
Kleyko, D., Rachkovskij, D., Osipov, E., & Rahimi, A. (2023) · ACM Computing Surveys · doi:10.1145/3558000 · Cited by 141
Self-citationSearcHD: A Memory-Centric Hyperdimensional Computing With Stochastic Training
Imani, M., Yin, X., Messerly, J., Gupta, S., Niemier, M., Hu, X. S., & Rosing, T. (2020) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2019.2952544 · Cited by 87
“Regardless of the data type, the encoded data is represented with a D -dimensional vector ( H ∈ N D ) [15], [42].”
BackgroundMethodInfluentialSelf-citationHyper-Dimensional Computing Challenges and Opportunities for AI Applications
Hassan, E., Halawani, Y., Mohammad, B., & Saleh, H. (2022) · IEEE Access · doi:10.1109/access.2021.3059762 · Cited by 61
Metadata
- Authors
- Imani, M., Kong, D., Rahimi, A., & Rosing, T.
- Venue
- 2017 IEEE International Conference on Rebooting Computing (ICRC)
- Publisher
- IEEE
- Published
- 2017-11
- Pages
- 1-8
- OpenAlex
- W2771100829
- Cited by
- 216
- References
- 5
- FWCI
- 4.95
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.