The DOI matches its Crossref record; 218 of the 218 references it cites were found in a registry or an index.
Machine Learning for Microcontroller-Class Hardware: A Review
Open accessAbstract
The advancements in machine learning opened a new opportunity to bring intelligence to the low-end Internet-of-Things nodes such as microcontrollers. Conventional machine learning deployment has high memory and compute footprint hindering their direct deployment on ultra resource-constrained microcontrollers. This paper highlights the unique requirements of enabling onboard machine learning for microcontroller class devices. Researchers use a specialized model development workflow for resource-limited applications to ensure the compute and latency budget is within the device limits while still maintaining the desired performance. We characterize a closed-loop widely applicable workflow of machine learning model development for microcontroller class devices and show that several classes of applications adopt a specific instance of it. We present both qualitative and numerical insights into different stages of model development by showcasing several use cases. Finally, we identify the open research challenges and unsolved questions demanding careful considerations moving forward.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
SciPy 1.0: fundamental algorithms for scientific computing in Python
Virtanen, P., Gommers, R., Oliphant, T. E., Haberland, M., Reddy, T., Cournapeau, D., Burovski, E., Peterson, P., Weckesser, W., Bright, J., et al. (2020) · Nature Methods · doi:10.1038/s41592-019-0686-2 · Cited by 38,430
(2008) · Journal of Machine Learning Research · Cited by 33,051
MobileNetV2: Inverted Residuals and Linear Bottlenecks
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., & Chen, L.-C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00474 · Cited by 28,755
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
Xception: Deep Learning with Depthwise Separable Convolutions
Chollet, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.195 · Cited by 20,380
On Information and Sufficiency
Kullback, S., & Leibler, R. A. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729694 · Cited by 20,193
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
Learning Internal Representations by Error Propagation
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1985) · doi:10.21236/ada164453 · Cited by 16,172
Nonlinear Dimensionality Reduction by Locally Linear Embedding
Roweis, S. T., & Saul, L. K. (2000) · Science · doi:10.1126/science.290.5500.2323 · Cited by 14,965
Learning the parts of objects by non-negative matrix factorization
Lee, D. D., & Seung, H. S. (1999) · Nature · doi:10.1038/44565 · Cited by 13,868
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
TensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
SciPy 1.0: fundamental algorithms for scientific computing in Python
Virtanen, P., Gommers, R., Oliphant, T. E., Haberland, M., Reddy, T., Cournapeau, D., Burovski, E., Peterson, P., Weckesser, W., Bright, J., et al. (2019) · Apollo - University of Cambridge Repository · doi:10.17863/cam.64134 · Cited by 10,460
YOLOv4: Optimal Speed and Accuracy of Object Detection
Bochkovskiy, A., Wang, C.-Y., & Liao, H.-Y. M. (2020) · arXiv · doi:10.48550/arxiv.2004.10934 · Cited by 10,307
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Zhang, X., Zhou, X., Lin, M., & Sun, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00716 · Cited by 9,982
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Zhang, X., Zhou, X., Lin, M., & Sun, J. (2017) · arXiv · doi:10.48550/arxiv.1707.01083 · Cited by 9,982
EfficientDet: Scalable and Efficient Object Detection
Tan, M., Pang, R., & Le, Q. V. (2019) · arXiv · Cited by 9,841
UMAP: Uniform Manifold Approximation and Projection
McInnes, L., Healy, J., Saul, N., & Großberger, L. (2018) · Journal of Open Source Software · doi:10.21105/joss.00861 · Cited by 9,826
Howard, A., Sandler, M., Chen, B., Wang, W., Chen, L.-C., Tan, M., Chu, G., Vasudevan, V., Zhu, Y., Pang, R., et al. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00140 · Cited by 9,708
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Reinforcement Learning: An Introduction
Johnson, J. D., Li, J., & Chen, Z. (2000) · Neurocomputing · doi:10.1016/s0925-2312(00)00324-6 · Cited by 8,414
Domain-Adversarial Training of Neural Networks
Ganin, Y., Ustinova, E., Ajakan, H., Germain, P., Larochelle, H., Laviolette, F., Marchand, M., & Lempitsky, V. (2017) · Advances in Computer Vision and Pattern Recognition · doi:10.1007/978-3-319-58347-1_10 · Cited by 8,318
Independent component analysis, A new concept?
Comon, P. (1994) · Signal Processing · doi:10.1016/0165-1684(94)90029-9 · Cited by 8,205
An introduction to variable and feature selection
GuyonIsabelle, & ElisseeffAndré (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944968 · Cited by 7,715
On the Properties of Neural Machine Translation: Encoder–Decoder Approaches
Cho, K., van Merrienboer, B., Bahdanau, D., & Bengio, Y. (2014) · Proceedings of SSST-8, Eighth Workshop on Syntax, Semantics and Structure in Statistical Translation · doi:10.3115/v1/w14-4012 · Cited by 7,099
An Introduction to Variable and Feature Selection.
Guyon, I., & Elisseeff, A. (2003) · Cited by 6,576
Learning Transferable Architectures for Scalable Image Recognition
Zoph, B., Vasudevan, V., Shlens, J., & Le, Q. V. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00907 · Cited by 6,249
Federated learning: Challenges, methods, and future directions
Li, T., Sahu, A. K., Talwalkar, A., & Smith, V. (2020) · IEEE Signal Processing Magazine · doi:10.1109/msp.2020.2975749 · Cited by 6,210
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
Iandola, F. N., Han, S., Moskewicz, M. W., Ashraf, K., Dally, W. J., & Keutzer, K. (2016) · arXiv · doi:10.48550/arxiv.1602.07360 · Cited by 6,201 · cited 7×
“SqueezeNet [92] brought on several microarchitectural enhancements to AlexNet [93].”
BackgroundInfluentialCSPNet: A New Backbone that can Enhance Learning Capability of CNN
Wang, C.-Y., Mark Liao, H.-Y., Wu, Y.-H., Chen, P.-Y., Hsieh, J.-W., & Yeh, I.-H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00203 · Cited by 5,265
Long-term recurrent convolutional networks for visual recognition and description
Donahue, J., Hendricks, L. A., Guadarrama, S., Rohrbach, M., Venugopalan, S., Darrell, T., & Saenko, K. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298878 · Cited by 5,228
A survey on feature selection methods
Chandrashekar, G., & Sahin, F. (2014) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2013.11.024 · Cited by 5,189
WaveNet: a generative model for raw audio
Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911
Han, S., Mao, H., & Dally, W. J. (2015) · arXiv · doi:10.48550/arxiv.1510.00149 · Cited by 4,662
Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference
Jacob, B., Kligys, S., Chen, B., Zhu, M., Tang, M., Howard, A., Adam, H., & Kalenichenko, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00286 · Cited by 4,114
Neural Architecture Search with Reinforcement Learning
Zoph, B., & Le, Q. V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01578 · Cited by 3,974
Practical Secure Aggregation for Privacy-Preserving Machine Learning
Bonawitz, K., Ivanov, V., Kreuter, B., Marcedone, A., McMahan, H. B., Patel, S., Ramage, D., Segal, A., & Seth, K. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3133982 · Cited by 3,956
Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review
Rawat, W., & Wang, Z. (2017) · Neural Computation · doi:10.1162/neco_a_00990 · Cited by 3,503
MnasNet: Platform-Aware Neural Architecture Search for Mobile
Tan, M., Chen, B., Pang, R., Vasudevan, V., Sandler, M., Howard, A., & Le, Q. V. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00293 · Cited by 3,416
DARTS: Differentiable architecture search
Liu, H., Simonyan, K., & Yang, Y. (2018) · arXiv · doi:10.48550/arxiv.1806.09055 · Cited by 3,248
Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761
Learning openCV: computer vision with the openCV library
Bradski, G. R., & Kaehler, A. (2008) · CERN Document Server (European Organization for Nuclear Research) · Cited by 2,468
Kernel principal component analysis
Schölkopf, B., Smola, A., & Müller, K.-R. (1997) · Lecture Notes in Computer Science · doi:10.1007/bfb0020217 · Cited by 1,942
TinyBERT: Distilling BERT for natural language understanding
Jiao, X., Yin, Y., Shang, L., Jiang, X., Chen, X., Li, L., Wang, F., & Liu, Q. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.372 · Cited by 1,786
Neural Architecture Search: A Survey
Elsken, T., Metzen, J. H., & Hutter, F. (2018) · arXiv · doi:10.48550/arxiv.1808.05377 · Cited by 1,763
Nasr, M., Shokri, R., & Houmansadr, A. (2019) · 2019 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2019.00065 · Cited by 1,760
Scaled-YOLOv4: Scaling Cross Stage Partial Network
Wang, C.-Y., Bochkovskiy, A., & Liao, H.-Y. M. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01283 · Cited by 1,718
Feature extraction : foundations and applications
Guyon, I., Gunn, S. R., Nikravesh, M., & zadeh, L. N. (2006) · Cited by 1,658
(2018) · International Conference on Machine Learning · Cited by 1,465
Exploiting Linear Structure Within Convolutional Networks for Efficient Evaluation
Denton, R., Zaremba, W., Bruna, J., LeCun, Y., & Fergus, R. (2014) · arXiv · doi:10.48550/arxiv.1404.0736 · Cited by 1,414
A Survey on IoT Security: Application Areas, Security Threats, and Solution Architectures
Hassija, V., Chamola, V., Saxena, V., Jain, D., Goyal, P., & Sikdar, B. (2019) · IEEE Access · doi:10.1109/access.2019.2924045 · Cited by 1,396
Deep Learning with Limited Numerical Precision
Gupta, S., Agrawal, A., Gopalakrishnan, K., & Narayanan, P. (2015) · arXiv · doi:10.48550/arxiv.1502.02551 · Cited by 1,364
FBNet: Hardware-Aware Efficient ConvNet Design via Differentiable Neural Architecture Search
Wu, B., Keutzer, K., Dai, X., Zhang, P., Wang, Y., Sun, F., Wu, Y., Tian, Y., Vajda, P., & Jia, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01099 · Cited by 1,261
TVM: an automated end-to-end optimizing compiler for deep learning
(2018) · arXiv (Cornell University) · doi:10.5555/3291168.3291211 · Cited by 1,170
MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformer
Mehta, S., & Rastegari, M. (2021) · arXiv · doi:10.48550/arxiv.2110.02178 · Cited by 1,110
Speech Commands: A Dataset for Limited-Vocabulary Speech Recognition
Warden, P. (2018) · arXiv · doi:10.48550/arxiv.1804.03209 · Cited by 1,033
Can homomorphic encryption be practical?
Naehrig, M., Lauter, K., & Vaikuntanathan, V. (2011) · Proceedings of the 3rd ACM workshop on Cloud computing security workshop · doi:10.1145/2046660.2046682 · Cited by 1,004
Deep face recognition: A survey
Wang, M., & Deng, W. (2021) · Neurocomputing · doi:10.1016/j.neucom.2020.10.081 · Cited by 996
HAQ: Hardware-Aware Automated Quantization With Mixed Precision
Wang, K., Liu, Z., Lin, Y., Lin, J., & Han, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00881 · Cited by 978
A Survey on Data Collection for Machine Learning: A Big Data - AI Integration Perspective
Roh, Y., Heo, G., & Whang, S. E. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2019.2946162 · Cited by 968
Temporal Convolutional Networks: A Unified Approach to Action Segmentation
Lea, C., Vidal, R., Reiter, A., & Hager, G. D. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-49409-8_7 · Cited by 924
A practical automatic polyhedral parallelizer and locality optimizer
Bondhugula, U., Hartono, A., Ramanujam, J., & Sadayappan, P. (2008) · Proceedings of the 29th ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/1375581.1375595 · Cited by 880
Rethinking the Value of Network Pruning
Liu, Z., Sun, M., Zhou, T., Huang, G. M., & Darrell, T. J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.05270 · Cited by 872
Once-for-All: Train One Network and Specialize it for Efficient Deployment
Cai, H., Gan, C., Wang, T., Zhang, Z., & Han, S. (2019) · arXiv · doi:10.48550/arxiv.1908.09791 · Cited by 845 · cited 5×
“A typical microcontroller has 128-kB RAM and 1 MB of flash, while a mobile phone can have 4 GB of RAM and 64 GB of storage [5].”
BackgroundInfluentialSingle Path One-Shot Neural Architecture Search with Uniform Sampling
Guo, Z., Zhang, X., Mu, H., Heng, W., Liu, Z., Wei, Y., & Sun, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58517-4_32 · Cited by 813
To prune, or not to prune: exploring the efficacy of pruning for model compression
Zhu, M., & Gupta, S. (2017) · arXiv · doi:10.48550/arxiv.1710.01878 · Cited by 805
Quantizing deep convolutional networks for efficient inference: A whitepaper
Krishnamoorthi, R. (2018) · arXiv · doi:10.48550/arxiv.1806.08342 · Cited by 753
Stisen, A., Blunck, H., Bhattacharya, S., Prentow, T. S., Kjærgaard, M. B., Dey, A., Sonne, T., & Jensen, M. M. (2015) · Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/2809695.2809718 · Cited by 714
LINEAR DISCRIMINANT ANALYSIS - A BRIEF TUTORIAL
Balakrishnama, S., & Ganapathiraju, A. (1995) · Cited by 705
SNIP: Single-shot Network Pruning based on Connection Sensitivity
Lee, N., Ajanthan, T., & Torr, P. H. S. (2018) · arXiv · doi:10.48550/arxiv.1810.02340 · Cited by 685
DÏoT: A Federated Self-learning Anomaly Detection System for IoT
Nguyen, T. D., Marchal, S., Miettinen, M., Fereidooni, H., Asokan, N., & Sadeghi, A.-R. (2019) · 2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2019.00080 · Cited by 663
Numerical Computing with Matlab
Moler, C. B. (2004) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9780898717952 · Cited by 646
Flower: A Friendly Federated Learning Research Framework
Beutel, D. J., Topal, T., Mathur, A., Qiu, X., Fernandez-Marques, J., Gao, Y., Sani, L., Li, K. H., Parcollet, T., de Gusmão, P. P. B., et al. (2020) · arXiv · doi:10.48550/arxiv.2007.14390 · Cited by 622
YOLO-LITE: A Real-Time Object Detection Algorithm Optimized for Non-GPU Computers
Huang, R., Pedoeem, J., & Chen, C. (2018) · 2018 IEEE International Conference on Big Data (Big Data) · doi:10.1109/bigdata.2018.8621865 · Cited by 622
Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables
Hammerla, N. Y., Halloran, S., & Ploetz, T. (2016) · arXiv · doi:10.48550/arxiv.1604.08880 · Cited by 606
A Comprehensive Survey of Neural Architecture Search: Challenges and Solutions
Ren, P., Xiao, Y., Chang, X., Huang, P.-Y., Li, Z., Chen, X., & Wang, X. (2022) · ACM Computing Surveys · doi:10.1145/3447582 · Cited by 590
Model Pruning Enables Efficient Federated Learning on Edge Devices
Jiang, Y., Wang, S., Valls, V., Ko, B. J., Lee, W.-H., Leung, K. K., & Tassiulas, L. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3166101 · Cited by 589
Google Vizier: A Service for Black-Box Optimization
Golovin, D., Solnik, B., Moitra, S., Kochanski, G., Karro, J., & Sculley, D. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098043 · Cited by 571
Automatically Tuned Linear Algebra Software
Whaley, R. C., & Dongarra, J. J. (1998) · Proceedings of the IEEE/ACM SC98 Conference · doi:10.1109/sc.1998.10004 · Cited by 527
A database for fine grained activity detection of cooking activities
Rohrbach, M., Amin, S., Andriluka, M., & Schiele, B. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247801 · Cited by 521
Convolutional neural networks for small-footprint keyword spotting
Sainath, T. N., & Parada, C. (2015) · Interspeech 2015 · doi:10.21437/interspeech.2015-352 · Cited by 521
DroNet: Learning to Fly by Driving
Loquercio, A., Maqueda, A. I., del-Blanco, C. R., & Scaramuzza, D. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2795643 · Cited by 514
TensorFlow Lite Micro: Embedded Machine Learning on TinyML Systems
David, R., Duke, J., Jain, A., Reddi, V. J., Jeffries, N., Li, J., Kreeger, N., Nappier, I., Natraj, M., Regev, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.08678 · Cited by 470
Scaling for edge inference of deep neural networks
Xu, X., Ding, Y., Hu, S. X., Niemier, M., Cong, J., Hu, Y., & Shi, Y. (2018) · Nature Electronics · doi:10.1038/s41928-018-0059-3 · Cited by 462
A review on TinyML: State-of-the-art and prospects
Ray, P. P. (2022) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2021.11.019 · Cited by 460 · cited 6×
“While prior surveys [3] [4] [6] [7] present a qualitative review”
BackgroundInfluentialLite Transformer with Long-Short Range AttentionPreprint
Wu, Z., Liu, Z., Lin, J., Lin, Y., & Han, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.11886 · Cited by 438
A survey of open source tools for machine learning with big data in the Hadoop ecosystem
Landset, S., Khoshgoftaar, T. M., Richter, A. N., & Hasanin, T. (2015) · Journal of Big Data · doi:10.1186/s40537-015-0032-1 · Cited by 432
Zero-Cost Proxies for Lightweight NASPreprint
Abdelfattah, M. S., Mehrotra, A., Dudziak, Ł., & Lane, N. D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.08134 · Cited by 430
Personalized Federated Learning for Intelligent IoT Applications: A Cloud-Edge Based Framework
Wu, Q., He, K., & Chen, X. (2020) · IEEE Open Journal of the Computer Society · doi:10.1109/ojcs.2020.2993259 · Cited by 424
Greydanus, S., Dzamba, M., & Yosinski, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.01563 · Cited by 418
MIMII Dataset: Sound Dataset for Malfunctioning Industrial Machine Investigation and Inspection
Purohit, H., Tanabe, R., Ichige, T., Endo, T., Nikaido, Y., Suefusa, K., & Kawaguchi, Y. (2019) · Proceedings of the Detection and Classification of Acoustic Scenes and Events 2019 Workshop (DCASE2019) · doi:10.33682/m76f-d618 · Cited by 387
Hello Edge: Keyword Spotting on Microcontrollers
Zhang, Y., Suda, N., Lai, L., & Chandra, V. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.07128 · Cited by 334
Regularized Evolution for Image Classifier Architecture Search
Real, E., Aggarwal, A., Huang, Y., & Le, Q. V. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33014780 · Cited by 328
TinyML Meets IoT: A Comprehensive Survey
Dutta, D. L., & Bharali, S. (2021) · Internet of Things · doi:10.1016/j.iot.2021.100461 · Cited by 328
In-place Activated BatchNorm for Memory-Optimized Training of DNNs
Bulo, S. R., Porzi, L., & Kontschieder, P. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00591 · Cited by 320
Distance measures for speech recognition, psychological and instrumental
Mermelstein, P. (1976) · Medical Entomology and Zoology · Cited by 318
Toward a Quantitative Survey of Dimension Reduction Techniques
Espadoto, M., Martins, R. M., Kerren, A., Hirata, N. S. T., & Telea, A. C. (2021) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2019.2944182 · Cited by 309
RoNIN: Robust Neural Inertial Navigation in the Wild: Benchmark, Evaluations, & New Methods
Herath, S., Yan, H., & Furukawa, Y. (2020) · 2020 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra40945.2020.9196860 · Cited by 302
TinyML-Enabled Frugal Smart Objects: Challenges and Opportunities
Sanchez-Iborra, R., & Skarmeta, A. F. (2020) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2020.3005467 · Cited by 295 · cited 4×
“While prior surveys [3] [4] [6] [7] present a qualitative review”
BackgroundInfluentialCMSIS-NN: Efficient Neural Network Kernels for Arm Cortex-M CPUs
Oliveira, A., Costa, D., Moreira, G., Martins, J., & Pinto, S. (2018) · arXiv (Cornell University) · doi:10.4230/oasics.ng-res.2025.4 · Cited by 288
Updates in Human-AI Teams: Understanding and Addressing the Performance/Compatibility Tradeoff
Bansal, G., Nushi, B., Kamar, E., Weld, D. S., Lasecki, W. S., & Horvitz, E. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33012429 · Cited by 284
A Survey of On-Device Machine Learning: An Algorithms and Learning Theory Perspective
Dhar, S., Guo, J., Liu, J., Tripathi, S., Kurup, U., & Shah, M. (2021) · ACM Transactions on Internet of Things · doi:10.1145/3450494 · Cited by 275
Scalpel: Customizing DNN Pruning to the Underlying Hardware Parallelism
Yu, J., Lukefahr, A., Palframan, D., Dasika, G., Das, R., & Mahlke, S. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080215 · Cited by 272
Resource-efficient machine learning in 2 KB RAM for the internet of things
Kumar, A., Goyal, S., & Varma, M. (2017) · International Conference on Machine Learning · Cited by 262
MCUNet: Tiny Deep Learning on IoT Devices
Lin, J., Chen, W.-M., Lin, Y., Cohn, J., Gan, C., & Han, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.10319 · Cited by 259
BRP-NAS: Prediction-based NAS using GCNsPreprint
Dudziak, L., Chau, T. C. P., Abdelfattah, M. S., Lee, R., Kim, H., & Lane, N. (2020) · Neural Information Processing Systems · doi:10.48550/arxiv.2007.08668 · Cited by 242
Visual Wake Words DatasetPreprint
Chowdhery, A., Warden, P., Shlens, J., Howard, A., & Rhodes, R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.05721 · Cited by 224
TinyML: Machine Learning with TensorFlow Lite on Arduino and Ultra-Low-Power Microcontrollers
Warden, P., & Situnayake, D. (2019) · Cited by 224
PULP-NN: accelerating quantized neural networks on parallel ultra-low-power RISC-V processors
Garofalo, A., Rusci, M., Conti, F., Rossi, D., & Benini, L. (2019) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2019.0155 · Cited by 222
A Taxonomy of Attacks on Federated Learning
Jere, M. S., Farnan, T., & Koushanfar, F. (2021) · IEEE Security & Privacy · doi:10.1109/msec.2020.3039941 · Cited by 217
When NAS Meets Robustness: In Search of Robust Architectures Against Adversarial Attacks
Guo, M., Yang, Y., Xu, R., Liu, Z., & Lin, D. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00071 · Cited by 217
Single-Path NAS: Designing Hardware-Efficient ConvNets in Less Than 4 Hours
Stamoulis, D., Ding, R., Wang, D., Lymberopoulos, D., Priyantha, B., Liu, J., & Marculescu, D. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-46147-8_29 · Cited by 215
Adversarial Robustness vs. Model Compression, or Both?
Ye, S., Xu, K., Liu, S., Cheng, H., Lambrechts, J.-H., Zhang, H., Zhou, A., Ma, K., Wang, Y., & Lin, X. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00020 · Cited by 214
A Survey of Stochastic Computing Neural Networks for Machine Learning Applications
Liu, Y., Liu, S., Wang, Y., Lombardi, F., & Han, J. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3009047 · Cited by 212
Unitary Evolution Recurrent Neural Networks
Arjovsky, M., Shah, A., & Bengio, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06464 · Cited by 210
Quantization and Deployment of Deep Neural Networks on Microcontrollers
Novac, P.-E., Boukli Hacene, G., Pegatoquet, A., Miramond, B., & Gripon, V. (2021) · Sensors · doi:10.3390/s21092984 · Cited by 210
Yao, S., Li, J., Liu, D., Wang, T., Liu, S., Shao, H., & Abdelzaher, T. (2020) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3384419.3430898 · Cited by 209
Intelligence Beyond the Edge: Inference on Intermittent Embedded Systems
Gobieski, G., Lucia, B., & Beckmann, N. (2019) · Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3297858.3304011 · Cited by 203
Coelho, C. N., Kuusela, A., Li, S., Zhuang, H., Ngadiuba, J., Aarrestad, T. K., Loncar, V., Pierini, M., Pol, A. A., & Summers, S. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00356-5 · Cited by 197
Feedback Control For Cassie With Deep Reinforcement Learning
Xie, Z., Berseth, G., Clary, P., Hurst, J., & van de Panne, M. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593722 · Cited by 192
ToyADMOS: A Dataset of Miniature-Machine Operating Sounds for Anomalous Sound Detection
Koizumi, Y., Saito, S., Uematsu, H., Harada, N., & Imoto, K. (2019) · 2019 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) · doi:10.1109/waspaa.2019.8937164 · Cited by 191
Yao, S., Zhao, Y., Zhang, A., Su, L., & Abdelzaher, T. (2017) · Proceedings of the 15th ACM Conference on Embedded Network Sensor Systems · doi:10.1145/3131672.3131675 · Cited by 188
FastGRNN: A Fast, Accurate, Stable and Tiny Kilobyte Sized Gated Recurrent Neural NetworkPreprint
Kusupati, A., Singh, M., Bhatia, K., Kumar, A., Jain, P., & Varma, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.02358 · Cited by 186
A 64-mW DNN-Based Visual Navigation Engine for Autonomous Nano-Drones
Palossi, D., Loquercio, A., Conti, F., Flamand, E., Scaramuzza, D., & Benini, L. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2917066 · Cited by 186
Realizing the Heterogeneity: A Self-Organized Federated Learning Framework for IoT
Pang, J., Huang, Y., Xie, Z., Han, Q., & Cai, Z. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3007662 · Cited by 186
Hardware/Software Co-Exploration of Neural Architectures
Jiang, W., Yang, L., Sha, E. H. ‐., Zhuge, Q., Gu, S., Dasgupta, S., Shi, Y., & Hu, J. (2020) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2020.2986127 · Cited by 185
DORY: Automatic End-to-End Deployment of Real-World DNNs on Low-Cost IoT MCUs
Burrello, A., Garofalo, A., Bruschi, N., Tagliavini, G., Rossi, D., & Conti, F. (2021) · IEEE Transactions on Computers · doi:10.1109/tc.2021.3066883 · Cited by 185
TinyOL: TinyML with Online-Learning on Microcontrollers
Ren, H., Anicic, D., & Runkler, T. A. (2021) · 2021 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9533927 · Cited by 185
Banbury, C., Zhou, C., Fedorov, I., Navarro, R. M., Thakker, U., Gope, D., Reddi, V. J., Mattina, M., & Whatmough, P. N. (2020) · arXiv · doi:10.48550/arxiv.2010.11267 · Cited by 183
SpArSe: Sparse Architecture Search for CNNs on Resource-Constrained MicrocontrollersPreprint
Fedorov, I., Adams, R. P., Mattina, M., & Whatmough, P. N. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.12107 · Cited by 181
Zhang, L. L., Han, S., Wei, J., Zheng, N., Cao, T., Yang, Y., & Liu, Y. (2021) · Proceedings of the 19th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3458864.3467882 · Cited by 178
TinyML: Current Progress, Research Challenges, and Future Roadmap
Shafique, M., Theocharides, T., Reddy, V. J., & Murmann, B. (2021) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1109/dac18074.2021.9586232 · Cited by 176
Neural Predictor for Neural Architecture Search
Wen, W., Liu, H., Chen, Y., Li, H., Bender, G., & Kindermans, P.-J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58526-6_39 · Cited by 167
Wang, X., Magno, M., Cavigelli, L., & Benini, L. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2976702 · Cited by 162
Deep-Learning-Based Pedestrian Inertial Navigation: Methods, Data Set, and On-Device Inference
Chen, C., Zhao, P., Lu, C. X., Wang, W., Markham, A., & Trigoni, N. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2966773 · Cited by 161
Accuracy vs. Efficiency: Achieving Both through FPGA-Implementation Aware Neural Architecture Search
Jiang, W., Zhang, X., Sha, E. H. ‐., Yang, L., Zhuge, Q., Shi, Y., & Hu, J. (2019) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1145/3316781.3317757 · Cited by 154
Larq: An Open-Source Library for Training Binarized Neural Networks
Geiger, L., & Plumerai Team (2020) · The Journal of Open Source Software · doi:10.21105/joss.01746 · Cited by 141
Dave, S., Baghdadi, R., Nowatzki, T., Avancha, S., Shrivastava, A., & Li, B. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3098483 · Cited by 140
Engineless Unmanned Aerial Vehicle Propulsion by Dynamic Soaring
Deittert, M., Richards, A. G., Toomer, C., & Pipe, T. (2009) · Journal of Guidance Control and Dynamics · doi:10.2514/1.43270 · Cited by 135
CMix-NN: Mixed Low-Precision CNN Library for Memory-Constrained Edge Devices
Capotondi, A., Rusci, M., Fariselli, M., & Benini, L. (2020) · IEEE Transactions on Circuits and Systems II: Express Briefs · doi:10.1109/tcsii.2020.2983648 · Cited by 135
A TinyML Platform for On-Device Continual Learning With Quantized Latent Replays
Ravaglia, L., Rusci, M., Nadalini, D., Capotondi, A., Conti, F., & Benini, L. (2021) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2021.3121554 · Cited by 132
MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep LearningPreprint
Lin, J., Chen, W.-M., Cai, H., Gan, C., & Han, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.15352 · Cited by 132
Banbury, C., Reddi, V. J., Torelli, P., Holleman, J., Jeffries, N., Kiraly, C., Montino, P., Kanter, D., Ahmed, S., Pau, D., et al. (2021) · arXiv · doi:10.48550/arxiv.2106.07597 · Cited by 121 · cited 8×
“5 benchmark, applications of anomaly detection include diagnosis of industrial machinery [9] [120] [8], physiological”
BackgroundMethodInfluentialTinyLSTMs: Efficient Neural Speech Enhancement for Hearing Aids
Fedorov, I., Stamenovic, M., Jensen, C., Yang, L.-C., Mandell, A., Gan, Y., Mattina, M., & Whatmough, P. N. (2020) · Interspeech 2020 · doi:10.21437/interspeech.2020-1864 · Cited by 116
Visual Odometry by Multi-frame Feature Integration
Badino, H., Yamamoto, A., & Takeo Kanade, A. (2013) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2013.37 · Cited by 116
Towards Backward-Compatible Representation Learning
Shen, Y., Xiong, Y., Xia, W., & Soatto, S. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00640 · Cited by 116
Legendre Memory Units: Continuous-Time Representation in Recurrent Neural Networks
Voelker, A. R., Kajić, I., & Eliasmith, C. (2019) · neural information processing systems · Cited by 108
dMazeRunner: Executing Perfectly Nested Loops on Dataflow Accelerators
Dave, S., Kim, Y., Avancha, S., Lee, K., & Shrivastava, A. (2019) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3358198 · Cited by 106
Yao, S., Piao, A., Jiang, W., Zhao, Y., Shao, H., Liu, S., Liu, D., Li, J., Wang, T., Hu, S., et al. (2019) · International World Wide Web Conference (WWW) · doi:10.1145/3308558.3313426 · Cited by 104
Positive-Congruent Training: Towards Regression-Free Model Updates
Yan, S.-J., Xiong, Y., Kundu, K., Yang, S., Deng, S., Wang, M., Xia, W., & Soatto, S. (2020) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr46437.2021.01407 · Cited by 94
Compiling KB-sized machine learning models to tiny IoT devices
Gopinath, S., Ghanathe, N., Seshadri, V., & Sharma, R. (2019) · Proceedings of the 40th ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/3314221.3314597 · Cited by 92
μNAS: Constrained Neural Architecture Search for Microcontrollers
Liberis, E., Dudziak, Ł., & Lane, N. D. (2021) · Proceedings of the 1st Workshop on Machine Learning and Systems · doi:10.1145/3437984.3458836 · Cited by 90
Intermittent Learning: On-Device Machine Learning on Intermittently Powered System
Lee, S., Islam, B., Luo, Y., & Nirjon, S. (2019) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3369837 · Cited by 81
Multilingual Spoken Words Corpus
Mazumder, M., Chitlangia, S., Banbury, C., Kang, Y., Manuel, J., Achorn, K., Gálvez, D., Sabini, M., Mattson, P. R., Kanter, D. E., et al. (2021) · neural information processing systems · Cited by 80
Neural Network Quantization with AI Model Efficiency Toolkit (AIMET)Preprint
Siddegowda, S., Fournarakis, M., Nagel, M., Blankevoort, T., Patel, C., & Khobare, A. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2201.08442 · Cited by 77
A Tiny CNN Architecture for Medical Face Mask Detection for Resource-Constrained Endpoints
Mohan, P., Paul, A. J., & Chirania, A. (2021) · Lecture Notes in Electrical Engineering · doi:10.1007/978-981-16-0749-3_52 · Cited by 70
Secure aggregation for federated learning in flower
Li, K. H., de Gusmão, P. P. B., Beutel, D. J., & Lane, N. D. (2021) · doi:10.1145/3488659.3493776 · Cited by 70
TinyFedTL: Federated Transfer Learning on Ubiquitous Tiny IoT Devices
Kopparapu, K., Lin, E., Breslin, J. G., & Sudharsan, B. (2022) · 2022 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops) · doi:10.1109/percomworkshops53856.2022.9767250 · Cited by 66
An Empirical Analysis of Backward Compatibility in Machine Learning Systems
Srivastava, M., Nushi, B., Kamar, E. S., Shah, S., & Horvitz, E. (2020) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3394486.3403379 · Cited by 65
Self-citationA Lightweight Framework for Human Activity Recognition on Wearable Devices
Coelho, Y., dos Santos, F. D. A. S., Frizera, A., & Bastos-Filho, T. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3113908 · Cited by 65
TinyOdom: Hardware-Aware Efficient Neural Inertial Navigation
Saha, S. S., Sandha, S. S., Garcia, L. A., & Srivastava, M. B. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3534594 · Cited by 64
Self-citationML-MCU: A Framework to Train ML Classifiers on MCU-Based IoT Edge Devices
Sudharsan, B., Breslin, J. G., & Ali, M. I. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3098166 · Cited by 63
GP-NAS: Gaussian Process Based Neural Architecture Search
Li, Z.-H., Xi, T., Deng, J., Zhang, G., Wen, S., & He, R. (2020) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr42600.2020.01195 · Cited by 62
RNNPool: Efficient Non-linear Pooling for RAM Constrained InferencePreprint
Saha, O., Kusupati, A., Simhadri, H. V., Varma, M., & Jain, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.11921 · Cited by 59
Robustifying the Deployment of tinyML Models for Autonomous mini-vehicles
de Prado, M., Rusci, M., Capotondi, A., Donze, R., Benini, L., & Pazos, N. (2021) · Sensors · doi:10.3390/s21041339 · Cited by 57
Enabling On-Device CNN Training by Self-Supervised Instance Filtering and Error Map Pruning
Wu, Y., Wang, Z., Shi, Y., & Hu, J. (2020) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2020.3012216 · Cited by 56
A Method for Sensor-Based Activity Recognition in Missing Data Scenario
Hossain, T., Ahad, M. A. R., & Inoue, S. (2020) · Sensors · doi:10.3390/s20143811 · Cited by 52
Intermittent-Aware Neural Architecture Search
Mendis, H. R., Kang, C.-K., & Hsiu, P.-C. (2021) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3476995 · Cited by 52
Palossi, D., Conti, F., & Benini, L. (2019) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000364073 · Cited by 51
Palossi, D., Conti, F., & Benini, L. (2019) · International Conference on Distributed Computing in Smart Systems and the Internet of Things (DCOSS-IoT) · doi:10.1109/dcoss.2019.00111 · Cited by 50
A 1D-CNN Based Deep Learning Technique for Sleep Apnea Detection in IoT Sensors
John, A., Cardiff, B., & John, D. (2021) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas51556.2021.9401300 · Cited by 49
Train++: An Incremental ML Model Training Algorithm to Create Self-Learning IoT Devices
Sudharsan, B., Yadav, P., Breslin, J. G., & Ali, M. I. (2021) · IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI) · doi:10.1109/swc50871.2021.00023 · Cited by 46
A Microcontroller is All You Need: Enabling Transformer Execution on Low-Power IoT Endnodes
Burrello, A., Scherer, M., Zanghieri, M., Conti, F., & Benini, L. (2021) · IEEE International Conference on Omni-layer Intelligent Systems (COINS) · doi:10.1109/coins51742.2021.9524173 · Cited by 45
Osman, A., Abid, U., Gemma, L., Perotto, M., & Brunelli, D. (2022) · Lecture notes in electrical engineering · doi:10.1007/978-3-030-95498-7_20 · Cited by 45
Imteaj, A., & Amini, M. H. (2021) · Frontiers in Communications and Networks · doi:10.3389/frcmn.2021.657653 · Cited by 41
A Battery-Free Long-Range Wireless Smart Camera for Face Detection
Giordano, M., Mayer, P., & Magno, M. (2020) · Proceedings of the 8th International Workshop on Energy Harvesting and Energy-Neutral Sensing Systems · doi:10.1145/3417308.3430273 · Cited by 38 · cited 2×
“97 352 kB 85M Batteryless Face Detection [25] CelebA Accuracy: 0.”
BackgroundCapacitive Sensing Based On-board Hand Gesture Recognition with TinyML
Bian, S., & Lukowicz, P. (2021) · Adjunct Proceedings of the 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2021 ACM International Symposium on Wearable Computers · doi:10.1145/3460418.3479287 · Cited by 37
UniTS: Short-Time Fourier Inspired Neural Networks for Sensory Time Series Classification
Li, S., Chowdhury, R. R., Shang, J., Gupta, R. K., & Hong, D. (2021) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3485730.3485942 · Cited by 37
Kayan, H., Majib, Y., Alsafery, W., Barhamgi, M., & Perera, C. (2021) · Internet of Things · doi:10.1016/j.iot.2021.100437 · Cited by 33
Are Microcontrollers Ready for Deep Learning-Based Human Activity Recognition?
Elsts, A., & McConville, R. (2021) · Electronics · doi:10.3390/electronics10212640 · Cited by 33
Paul, A. J., Mohan, P., & Sehgal, S. (2020) · 2020 IEEE Recent Advances in Intelligent Computational Systems (RAICS) · doi:10.1109/raics51191.2020.9332480 · Cited by 32
Dennis, D. K., Pabbaraju, C., Simhadri, H. V., & Jain, P. (2018) · neural information processing systems · Cited by 32
GesturePod: Enabling On-device Gesture-based Interaction for White Cane Users
Patil, S. G., Dennis, D. K., Pabbaraju, C., Shaheer, N., Simhadri, H. V., Seshadri, V., Varma, M., & Jain, P. (2019) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3332165.3347881 · Cited by 31
Real-Time Multi-Scale Face Detector on Embedded Devices
Zhao, X. F., Liang, X., Zhao, C., Tang, M., & Wang, J. (2019) · Sensors · doi:10.3390/s19092158 · Cited by 30
Saha, S. S., Sandha, S. S., Pei, S., Jain, V., Wang, Z., Li, Y., Sarker, A., & Srivastava, M. B. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3534586 · Cited by 28
Self-citationTinySpeech: Attention Condensers for Deep Speech Recognition Neural Networks on Edge Devices
Wong, A., Famouri, M., Pavlova, M., & Surana, S. (2020) · arXiv · doi:10.48550/arxiv.2008.04245 · Cited by 27
Learning in the Wild: When, How, and What to Learn for On-Device Dataset Adaptation
Lee, S., & Nirjon, S. (2020) · International Workshop on Challenges in Artificial Intelligence and Machine Learning for Internet of Things (AIChallengeIoT) · doi:10.1145/3417313.3429382 · Cited by 26
Hardware Aware Training for Efficient Keyword Spotting on General Purpose and Specialized HardwarePreprint
Blouw, P., Malik, G. S., Morcos, B., Voelker, A. R., & Eliasmith, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.04465 · Cited by 26
TF-Net: Deploying Sub-Byte Deep Neural Networks on Microcontrollers
Yu, J., Lukefahr, A., Das, R., & Mahlke, S. A. (2019) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3358189 · Cited by 25
Neuroplex: learning to detect complex events in sensor networks through knowledge injection
Xing, T., García, L. A. R., Vilamala, M. R., Cerutti, F., Kaplan, L., Preece, A. D., & Srivastava, M. B. (2020) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3384419.3431158 · Cited by 24
Self-citationCompiler optimizations for improving data locality
Carr, S., McKinley, K. S., & Tseng, C. (1994) · ACM SIGPLAN Notices · doi:10.1145/195470.195557 · Cited by 24
EmbML Tool: Supporting the use of Supervised Learning Algorithms in Low-Cost Embedded Systems
da Silva, L. T., Souza, V. M. A., & Batista, G. E. A. P. A. (2019) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai.2019.00238 · Cited by 23
Research works printed but not linked: 52
- 2022, X-CUBE-AI—AI Expansion Pack for STM32CubeMX—Stmicroelectronics
- goyal, 2020, DROCC: Deep robust one-class classification, Proc Int Conf Mach Learn, 3711
- morawiec, 2022, sklearn-porter
- 2021, Nanoedge AI Library
- 2022, Edge Ai/TinyML SAAS Deep Learning
- 2022, AI-Driven Deep Neural Network Optimizer
- tan, 2022, Utensor/Utensor TinyML Ai Inference Library
- dennis, 2019, Shallow RNN: Accurate time-series classification on resource constrained devices, Proc Adv Neural Inf Process Syst, 32, 1
- 2022, Edge Impulse
- 2022, Plumerai
- 2022, Qeexo Automl
- 2022, Sensiml Making Sensor Data Sensible
- 2022, Reality AI
- 2022, Neuton AI—No-Code Artificial Intelligence for All
- wang, 2019, Picking winning tickets before training by preserving gradient flow, Proc Int Conf Learn Represent, 1
- chen, 2020, Neural architecture search on ImageNet in four GPU hours: A theoretically inspired perspective, Proc Int Conf Learn Represent, 1
- tanaka, 2020, Pruning neural networks without any data by iteratively conserving synaptic flow, Proc Adv Neural Inf Process Syst, 33, 6377
- mellor, 2021, Neural architecture search without training, Proc Int Conf Mach Learn, 7588
- 10.1109/ICASSP40776.2020.9054609 · DOI
- daulton, 2022, Multi-objective Bayesian optimization over high-dimensional search spaces, Proc Conf Uncertainty of Artificial Intelligence, 507
- gupta, 2017, ProtoNN: Compressed and accurate KNN for resource-scarce devices, Proc Int Conf Mach Learn, 1331
- 2022, Microsoft/Nni An Open Source Automl Toolkit for Automate Machine Learning Lifecycle Including Feature Engineering Neural Architecture Search Model Compression and Hyper-Parameter Tuning
- bannink, 2021, Larq compute engine: Design, benchmark and deploy state-of-the-art binarized neural networks, Proc Mach Learn Syst, 3, 680
- tauzin, 2021, giotto-tda: A topological data analysis toolkit for machine learning and data exploration, J Mach Learn Res, 22, 1
- 10.1007/978-1-4615-4337-4 · doi:10.1007/978-1-4615-4337-4
- gielda, 2017, Renode: A flexible, open-source simulation framework for building scalable, well-tested RISC-V systems, Proc 7th RISC-V Workshop, 1
- jung, 2019, Imgaug documentation, Readthedocs io, 25, 1
- clark, 2015, Pillow (pil fork) documentation, Readthedocs io, 6 2 0, 1
- 2022, Eloquentarduino
- han, 2015, Learning both weights and connections for efficient neural network, Proc Adv Neural Inf Process Syst, 28, 1
- mcmahan, 2017, Communication-efficient learning of deep networks from decentralized data, Proc 20th Int Conf Artif Intell Statist, 1273
- 10.1109/VLSID.2019.00056 · DOI
- 10.1109/CVPR42600.2020.01079 · doi:10.1109/cvpr42600.2020.01079 · Paper page
- hubara, 2016, Binarized neural networks, Proc Adv Neural Inf Process Syst, 29, 1
- rusci, 2020, Memory-driven mixed low precision quantization for enabling deep network inference on microcontrollers, Proc Mach Learn Syst, 2, 326
- liberis, 2022, Differentiable network pruning to enable smart applications, Proc 4th U K Mobile Wearable Ubiquitous Syst Res Symp, 1
- 10.1109/ET52713.2021.9579991 · DOI
- baker, 2017, Designing neural network architectures using reinforcement learning, Proc Int Conf Learn Represent (ICLR), 1
- cai, 2018, ProxylessNAS: Direct neural architecture search on target task and hardware, Proc Int Conf Learn Represent, 1
- chen, 2018, Understanding the limitations of existing energy-efficient design approaches for deep neural networks, Energy, 2, 3l
- cranmer, 2020, Lagrangian neural networks, Proc ICLR WKSH Integr Deep Neural Models Differ Equ, 1
- mao, 2018, The neuro-symbolic concept learner: Interpreting scenes, words, and sentences from natural supervision, Proc Int Conf Learn Represent, 1
- li, 2021, FLASH: Fast neural architecture search with hardware optimization, ACM Trans Embedded Comput Syst, 20, 1, 10.1145/3477034 · doi:10.1145/3477034
- silver, 2014, Deterministic policy gradient algorithms, Proc Int Conf Mach Learn, 387
- elsken, 2018, Efficient multi-objective neural architecture search via Lamarckian evolution, Proc Int Conf Learn Represent, 1
- jose, 2018, Kronecker recurrent units, Proc Int Conf Mach Learn, 2380
- vaswani, 0, Attention is all you need, Proc Adv Neural Inf Process Syst, 2017, 5998
- lin, 2018, Defensive quantization: When efficiency meets robustness, Proc Int Conf Learn Represent, 1
- jagielski, 2020, High accuracy and high fidelity extraction of neural networks, Proc 29th USENIX Secur Symp (USENIX Secur ), 1345
- gui, 2019, Model compression with adversarial robustness: A unified optimization framework, Proc Adv Neural Inf Process Syst, 32, 1285
- cai, 2020, TinyTL: Reduce memory, not parameters for efficient on-device learning, Proc Adv Neural Inf Process Syst, 33, 1
- 10.3390/s21144805 · DOI
Cited by
A Comprehensive Survey on TinyML
Abadade, Y., Temouden, A., Bamoumen, H., Benamar, N., Chtouki, Y., & Hafid, A. S. (2023) · IEEE Access · doi:10.1109/access.2023.3294111 · Cited by 366
“The study in [29] presented a clear and complete closed-loop workflow for the development and deployment ofMLmodels for MCUs.”
BackgroundMethodInfluentialLamaakal, I., Ouahbi, I., El Makkaoui, K., Maleh, Y., Pławiak, P., & Alblehai, F. (2024) · IEEE Access · doi:10.1109/access.2024.3406631 · Cited by 34
“The emergence of TinyML [1], [2], [3], [4], [55], [56], [58], [60] represents a significant breakthrough in technology, blending the ever-growing needs of data-driven applications with the constraints of low-power, embedded devices.”
BackgroundEfficient Gesture-Based Recognition of Tifinagh Characters in Air Handwriting with a TinyDL Model
Lamaakal, I., El Mourabit, N., El Makkaoui, K., Ouahbi, I., & Maleh, Y. (2024) · 2024 Sixth International Conference on Intelligent Computing in Data Sciences (ICDS) · doi:10.1109/icds62089.2024.10756483 · Cited by 14
Metadata
- Authors
- Saha, S. S., Sandha, S. S., & Srivastava, M.
- Venue
- IEEE Sensors Journal
- Published
- 2022-11-15
- Volume
- 22
- Issue
- 22
- Pages
- 21362-21390
- ISSN
- 1530-437X (ISSN-L)
- 1558-1748
- 2379-9153
- OpenAlex
- W4309287541
- Cited by
- 253
- References
- 218
- FWCI
- 21.17
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- Funders
- National Institutes of Health (1P41EB028242)
- Army Research Laboratory (W911NF-17-2-0196)
- Semiconductor Research Corporation (S201617)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.