The DOI matches its Crossref record; 218 of the 218 references it cites were found in a registry or an index.
Machine Learning for Microcontroller-Class Hardware: A Review
Open accessAbstract
The advancements in machine learning opened a new opportunity to bring intelligence to the low-end Internet-of-Things nodes such as microcontrollers. Conventional machine learning deployment has high memory and compute footprint hindering their direct deployment on ultra resource-constrained microcontrollers. This paper highlights the unique requirements of enabling onboard machine learning for microcontroller class devices. Researchers use a specialized model development workflow for resource-limited applications to ensure the compute and latency budget is within the device limits while still maintaining the desired performance. We characterize a closed-loop widely applicable workflow of machine learning model development for microcontroller class devices and show that several classes of applications adopt a specific instance of it. We present both qualitative and numerical insights into different stages of model development by showcasing several use cases. Finally, we identify the open research challenges and unsolved questions demanding careful considerations moving forward.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Items 201–218 of 218
Tiny Eats: Eating Detection on a Microcontroller
Nyamukuru, M., & Odame, K. M. (2020) · doi:10.1109/sensysml50931.2020.00011 · Cited by 23
On-device Federated Learning with Flower
Mathur, A., Beutel, D. J., de Gusmão, P. P. B., Fernandez-Marques, J., Topal, T., Qiu, X., Parcollet, T., Gao, Y., & Lane, N. D. (2021) · arXiv · doi:10.48550/arxiv.2104.03042 · Cited by 22
Enabling Hyperparameter Tuning of Machine Learning Classifiers in Production
Sandha, S. S., Aggarwal, M., Saha, S. S., & Srivastava, M. B. (2021) · IEEE International Conference on Cognitive Machine Intelligence (CogMI) · doi:10.1109/cogmi52975.2021.00041 · Cited by 22
Self-citationTime Awareness in Deep Learning-Based Multimodal Fusion Across Smartphone Platforms
Sandha, S. S., Noor, J., Anwar, F. M., & Srivastava, M. B. (2020) · IEEE/ACM International Conference on Internet-of-Things Design and Implementation (IoTDI) · doi:10.1109/iotdi49375.2020.00022 · Cited by 21
Self-citationSTLnet: Signal Temporal Logic Enforced Multivariate Recurrent Neural Networks
Ma, M., Gao, J., Feng, L., & Stankovic, J. A. (2020) · neural information processing systems · Cited by 20
AttendNets: Tiny Deep Image Recognition Neural Networks for the Edge via Visual Attention Condensers
Wong, A., Famouri, M., & Shafiee, M. J. (2020) · arXiv · doi:10.48550/arxiv.2009.14385 · Cited by 20
Memory-Efficient, Limb Position-Aware Hand Gesture Recognition using Hyperdimensional Computing
Zhou, A., Muller, R., & Rabaey, J. (2021) · arXiv · doi:10.48550/arxiv.2103.05267 · Cited by 17
Imbal-OL: Online Machine Learning from Imbalanced Data Streams in Real-world IoT
Sudharsan, B., Breslin, J. G., & Ali, M. I. (2021) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata52589.2021.9671765 · Cited by 17
512KiB RAM Is Enough! Live Camera Face Recognition DNN on MCU
Zemlyanikin, M., Smorkalov, A., Khanova, T., Petrovicheva, A., & Serebryakov, G. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00305 · Cited by 16
RaScaNet: Learning Tiny Models by Raster-Scanning Images
Yoo, J., Lee, D., Son, C., Jung, S., Yoo, B., Choi, C., Han, J.-J., & Han, B. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01346 · Cited by 14
The Ramifications of Making Deep Neural Networks Compact
Jha, N. K., Mittal, S., & Mattela, G. (2019) · Research Archive of Indian Institute of Technology Hyderabad (Indian Institute of Technology Hyderabad) · Cited by 13
Deep Convolutional Bidirectional LSTM for Complex Activity Recognition with Missing Data
Saha, S. S., Sandha, S. S., & Srivastava, M. (2021) · Smart Innovation, Systems and Technologies · doi:10.1007/978-981-15-8269-1_4 · Cited by 12
Self-citationExploiting Smartphone Peripherals for Precise Time Synchronization
Sandha, S. S., Noor, J., Anwar, F. M., & Srivastava, M. B. (2019) · IEEE Global Conference on Signal and Information Processing · doi:10.1109/globalsip45357.2019.8969519 · Cited by 11
Self-citationAttendSeg: A Tiny Attention Condenser Neural Network for Semantic Segmentation on the EdgePreprint
Wen, X., Famouri, M., Hryniowski, A., & Wong, A. M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.14623 · Cited by 10
Doping: A technique for Extreme Compression of LSTM Models using Sparse Structured Additive Matrices
Thakker, U., Whatmough, P. N., Liu, Z. G., Mattina, M., & Beu, J. G. (2021) · Proceedings of Machine Learning and Systems · Cited by 9
IoT for COVID-19 Indoor Spread Prevention: Cough Detection, Air Quality Control and Contact Tracing
Petrović, N., & Kocić, Đ. (2021) · IEEE International Conference on Microelectronics (MIEL) · doi:10.1109/miel52794.2021.9569099 · Cited by 9
Compressing RNNs to Kilobyte Budget for IoT Devices Using Kronecker Products
Thakker, U., Fedorov, I., Zhou, C., Gope, D., Mattina, M., Dasika, G., & Beu, J. (2021) · ACM Journal on Emerging Technologies in Computing Systems · doi:10.1145/3440016 · Cited by 8
Hardy, E., & Badets, F. (2021) · arXiv · doi:10.48550/arxiv.2103.04792 · Cited by 6
Research works printed but not linked: 52
- 2022, X-CUBE-AI—AI Expansion Pack for STM32CubeMX—Stmicroelectronics
- goyal, 2020, DROCC: Deep robust one-class classification, Proc Int Conf Mach Learn, 3711
- morawiec, 2022, sklearn-porter
- 2021, Nanoedge AI Library
- 2022, Edge Ai/TinyML SAAS Deep Learning
- 2022, AI-Driven Deep Neural Network Optimizer
- tan, 2022, Utensor/Utensor TinyML Ai Inference Library
- dennis, 2019, Shallow RNN: Accurate time-series classification on resource constrained devices, Proc Adv Neural Inf Process Syst, 32, 1
- 2022, Edge Impulse
- 2022, Plumerai
- 2022, Qeexo Automl
- 2022, Sensiml Making Sensor Data Sensible
- 2022, Reality AI
- 2022, Neuton AI—No-Code Artificial Intelligence for All
- wang, 2019, Picking winning tickets before training by preserving gradient flow, Proc Int Conf Learn Represent, 1
- chen, 2020, Neural architecture search on ImageNet in four GPU hours: A theoretically inspired perspective, Proc Int Conf Learn Represent, 1
- tanaka, 2020, Pruning neural networks without any data by iteratively conserving synaptic flow, Proc Adv Neural Inf Process Syst, 33, 6377
- mellor, 2021, Neural architecture search without training, Proc Int Conf Mach Learn, 7588
- 10.1109/ICASSP40776.2020.9054609 · DOI
- daulton, 2022, Multi-objective Bayesian optimization over high-dimensional search spaces, Proc Conf Uncertainty of Artificial Intelligence, 507
- gupta, 2017, ProtoNN: Compressed and accurate KNN for resource-scarce devices, Proc Int Conf Mach Learn, 1331
- 2022, Microsoft/Nni An Open Source Automl Toolkit for Automate Machine Learning Lifecycle Including Feature Engineering Neural Architecture Search Model Compression and Hyper-Parameter Tuning
- bannink, 2021, Larq compute engine: Design, benchmark and deploy state-of-the-art binarized neural networks, Proc Mach Learn Syst, 3, 680
- tauzin, 2021, giotto-tda: A topological data analysis toolkit for machine learning and data exploration, J Mach Learn Res, 22, 1
- 10.1007/978-1-4615-4337-4 · doi:10.1007/978-1-4615-4337-4
- gielda, 2017, Renode: A flexible, open-source simulation framework for building scalable, well-tested RISC-V systems, Proc 7th RISC-V Workshop, 1
- jung, 2019, Imgaug documentation, Readthedocs io, 25, 1
- clark, 2015, Pillow (pil fork) documentation, Readthedocs io, 6 2 0, 1
- 2022, Eloquentarduino
- han, 2015, Learning both weights and connections for efficient neural network, Proc Adv Neural Inf Process Syst, 28, 1
- mcmahan, 2017, Communication-efficient learning of deep networks from decentralized data, Proc 20th Int Conf Artif Intell Statist, 1273
- 10.1109/VLSID.2019.00056 · DOI
- 10.1109/CVPR42600.2020.01079 · doi:10.1109/cvpr42600.2020.01079 · Paper page
- hubara, 2016, Binarized neural networks, Proc Adv Neural Inf Process Syst, 29, 1
- rusci, 2020, Memory-driven mixed low precision quantization for enabling deep network inference on microcontrollers, Proc Mach Learn Syst, 2, 326
- liberis, 2022, Differentiable network pruning to enable smart applications, Proc 4th U K Mobile Wearable Ubiquitous Syst Res Symp, 1
- 10.1109/ET52713.2021.9579991 · DOI
- baker, 2017, Designing neural network architectures using reinforcement learning, Proc Int Conf Learn Represent (ICLR), 1
- cai, 2018, ProxylessNAS: Direct neural architecture search on target task and hardware, Proc Int Conf Learn Represent, 1
- chen, 2018, Understanding the limitations of existing energy-efficient design approaches for deep neural networks, Energy, 2, 3l
- cranmer, 2020, Lagrangian neural networks, Proc ICLR WKSH Integr Deep Neural Models Differ Equ, 1
- mao, 2018, The neuro-symbolic concept learner: Interpreting scenes, words, and sentences from natural supervision, Proc Int Conf Learn Represent, 1
- li, 2021, FLASH: Fast neural architecture search with hardware optimization, ACM Trans Embedded Comput Syst, 20, 1, 10.1145/3477034 · doi:10.1145/3477034
- silver, 2014, Deterministic policy gradient algorithms, Proc Int Conf Mach Learn, 387
- elsken, 2018, Efficient multi-objective neural architecture search via Lamarckian evolution, Proc Int Conf Learn Represent, 1
- jose, 2018, Kronecker recurrent units, Proc Int Conf Mach Learn, 2380
- vaswani, 0, Attention is all you need, Proc Adv Neural Inf Process Syst, 2017, 5998
- lin, 2018, Defensive quantization: When efficiency meets robustness, Proc Int Conf Learn Represent, 1
- jagielski, 2020, High accuracy and high fidelity extraction of neural networks, Proc 29th USENIX Secur Symp (USENIX Secur ), 1345
- gui, 2019, Model compression with adversarial robustness: A unified optimization framework, Proc Adv Neural Inf Process Syst, 32, 1285
- cai, 2020, TinyTL: Reduce memory, not parameters for efficient on-device learning, Proc Adv Neural Inf Process Syst, 33, 1
- 10.3390/s21144805 · DOI
Cited by
A Comprehensive Survey on TinyML
Abadade, Y., Temouden, A., Bamoumen, H., Benamar, N., Chtouki, Y., & Hafid, A. S. (2023) · IEEE Access · doi:10.1109/access.2023.3294111 · Cited by 366
“The study in [29] presented a clear and complete closed-loop workflow for the development and deployment ofMLmodels for MCUs.”
BackgroundMethodInfluentialLamaakal, I., Ouahbi, I., El Makkaoui, K., Maleh, Y., Pławiak, P., & Alblehai, F. (2024) · IEEE Access · doi:10.1109/access.2024.3406631 · Cited by 34
“The emergence of TinyML [1], [2], [3], [4], [55], [56], [58], [60] represents a significant breakthrough in technology, blending the ever-growing needs of data-driven applications with the constraints of low-power, embedded devices.”
BackgroundEfficient Gesture-Based Recognition of Tifinagh Characters in Air Handwriting with a TinyDL Model
Lamaakal, I., El Mourabit, N., El Makkaoui, K., Ouahbi, I., & Maleh, Y. (2024) · 2024 Sixth International Conference on Intelligent Computing in Data Sciences (ICDS) · doi:10.1109/icds62089.2024.10756483 · Cited by 14
Metadata
- Authors
- Saha, S. S., Sandha, S. S., & Srivastava, M.
- Venue
- IEEE Sensors Journal
- Published
- 2022-11-15
- Volume
- 22
- Issue
- 22
- Pages
- 21362-21390
- ISSN
- 1530-437X (ISSN-L)
- 1558-1748
- 2379-9153
- OpenAlex
- W4309287541
- Cited by
- 253
- References
- 218
- FWCI
- 21.17
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- Funders
- National Institutes of Health (1P41EB028242)
- Army Research Laboratory (W911NF-17-2-0196)
- Semiconductor Research Corporation (S201617)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.