The DOI matches its Crossref record; 213 of the 213 references it cites were found in a registry or an index.
Machine Learning for Microcontroller-Class Hardware: A Review
Open accessAbstract
The advancements in machine learning opened a new opportunity to bring intelligence to the low-end Internet-of-Things nodes such as microcontrollers. Conventional machine learning deployment has high memory and compute footprint hindering their direct deployment on ultra resource-constrained microcontrollers. This paper highlights the unique requirements of enabling onboard machine learning for microcontroller class devices. Researchers use a specialized model development workflow for resource-limited applications to ensure the compute and latency budget is within the device limits while still maintaining the desired performance. We characterize a closed-loop widely applicable workflow of machine learning model development for microcontroller class devices and show that several classes of applications adopt a specific instance of it. We present both qualitative and numerical insights into different stages of model development by showcasing several use cases. Finally, we identify the open research challenges and unsolved questions demanding careful considerations moving forward.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
SciPy 1.0: fundamental algorithms for scientific computing in Python
Virtanen, P., Gommers, R., Oliphant, T. E., Haberland, M., Reddy, T., Cournapeau, D., Burovski, E., Peterson, P., Weckesser, W., Bright, J., et al. (2020) · Nature Methods · doi:10.1038/s41592-019-0686-2 · Cited by 38,430
(2008) · Journal of Machine Learning Research · Cited by 33,051
MobileNetV2: Inverted Residuals and Linear Bottlenecks
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., & Chen, L.-C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00474 · Cited by 28,755
Research works printed but not linked: 56
- 2022, X-CUBE-AI—AI Expansion Pack for STM32CubeMX—Stmicroelectronics
- goyal, 2020, DROCC: Deep robust one-class classification, Proc Int Conf Mach Learn, 3711
- morawiec, 2022, sklearn-porter
- 2021, Nanoedge AI Library
- 2022, Edge Ai/TinyML SAAS Deep Learning
- 2022, AI-Driven Deep Neural Network Optimizer
- tan, 2022, Utensor/Utensor TinyML Ai Inference Library
- dennis, 2019, Shallow RNN: Accurate time-series classification on resource constrained devices, Proc Adv Neural Inf Process Syst, 32, 1
- 2022, Edge Impulse
- 2022, Plumerai
- 2022, Qeexo Automl
- 2022, Sensiml Making Sensor Data Sensible
- 2022, Reality AI
- 2022, Neuton AI—No-Code Artificial Intelligence for All
- wang, 2019, Picking winning tickets before training by preserving gradient flow, Proc Int Conf Learn Represent, 1
- chen, 2020, Neural architecture search on ImageNet in four GPU hours: A theoretically inspired perspective, Proc Int Conf Learn Represent, 1
- tanaka, 2020, Pruning neural networks without any data by iteratively conserving synaptic flow, Proc Adv Neural Inf Process Syst, 33, 6377
- mellor, 2021, Neural architecture search without training, Proc Int Conf Mach Learn, 7588
- 10.1109/ICASSP40776.2020.9054609 · doi:10.1109/icassp40776.2020.9054609
- daulton, 2022, Multi-objective Bayesian optimization over high-dimensional search spaces, Proc Conf Uncertainty of Artificial Intelligence, 507
- gupta, 2017, ProtoNN: Compressed and accurate KNN for resource-scarce devices, Proc Int Conf Mach Learn, 1331
- 2022, Microsoft/Nni An Open Source Automl Toolkit for Automate Machine Learning Lifecycle Including Feature Engineering Neural Architecture Search Model Compression and Hyper-Parameter Tuning
- bannink, 2021, Larq compute engine: Design, benchmark and deploy state-of-the-art binarized neural networks, Proc Mach Learn Syst, 3, 680
- tauzin, 2021, giotto-tda: A topological data analysis toolkit for machine learning and data exploration, J Mach Learn Res, 22, 1
- david, 2021, TensorFlow Lite Micro: Embedded machine learning for TinyML systems, Proc Mach Learn Syst, 3, 1
- 10.1007/978-1-4615-4337-4 · doi:10.1007/978-1-4615-4337-4
- gielda, 2017, Renode: A flexible, open-source simulation framework for building scalable, well-tested RISC-V systems, Proc 7th RISC-V Workshop, 1
- jung, 2019, Imgaug documentation, Readthedocs io, 25, 1
- clark, 2015, Pillow (pil fork) documentation, Readthedocs io, 6 2 0, 1
- 2022, Eloquentarduino
- han, 2015, Learning both weights and connections for efficient neural network, Proc Adv Neural Inf Process Syst, 28, 1
- mcmahan, 2017, Communication-efficient learning of deep networks from decentralized data, Proc 20th Int Conf Artif Intell Statist, 1273
- 10.1109/VLSID.2019.00056 · doi:10.1109/vlsid.2019.00056
- 10.1109/CVPR42600.2020.01079 · doi:10.1109/cvpr42600.2020.01079 · Paper page
- hubara, 2016, Binarized neural networks, Proc Adv Neural Inf Process Syst, 29, 1
- rusci, 2020, Memory-driven mixed low precision quantization for enabling deep network inference on microcontrollers, Proc Mach Learn Syst, 2, 326
- liberis, 2022, Differentiable network pruning to enable smart applications, Proc 4th U K Mobile Wearable Ubiquitous Syst Res Symp, 1
- 10.1109/ET52713.2021.9579991 · DOI
- baker, 2017, Designing neural network architectures using reinforcement learning, Proc Int Conf Learn Represent (ICLR), 1
- cai, 2018, ProxylessNAS: Direct neural architecture search on target task and hardware, Proc Int Conf Learn Represent, 1
- chen, 2018, Understanding the limitations of existing energy-efficient design approaches for deep neural networks, Energy, 2, 3l
- cranmer, 2020, Lagrangian neural networks, Proc ICLR WKSH Integr Deep Neural Models Differ Equ, 1
- mao, 2018, The neuro-symbolic concept learner: Interpreting scenes, words, and sentences from natural supervision, Proc Int Conf Learn Represent, 1
- li, 2021, FLASH: Fast neural architecture search with hardware optimization, ACM Trans Embedded Comput Syst, 20, 1, 10.1145/3477034 · doi:10.1145/3477034
- silver, 2014, Deterministic policy gradient algorithms, Proc Int Conf Mach Learn, 387
- liu, 2018, DARTS: Differentiable architecture search, Proc Int Conf Learn Represent, 1
- elsken, 2018, Efficient multi-objective neural architecture search via Lamarckian evolution, Proc Int Conf Learn Represent, 1
- jose, 2018, Kronecker recurrent units, Proc Int Conf Mach Learn, 2380
- vaswani, 0, Attention is all you need, Proc Adv Neural Inf Process Syst, 2017, 5998
- lin, 2018, Defensive quantization: When efficiency meets robustness, Proc Int Conf Learn Represent, 1
- jagielski, 2020, High accuracy and high fidelity extraction of neural networks, Proc 29th USENIX Secur Symp (USENIX Secur ), 1345
- gui, 2019, Model compression with adversarial robustness: A unified optimization framework, Proc Adv Neural Inf Process Syst, 32, 1285
- howard, 2017, MobileNets: Efficient convolutional neural networks for mobile vision applications, arXiv 1704 04861
- cai, 2020, TinyTL: Reduce memory, not parameters for efficient on-device learning, Proc Adv Neural Inf Process Syst, 33, 1
- wong, 2020, AttendNets: Tiny deep image recognition neural networks for the edge via visual attention condensers, Proc 6th WKSH Energy Efficient Mach Learn Cognit Comput (EMC2), 1
- 10.3390/s21144805 · DOI
Cited by
A Comprehensive Survey on TinyML
Abadade, Y., Temouden, A., Bamoumen, H., Benamar, N., Chtouki, Y., & Hafid, A. S. (2023) · IEEE Access · doi:10.1109/access.2023.3294111 · Cited by 366
“The study in [29] presented a clear and complete closed-loop workflow for the development and deployment ofMLmodels for MCUs.”
BackgroundMethodInfluentialLamaakal, I., Ouahbi, I., El Makkaoui, K., Maleh, Y., Pławiak, P., & Alblehai, F. (2024) · IEEE Access · doi:10.1109/access.2024.3406631 · Cited by 34
Efficient Gesture-Based Recognition of Tifinagh Characters in Air Handwriting with a TinyDL Model
Lamaakal, I., El Mourabit, N., El Makkaoui, K., Ouahbi, I., & Maleh, Y. (2024) · 2024 Sixth International Conference on Intelligent Computing in Data Sciences (ICDS) · doi:10.1109/icds62089.2024.10756483 · Cited by 14
Metadata
- Authors
- Saha, S. S., Sandha, S. S., & Srivastava, M.
- Venue
- IEEE Sensors Journal
- Published
- 2022-11-15
- Volume
- 22
- Issue
- 22
- Pages
- 21362-21390
- ISSN
- 1530-437X (ISSN-L)
- 1558-1748
- 2379-9153
- OpenAlex
- W4309287541
- Cited by
- 253
- References
- 213
- FWCI
- 21.17
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- Funders
- National Institutes of Health (1P41EB028242)
- Army Research Laboratory (W911NF-17-2-0196)
- Semiconductor Research Corporation (S201617)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Machine Learning for Microcontroller-Class Hardware: A Review. https://app.cochat.ai/papers/10.1109/jsen.2022.3210773
- The paper
- Saha, S. S., Sandha, S. S., & Srivastava, M. (2022). Machine Learning for Microcontroller-Class Hardware: A Review. IEEE Sensors Journal. https://doi.org/10.1109/jsen.2022.3210773
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.