CoChat

FANN-on-MCU: An Open-Source Toolkit for Energy-Efficient Neural Network Inference at the Edge of the Internet of Things

Open access
Wang, Xiaying, Magno, Michele, Cavigelli, Lukas, Benini, Luca · 2020 · IEEE Internet of Things Journal

The DOI matches its Crossref record; 58 of the 59 references it cites were found in a registry or an index.

Abstract

The growing number of low-power smart devices in the Internet of Things is coupled with the concept of “edge computing” that is moving some of the intelligence, especially machine learning, toward the edge of the network. Enabling machine learning algorithms to run on resource-constrained hardware, typically on low-power smart devices, is challenging in terms of hardware (optimized and energy-efficient integrated circuits), algorithmic, and firmware implementations. This article presents a FANN-on-MCU, an open-source toolkit built upon the fast artificial neural network (FANN) library to run lightweight and energy-efficient neural networks on microcontrollers based on both the ARM Cortex-M series and the novel RISC-V-based parallel ultralow-power (PULP) platform. The toolkit takes multilayer perceptrons trained with FANN and generates code targeted to low-power microcontrollers. This article also presents detailed analyses of energy efficiency across the different cores, and the optimizations to handle different network sizes. Moreover, it provides a detailed analysis of parallel speedups and degradations due to parallelization overhead and memory transfers. Further evaluations include experimental results for three different applications using a self-sustainable wearable multisensor bracelet. The experimental results show a measured latency in the order of only a few microseconds and power consumption of a few milliwatts while keeping the memory requirements below the limitations of the targeted microcontrollers. In particular, the parallel implementation on the octa-core RISC-V platform reaches a speedup of 22× and a 69% reduction in energy consumption with respect to a single-core implementation on Cortex-M4 for continuous real-time classification.

Overview

Integrity signals

Registry

Crossref · 10.1109/jiot.2020.2976702

Cites

58 of 58 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

The text we found for this paper looks like another document, so its claims and self-check weren’t run. The registry and citation checks still apply.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The text we found for this paper looks like another document, so the self-check wasn’t run.

Citations

Cites

Show all 58 references

Research works printed but not linked: 3

  1. 2019, MYO Gesture Control Armband—Wearable Technology by Thalmic Labs
  2. 2017, CMSIS-Cortex Microcontroller Software Interface Standard
  3. kuyumcu, 2007, FANN Tool

Cited by

See all 162

Metadata

Authors
Wang, X., Magno, M., Cavigelli, L., & Benini, L.
Affiliations
ETH Zurich (CH)
Venue
IEEE Internet of Things Journal
Published
2020-05
Volume
7
Issue
5
Pages
4403-4417
ISSN
  • 2327-4662 (ISSN-L)
  • 2372-2541
OpenAlex
W3007729836
Cited by
162
References
59
Citations by year
2026: 12 · 2025: 18 · 2024: 18 · 2023: 32 · 2022: 33 · 2021: 34 · 2020: 15
FWCI
13.39
Type
journal article
Language
en
Open access
Locations
  • IEEE Internet of Things Journal (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • Archivio istituzionale della ricerca (Alma Mater Studiorum Università di Bologna) (submittedVersion, other-oa)
  • arXiv (Cornell University)
Funders
  • Swiss Data Science Center Ph.D. Fellowship (ID P18-04)
  • U.S. Office of Naval Research Global “Zero-Power Sensing for Underwater Monitoring,” (ONRG - NICOP - N62909-19-1-2018)
  • Armasuisse Science and Technology
Topics
  • Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
  • Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
Keywords
edge computing, Internet of Things, microcontroller, ARM Cortex-M, RISC-V, multilayer perceptron, code generation, parallelization overhead, memory transfer, real-time classification

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: FANN-on-MCU: An Open-Source Toolkit for Energy-Efficient Neural Network Inference at the Edge of the Internet of Things. https://app.cochat.ai/papers/10.1109/jiot.2020.2976702
The paper
Wang, X., Magno, M., Cavigelli, L., & Benini, L. (2020). FANN-on-MCU: An Open-Source Toolkit for Energy-Efficient Neural Network Inference at the Edge of the Internet of Things. IEEE Internet of Things Journal. https://doi.org/10.1109/jiot.2020.2976702

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.