Cited by 57Advanced Neural Network ApplicationsAutonomous Vehicle Technology and SafetyEmbedded Systems and FPGA Design

Robustifying the Deployment of tinyML Models for Autonomous mini-vehicles

Open access
de Prado, Miguel, Rusci, Manuele, Capotondi, Alessandro, Donze, Romain, Benini, Luca, Pazos, Nuria·2021·Sensors

Abstract

Standard-sized autonomous vehicles have rapidly improved thanks to the breakthroughs of deep learning. However, scaling autonomous driving to mini-vehicles poses several challenges due to their limited on-board storage and computing capabilities. Moreover, autonomous systems lack robustness when deployed in dynamic environments where the underlying distribution is different from the distribution learned during training. To address these challenges, we propose a closed-loop learning flow for autonomous driving mini-vehicles that includes the target deployment environment in-the-loop. We leverage a family of compact and high-throughput tinyCNNs to control the mini-vehicle that learn by imitating a computer vision algorithm, i.e., the expert, in the target environment. Thus, the tinyCNNs, having only access to an on-board fast-rate linear camera, gain robustness to lighting conditions and improve over time. Moreover, we introduce an online predictor that can choose between different tinyCNN models at runtime-trading accuracy and latency-which minimises the inference's energy consumption by up to 3.2×. Finally, we leverage GAP8, a parallel ultra-low-power RISC-V-based micro-controller unit (MCU), to meet the real-time inference requirements. When running the family of tinyCNNs, our solution running on GAP8 outperforms any other implementation on the STM32L4 and NXP k64f (traditional single-core MCUs), reducing the latency by over 13× and the energy consumption by 92%.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/s21041339

Cites

49 of 49 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • In [34], VNN3, VNN4, and LeNet5 models reach an accuracy of 98.74% on reinforced dataset Dset-All (I1, I2, and I3).

    “The results obtained VNN3, VNN4, and LeNet5 models reach an accuracy of 98.74% on the reinforced dataset Dset-All (I1, I2, and I3) by using”

    From TinyML: Enabling of Inference Deep Learning Models on Ultra-Low-Power IoT Edge Devices for AI Applications (2022) · cites this paper as [34]

    Section 5.1 (page unavailable) reports results for VNN3, VNN4, and LeNet5 after training on a reinforced dataset, but their respective accuracies are 94.1%, 97.4%, and 98.3% on the Dset-1.0 test set—not 98.74% on Dset-All. The same section describes Dset-All as a combined training dataset, distinct from the later reinforced dataset. (LLM, conf=0.91)

    Experimental — accuracy not yet measured
  • The TinyML approach is deployed on the GAP8 MCI based on the convolution neural network framework.

    “It is deployed on the GAP8 MCI based on the convolution neural network framework.”

    From A review on TinyML: State-of-the-art and prospects (2022) · cites this paper as de Prado et al., 2021

  • TinyML approach is investigated to seek improvement of autonomous driving of low-scale mini vehicles.

    “TinyML approach is investigated to seek for improvement of autonomous driving of such mini vehicles (de Prado et al., 2021).”

    From A review on TinyML: State-of-the-art and prospects (2022) · cites this paper as de Prado et al., 2021

  • The TinyML approach is also tested on the STM32L4 and NXP k64f platforms.

    “It is also tested on the STM32L4 and NXP k64f platforms.”

    From A review on TinyML: State-of-the-art and prospects (2022) · cites this paper as de Prado et al., 2021

  • Results show that the integration minimizes processing latency by 13x and improves energy consumption by 92%.

    “Results show that the integration minimizes processing latency by 13x and improves energy consumption by 92%.”

    From A review on TinyML: State-of-the-art and prospects (2022) · cites this paper as de Prado et al., 2021

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

2 of the 51 references couldn’t be matched to a known paper.

Research works printed but not linked: 4

  1. [23]ICML 2018: Imitation Learning Tutorial 2018 Available online: https://sites.google.com/view/icml2018-imitation-learning/ (accessed on 30 December 2020)
  2. [37]O’Kelly M. Sukhil V. Abbas H. Harkins J. Kao C. Pant Y.V. Mangharam R. Agarwal D. Behl M. Burgio P. F1/10: An Open-Source Autonomous Cyber-Physical Platform arXiv 2019 1901.08567
  3. [41]Jacob B. gemmlowp: A small self-contained low-precision GEMM library arXiv 2017 1903.01061
  4. [43]Lai L. Suda N. Chandra V. Cmsis-nn: Efficient neural network kernels for Arm cortex-m cpus arXiv 2018 1801.06601

Cited by

Sorted by citations

Authors
de Prado, M., Rusci, M., Capotondi, A., Donze, R., Benini, L., & Pazos, N.
Affiliations
  • He-Arc Ingenierie, HES-SO, 2800 Delemont, Switzerland
  • University of Bologna (IT)
  • University of Modena and Reggio Emilia (IT)
  • HES-SO University of Applied Sciences and Arts Western Switzerland (CH)
  • Integrated System Lab, ETH Zurich, 8092 Zurich, Switzerland
Corresponding author
Rusci, Manuele
Venue
Sensors
Publisher
MDPI AG
Published
2021-02-13
Volume
21
Issue
4
Pages
1339
ISSN
1424-8220 (ISSN-L)
OpenAlex
W3129911950
Cited by
57
References
51
Citations by year
2026: 8 · 2025: 9 · 2024: 13 · 2023: 9 · 2022: 15 · 2021: 3
FWCI
3.60
Type
journal article
Language
en
Open access
Locations
  • Sensors (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • IRIS UNIMORE (University of Modena and Reggio Emilia) (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • ArODES (HES-SO (https://www.hes-so.ch/)) (submittedVersion)
  • Repository for Publications and Research Data (ETH Zurich) (submittedVersion, cc-by)
  • ETH Zürich Research Collection (cc-by)
Funders
  • Horizon 2020 Framework Programme (732204)
  • Swiss State Secretariat for Education, Research and Innovation (16.0159)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
  • Physical Sciences › Engineering › Control and Systems Engineering › Embedded Systems and FPGA Design
Keywords
TinyML, distribution shift robustness, online model selection, energy-efficient inference, ultra-low-power microcontroller, RISC-V, onboard camera, autonomous driving, latency trade-off

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review