CoChat

Optimized Convolutional Neural Network at the IoT edge for image detection using pruning and quantization

Open access
Naveen, Soumyalatha, Kounte, Manjunath R · 2024 · Multimedia Tools and Applications

The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index; 5 of the 8 sources its claims cite were checked for support.

Abstract

Most real-time computer vision applications heavily rely on Convolutional Neural Network (CNN) based models, for image classification and recognition. Due to the computationally and memory-intensive nature of the CNN model, it’s challenging to deploy on resource-constrained Internet of Things (IoT) devices to enable Edge intelligence for real-time decision-making. Edge intelligence requires minimum inference latency, memory footprint, and energy-efficient model. This work aims to develop an energy-efficient deep learning accelerator using a 3-stage pipeline: Training, Weight-pruning, and Quantization to reduce the model size and optimize the resources. First, we employ YOLOv3, a CNN architecture to detect objects in an image on the trained data. In addition, a sparse network of YOLO has been created by using pruning, which helps to improve the network’s performance and efficiency by reducing the computational requirements. Finally, we utilize 8-bit quantization to reduce the precision of the weights and activations, in a neural network. The evaluation of our proposed model shows that combining pruning and 8-bit quantization improves the efficiency and performance of the model. While pruning shows a decline of 80.39% in model parameters. The combination of 8-bit quantization results in an improvement in inference latency by 22.72% compared to existing SQuantization approach and a reduction of energy consumption by 29.41%.

Overview

CoChat Summary

TL;DR

The paper proposes a three-stage pipeline—training, pruning, and 8-bit k-means quantization—to compress a YOLOv3-SPP object detector for IoT edge deployment on COCO2017. It reports reduced parameters, lower inference latency, and 29.41% lower energy consumption while maintaining mAP@0.5 around 61.86%.

Key findings

  • Pruning at an 80% ratio reduced parameters from 62,998,749 to 12,350,941 (abstract reports an 80.39% decline) and channels from 13,376 to 3,535/3,536 (actual pruning ratio 0.736), while mAP@0.5 increased from 61% to 61.85%; precision was 0.6970, recall 0.74, and F1 0.7178.
  • Adding 8-bit k-means quantization yielded mAP 61.86% (61.8676%), inference latency of 17 ms, and a 29.41% reduction in energy consumption; the abstract also reports a 22.72% inference-latency improvement compared with SQuantization.
  • The baseline YOLOv3-SPP on COCO2017 had inference speeds of 22 ms for 416×416 and 43 ms for 608×608; training validation loss decreased from 14.5 to 6.27 for 416×416 and from 12.7 to 4.95 for 608×608, with mAP increasing to 57.3% and 61%, respectively.

Methods

  • Three-stage pipeline: initial training of pretrained YOLOv3-SPP on COCO2017; channel/weight pruning with sparsity 0.1 and pruning ratios up to 80%, performed without retraining; then 8-bit integer uniform quantization using k-means clustering on pruned weights.
  • Data and setup: COCO2017 (118k train, 40.7k test, 5k validation; 80 object categories), input sizes 416×416 and 608×608, baseline batch size 16 and 100 epochs; quantization algorithm uses bit width 8, batch size 64, and 10 epochs. Hardware included Nvidia V100 Tensor Core GPUs and an Intel i5 8th-generation CPU; implementation used PyTorch, NumPy, Matplotlib, and scikit-learn.
  • Main analysis: mAP@0.5, precision, recall, F1, parameter count, inference latency, and energy consumption, with comparison against SQuantization.

Limitations

  • The paper does not state a dedicated limitations section. It explicitly notes that pruning is performed without retraining, which may constrain accuracy recovery.
  • Evident from the text: evaluation is limited to COCO2017 and YOLOv3-SPP, and training/testing used Nvidia V100 and Intel i5 hardware rather than resource-constrained IoT/edge devices, so edge-deployment claims are not directly validated on such hardware.
  • Evident from the text: some reported numbers are inconsistent—e.g., pruning ratio described as 80% but actual 73.6%, channels 3,535 vs 3,536, and Table 9 before-pruning mAP 0.702388 vs text 61%—which complicates interpretation.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1007/s11042-024-20523-1

Cites

43 of 43 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

3 Valid · 9 Not valid · 3 Not checked · 46 Own results and interpretations

32 more claims

Create a free account to see all 61 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 15
  • Borderline: one of the tests for a substantial claim is unclear. 2
  • It may state two separate claims as one. 12
  • The quote only partly states this claim. 3

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

2 of 2

Citations

Cites

Show all 43 references

Research works printed but not linked: 2

  1. Maini DS, Aggarwal AK (2018) Camera position estimation using 2D image dataset. Int J Innov Eng Technol 10(2):199-203. http://dx.doi.org/10.21172/ijiet.102.29 · doi:10.21172/ijiet.102.29
  2. Aggarwal AK (2015) A hybrid approach to GPS improvement in urban canyons? Int J Eng Sci Res Technol 4(10):358–363

Cited by

See all 33

Metadata

Authors
Naveen, S., & Kounte, M. R.
Affiliations
  • Manipal Academy of Higher Education (IN)
  • REVA University (IN)
Corresponding author
Naveen, Soumyalatha
Venue
Multimedia Tools and Applications
Published
2024-12-26
Volume
84
Issue
9
Pages
5435-5455
ISSN
  • 1380-7501 (ISSN-L)
  • 1573-7721
OpenAlex
W4405783794
Cited by
33
References
40
Citations by year
2026: 21 · 2025: 12
FWCI
4.61
Type
journal article
Language
en
Open access
Licence
Locations
Multimedia Tools and Applications (publishedVersion, cc-by)
Funders
Manipal Academy of Higher Education, Manipal
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
Keywords
convolutional neural networks, edge AI, weight pruning, 8-bit quantization, YOLOv3, object detection, energy-efficient inference, inference latency, model compression, sparse neural networks

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Optimized Convolutional Neural Network at the IoT edge for image detection using pruning and quantization. https://app.cochat.ai/papers/10.1007/s11042-024-20523-1
The paper
Naveen, S., & Kounte, M. R. (2024). Optimized Convolutional Neural Network at the IoT edge for image detection using pruning and quantization. Multimedia Tools and Applications. https://doi.org/10.1007/s11042-024-20523-1

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.