CoChat

On the Performance of One-Stage and Two-Stage Object Detectors in Autonomous Vehicles Using Camera Data

Open access
Carranza-García, Manuel, Torres-Mateo, Jesús, Lara-Benítez, Pedro, García-Gutiérrez, Jorge · 2020 · Remote Sensing

The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.

Abstract

Object detection using remote sensing data is a key task of the perception systems of self-driving vehicles. While many generic deep learning architectures have been proposed for this problem, there is little guidance on their suitability when using them in a particular scenario such as autonomous driving. In this work, we aim to assess the performance of existing 2D detection systems on a multi-class problem (vehicles, pedestrians, and cyclists) with images obtained from the on-board camera sensors of a car. We evaluate several one-stage (RetinaNet, FCOS, and YOLOv3) and two-stage (Faster R-CNN) deep learning meta-architectures under different image resolutions and feature extractors (ResNet, ResNeXt, Res2Net, DarkNet, and MobileNet). These models are trained using transfer learning and compared in terms of both precision and efficiency, with special attention to the real-time requirements of this context. For the experimental study, we use the Waymo Open Dataset, which is the largest existing benchmark. Despite the rising popularity of one-stage detectors, our findings show that two-stage detectors still provide the most robust performance. Faster R-CNN models outperform one-stage detectors in accuracy, being also more reliable in the detection of minority classes. Faster R-CNN Res2Net-101 achieves the best speed/accuracy tradeoff but needs lower resolution images to reach real-time speed. Furthermore, the anchor-free FCOS detector is a slightly faster alternative to RetinaNet, with similar precision and lower memory usage.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/rs13010089

Cites

46 of 46 references verified0 citation errors · 0 not checkable

Statistics

Figures

Image 1
CC-BY · From the PDF
Figure 1 Example camera images from the Waymo Open Dataset.
Figure 1 Example camera images from the Waymo Open Dataset.CC-BY · From the PDF
Image 3
CC-BY · From the PDF
Figure 3 Convolutional blocks of each feature extractor. F is the number of convolutional filters, C refers to the cardinality of the ResNeXt block and S is the scale dimension of Res2Net block.
Figure 3 Convolutional blocks of each feature extractor. F is the number of convolutional filters, C refers to the cardinality of the ResNeXt block and S is the scale dimension of Res2Net block.CC-BY · From the PDF
Figure 4 Inference time versus accuracy of low and high resolution models with different architectures and feature extractors. Low resolution models are always the left-most point of each line.
Figure 4 Inference time versus accuracy of low and high resolution models with different architectures and feature extractors. Low resolution models are always the left-most point of each line.CC-BY · From the PDF
Figure 5 Inference time versus accuracy of high-resolution models for each object class with difficulty level 2.
Figure 5 Inference time versus accuracy of high-resolution models for each object class with difficulty level 2.CC-BY · From the PDF

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Cited by

See all 270

Metadata

Authors
Carranza-García, M., Torres-Mateo, J., Lara-Benítez, P., & García-Gutiérrez, J.
Affiliations
  • Universidad de Sevilla (ES)
  • Division of Computer Science, University of Sevilla, ES-41012 Seville, Spain
Corresponding author
Carranza-García, Manuel
Venue
Remote Sensing
Publisher
MDPI AG
Published
2020-12-29
Volume
13
Issue
1
Pages
89
ISSN
2072-4292 (ISSN-L)
OpenAlex
W3113769242
Cited by
270
References
40
Citations by year
2026: 34 · 2025: 62 · 2024: 75 · 2023: 42 · 2022: 40 · 2021: 17
FWCI
9.63
Type
journal article
Language
en
Open access
Locations
  • Remote Sensing (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Deposito de Investigacion Universidad de Sevilla (University of Seville) (submittedVersion, cc-by-nc-nd)
Funders
  • Junta de Andalucía (US-126334, P18-RT-2778)
  • Ministerio de Economía y Competitividad (TIN2017-88209-C2-2-R)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
Keywords
object detection, autonomous vehicles, one-stage detectors, two-stage detection, Faster R-CNN, RetinaNet, YOLOv3, FCOS, vehicle detection, pedestrian detection, cyclist detection, feature extractor, speed-accuracy trade-off, Waymo Open Dataset, real-time detection

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.