Cited by 7Advanced Neural Network ApplicationsDomain Adaptation and Few-Shot LearningPower Line Inspection Robots

Sim-to-Real Transfer for Object Detection in Aerial Inspections of Transmission Towers

Open access
Peterlevitz, Augusto J., Chinelatto, Mateus A., Menezes, Angelo G., Motta, Cézanne A. M., Pereira, Guilherme A. B., Lopes, Gustavo L., Souza, Gustavo De M., Rodrigues, Juan +8 more·2023·IEEE Access

Abstract

Training deep learning models for object detection usually requires a large amount of data, a condition that is not common for most real-world applications, especially in the context of aerial imagery. One possible solution is the use of simulators to generate synthetic data. For a good generalization, the model must be able to learn on the simulated data and perform correctly on the real data, process known as sim-to-real transfer. In this work, we analyze the generation of synthetic data to account for a data-scarce real-world scenario, which includes aerial imagery and object detection of transmission towers and their components. We evaluate the impact of image-to-image translation methods as domain adaptation techniques. In this analysis, we explore training strategies to mitigate the domain shift between synthetic and real data. According to our experimental results, the use of domain-adapted data through image-to-image translation could slightly improve the detection performance in real test data when compared to training with raw synthetic images only or with small datasets of real data, although it was noted through a visual analysis that objects with small bounding boxes, like clamp, anchoring clamp and ball link, could be distorted or vanished by the application of image-to-image translation methods. Additionally, when only a small subset of real data is available, training with both real and synthetic data at once led to better detection results, surpassing combinations of pre-training on synthetic and fine-tuning on real data.

Integrity signals

Registry

Crossref · 10.1109/access.2023.3322374

Cites

48 of 48 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Cites

Flagged first, then by citations

1 of the 49 references couldn’t be matched to a known paper.

Research works printed but not linked: 4

  1. 2023, Unreal Engine
  2. 2018, Blender—A 3D Modelling and Rendering Package
  3. goodfellow, 2016, Deep Learning
  4. jocher, 2023, ultralytics yolov5

Cited by

Sorted by citations

Authors
Peterlevitz, A. J., Chinelatto, M. A., Menezes, A. G., Motta, C. A. M., Pereira, G. A. B., Lopes, G. L., Souza, G. D. M., Rodrigues, J., Godoy, L. C., Koller, M. A. F. F., Cabral, M. O., Alves, N. E., Silva, P. H., Cherobin, R., Yamamoto, R. A. O., & Silva, R. D. D.
Affiliations
  • Instituto de Pesquisas Eldorado (BR)
  • Universidade de São Paulo (BR)
  • Computer Vision Department, Eldorado Research Institute, Campinas, São Paulo, Brazil
Venue
IEEE Access
Published
2023
Volume
11
Pages
110312-110327
ISSN
2169-3536 (ISSN-L)
OpenAlex
W4387385679
Cited by
7
References
49
Citations by year
2026: 1 · 2025: 5 · 2024: 1
FWCI
0.63
Type
journal article
Language
en
Open access
Locations
  • IEEE Access (publishedVersion, cc-by-nc-nd)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
Transmissora Aliança de Energia Elétrica S.A. (TAESA) through Agência Nacional de Energia Elétrica (ANEEL) Research and Development Program (PD-07130-0059/2020)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
  • Physical Sciences › Engineering › Mechanical Engineering › Power Line Inspection Robots
Keywords
sim-to-real transfer, object detection, aerial imagery, transmission towers, synthetic data generation, domain adaptation, image-to-image translation, domain shift, data scarcity, aerial inspection, pre-training and fine-tuning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review