Cited by 141Power Line Inspection RobotsInfrastructure Maintenance and MonitoringThermal Analysis in Power Transmission

Fault Detection in Power Equipment via an Unmanned Aerial System Using Multi Modal Data

Open access
Jalil, Bushra, Leone, Giuseppe Riccardo, Martinelli, Massimo, Moroni, Davide, Pascali, Maria Antonietta, Berton, Andrea·2019·Sensors

Abstract

The power transmission lines are the link between power plants and the points of consumption, through substations. Most importantly, the assessment of damaged aerial power lines and rusted conductors is of extreme importance for public safety; hence, power lines and associated components must be periodically inspected to ensure a continuous supply and to identify any fault and defect. To achieve these objectives, recently, Unmanned Aerial Vehicles (UAVs) have been widely used; in fact, they provide a safe way to bring sensors close to the power transmission lines and their associated components without halting the equipment during the inspection, and reducing operational cost and risk. In this work, a drone, equipped with multi-modal sensors, captures images in the visible and infrared domain and transmits them to the ground station. We used state-of-the-art computer vision methods to highlight expected faults (i.e., hot spots) or damaged components of the electrical infrastructure (i.e., damaged insulators). Infrared imaging, which is invariant to large scale and illumination changes in the real operating environment, supported the identification of faults in power transmission lines; while a neural network is adapted and trained to detect and classify insulators from an optical video stream. We demonstrate our approach on data captured by a drone in Parma, Italy.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/s19133014

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Publications [4,5,6,7,8,9,10] address techniques for carrying out preventive inspections on transmission lines using RPASs with thermal cameras, demonstrating the importance of using this technology and the impact of using aircraft to carry out inspections.

    “Publications [4,5,6,7,8,9,10] address techniques for carrying out preventive inspections on transmission lines using RPASs with thermal cameras, demonstrating the importance of using this technology and the impact of using aircraft to carry out inspections.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 30

  1. [1]Asiegbu G.O. Haidar A.M.A. Hawari K. A Review of Defect Detection on Electrical Components Using Image Processing Technology Proceedings of the Fourth International Conference on Signal and Image Processing 2012 (ICSIP 2012); Lecture Notes in Electrical Engineering Springer New Delhi, India 2013 Volume 221
  2. [2]Jadin M.S. Taib S. Kabir S. Yusof M.A.B. Image Processing Methods for Evaluating Infrared Thermographic Image of Electrical Equipments Proceedings of the Progress in Electromagnetics Research Symposium Proceedings Marrakesh, Morocco 20–23 March 2011
  3. [3]Xie X. Liu Z. Xu C. Zhang Y. A Multiple Sensors Platform Method for Power Line Inspection Based on a Large Unmanned Helicopter Sensors 2017 6 1222 10.3390/s17061222 28587114 PMC5492564 · DOI
  4. [4]Katrasnik J. Pernus F. Likar B. A Survey of Mobile Robots for Distribution Power Line Inspection IEEE Trans. Power Deliv. 2010 25 485 493 10.1109/TPWRD.2009.2035427 · DOI
  5. [5]Qin X. Wu G. Lei J. Fan F. Ye X. Mei Q. A Novel Method of Autonomous Inspection for Transmission Line based on Cable Inspection Robot LiDAR Data Sensors 2018 18 596 10.3390/s18020596 29462865 PMC5855922 · DOI
  6. [6]Li Z. Liu Y. Walker R. Hayward R. Zhang J. Towards automatic power line detection for a UAV surveillance system using pulse coupled neural filter and an improved Hough transform Mach. Vis. Appl. 2010 21 677 686 10.1007/s00138-009-0206-y · DOI
  7. [7]Candamo J. Kasturi R. Goldgof D. Sarkar S. Detection of thin lines using low-quality video from low-altitude aircraft in urban settings IEEE Trans. Aerosp. Electron. Syst. 2009 45 937 949 10.1109/TAES.2009.5259175 · DOI
  8. [8]Jalil B. Moroni D. Pascali M. Salvetti O. Multimodal image analysis for power line inspection Proceedings of the International Conference on Pattern Recognition and Artificial Intelligence Montreal, QC, Canada 13–17 May 2018
  9. [9]Mirallès F. Pouliot N. Montambault S. State-of-the-art review of computer vision for the management of power transmission lines Proceedings of the 2014 3rd International Conference on Applied Robotics for the Power Industry (CARPI) Foz do Iguassu, Brazil 14–16 October 2014 1 6
  10. [10]Zhang J. Liu L. Wang B. Chen X. Wang Q. Zheng T. High speed automatic power line detection and tracking for a UAV-based inspection Proceedings of the 2012 International Conference on Industrial Control and Electronics Engineering (ICICEE) Xi’an, China 23–25 August 2012 266 269
  11. [11]Sampedro C. Martinez C. Chauhan A. Campoy P. A supervised approach to electric tower detection and classification for power line inspection Proceedings of the 2014 International Joint Conference on Neural Networks (IJCNN) Beijing, China 6–11 July 2014 1970 1977
  12. [12]Wronkowicz A. Vision Diagnostics of Power Transmission Lines: Approach to Recognition of Insulators Proceedings of the 9th International Conference on Computer Recognition Systems CORES 2015 Wroclaw, Poland 25–27 May 2015 Springer Cham, Switzerland 2016 431 440
  13. [13]Yan T. Yang G. Yu J. Feature fusion based insulator detection for aerial inspection Proceedings of the 2017 36th Chinese Control Conference (CCC) Dalian, China 26–28 July 2017 10972 10977
  14. [14]Zhao Z. Liu N. The recognition and localization of insulators adopting SURF and IFS based on correlation coefficient Opt. Int. J. Light Electron Opt. 2014 125 6049 6052 10.1016/j.ijleo.2014.06.094 · DOI
  15. [15]Zhao Z. Liu N. Wang L. Localization of multiple insulators by orientation angle detection and binary shape prior knowledge IEEE Trans. Dielectr. Electr. Insul. 2015 22 3421 3428 10.1109/TDEI.2015.004741 · DOI
  16. [16]Zhao Z. Xu G. Qi Y. Liu N. Zhang T. Multi-patch deep features for power line insulator status classification from aerial images Proceedings of the 2016 International Joint Conference on Neural Networks, IJCNN 2016 Vancouver, BC, Canada 24–29 July 2016 3187 3194
  17. [17]Liu Y. Yong J. Liu L. Zhao J. Li Z. The method of insulator recognition based on deep learning Proceedings of the 2016 4th International Conference on Applied Robotics for the Power Industry (CARPI) Jinan, China 11–13 October 2016 1 5
  18. [18]Levinshtein A. Stere A. Kutulakos K.N. Fleet D.J. Dickinson S.J. Siddiqi K. TurboPixels: Fast Superpixels Using Geometric Flows IEEE Trans. Pattern Anal. Mach. Intell. 2009 31 2290 2297 10.1109/TPAMI.2009.96 19834148 · DOI
  19. [19]Zitnick C.L. Dollár P. Edge Boxes: Locating Object Proposals from Edges Proceedings of the European Conference on Computer Vision, ECCV 2014 Zurich, Switzerland 6–12 September 2014 Fleet D. Pajdla T. Schiele B. Tuytelaars T. Springer International Publishing Cham, Switzerland 2014 391 405
  20. [20]Ren S. He K. Girshick R. Sun J. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks Advances in Neural Information Processing Systems 28 Cortes C. Lawrence N.D. Lee D.D. Sugiyama M. Garnett R. Curran Associates, Inc. Red Hook, NY, USA 2015 91 99
  21. [22]Uijlings J. van de Sande K. Gevers T. Smeulders A. Selective Search for Object Recognition Int. J. Comput. Vis. 2013 104 154 171 10.1007/s11263-013-0620-5 · DOI · Paper page
  22. [23]Abadi M. Barham P. Chen J. Chen Z. Davis A. Dean J. Devin M. Ghemawat S. Irving G. Isard M. TensorFlow: A System for Large-Scale Machine Learning Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16) Savannah, GA, USA 2–4 November 2016 Volume 16 265 283
  23. [24]Lin T.Y. Maire M. Belongie S. Hays J. Perona P. Ramanan D. Dollár P. Zitnick C.L. Microsoft COCO: Common objects in context Proceedings of the European Conference on Computer Vision Zurich, Switzerland 6–12 September 2014 Springer Cham, Switzerland 2014 740 755
  24. [25]Li H. Wang B. Li L. Research on the infrared and visible power-equipment image fusion for inspection robots Proceedings of the 2010 1st International Conference on Applied Robotics for the Power Industry (CARPI) Montreal, QC, Canada 5–7 October 2010 1 5
  25. [26]Larrauri J.I. Sorrosal G. González M. Automatic system for overhead power line inspection using an Unmanned Aerial Vehicle—RELIFO project Proceedings of the 2013 International Conference on Unmanned Aircraft Systems (ICUAS) Atlanta, GA, USA 28–31 May 2013 244 252
  26. [27]Otsu N. A threshold selection method from gray-level histograms IEEE Trans. Syst. Man Cybern. 1979 9 62 66 10.1109/TSMC.1979.4310076 · DOI
  27. [28]De Oliveira J.H.E. Lages W.F. Robotized inspection of power lines with infrared vision Proceedings of the 2010 1st International Conference on Applied Robotics for the Power Industry (CARPI) Montreal, QC, Canada 5–7 October 2010 1 6
  28. [29]Liu X.Z. Tian Z. Wen J.H. Wu J.M. Zhang Z.Y. SAR image registration based on affine invariant SIFT features Opto-Electron. Eng. 2010 37 121 127 10.3969/j.issn.1003-501X.2010.11.022 · DOI
  29. [31]Hines G. Multi-Image Registration for an Enhanced Vision System Proc. SPIE 2013 5108 231 241
  30. [32]Canny J. A computational approach to edge detection IEEE Trans. Pattern Anal. Mach. Intell. 1986 PAMI-8 679 698 10.1109/TPAMI.1986.4767851 21869365 · DOI · Paper page

Cited by

Sorted by citations

Authors
Jalil, B., Leone, G. R., Martinelli, M., Moroni, D., Pascali, M. A., & Berton, A.
Affiliations
  • Istituto di Scienza e Tecnologie dell'Informazione "Alessandro Faedo" (IT)
  • Istituto di Fisiologia Clinica (IT)
Corresponding author
  • Jalil, Bushra
  • Pascali, Maria Antonietta
Venue
Sensors
Publisher
MDPI AG
Published
2019-07-09
Volume
19
Issue
13
Pages
3014
ISSN
1424-8220 (ISSN-L)
OpenAlex
W2959781444
Cited by
141
References
1
Citations by year
2026: 17 · 2025: 19 · 2024: 31 · 2023: 20 · 2022: 24 · 2021: 15 · 2020: 12 · 2019: 3
FWCI
7.58
Type
journal article
Language
en
Open access
Locations
  • Sensors (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • HAL (submittedVersion, other-oa)
  • ISTI Open Portal (submittedVersion, other-oa)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • CINECA IRIS Institutional Research Information System (Sant'Anna School of Advanced Studies) (submittedVersion)
Funders
Nvidia
Topics
  • Physical Sciences › Engineering › Mechanical Engineering › Power Line Inspection Robots
  • Physical Sciences › Engineering › Civil and Structural Engineering › Infrastructure Maintenance and Monitoring
  • Physical Sciences › Engineering › Control and Systems Engineering › Thermal Analysis in Power Transmission
Keywords
fault detection, power transmission lines, unmanned aerial vehicles, drone inspection, infrared imaging, visible imagery, multimodal fusion, hotspot detection, insulator damage, artificial neural networks, power equipment inspection

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review