Infrared machine vision and infrared thermography with deep learning: A review
The DOI matches its Crossref record; 79 of the 79 references it cites were found in a registry or an index.
Abstract
Abstract Infrared imaging-based machine vision (IRMV) is the technology used to automatically inspect, detect, and analyse infrared images (or videos) obtained by recording the intensity of infrared light emitted or reflected by observed objects. Depending on whether controllable excitation is used during the imaging of infrared rays, thermal IRMV can be categorised into passive thermography and active thermography. Passive thermography is an important supplement to conventional machine vision based on visible light and is a valid imaging tool for self-heating objects such as the human body and electrical power devices. Active thermography is a non-destructive testing method for the quality evaluation and safety assurance of non-self-heating objects. In active thermography, the trend is to inspect rapidly, reliably, and intelligently by introducing multiple-mode excitation sources and artificial intelligence. The rapid development of deep learning makes IRMV more and more intelligent and highly automated, thus considerably increasing its range of applications. This paper reviews the principle, cameras, and thermal data of IRMV and discusses the applications of deep learning applied to IRMV. Case studies of IRMV and deep learning on various platforms such as unmanned vehicles, mobile phones and embedded systems are also reported.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387
Long-term recurrent convolutional networks for visual recognition and description
Donahue, J., Hendricks, L. A., Guadarrama, S., Rohrbach, M., Venugopalan, S., Darrell, T., & Saenko, K. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298878 · Cited by 5,228
Deep learning for computer vision: A brief review
Voulodimos, A., Doulamis, N., Doulamis, A., & Protopapadakis, E. (2018) · Computational Intelligence and Neuroscience · doi:10.1155/2018/7068349 · Cited by 3,403
2011 International Conference on Computer Vision
(2011) · doi:10.1109/iccv17851.2011 · Cited by 2,860
Deep visual domain adaptation: A survey
Wang, M., & Deng, W. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.05.083 · Cited by 2,209
Threat of Adversarial Attacks on Deep Learning in Computer Vision: A Survey
Akhtar, N., & Mian, A. (2018) · IEEE Access · doi:10.1109/access.2018.2807385 · Cited by 2,021
Learning to Detect a Salient Object
Liu, T., Yuan, Z., Sun, J., Wang, J., Zheng, N., Tang, X., & Shum, H.-Y. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.70 · Cited by 1,777
MARS: A Video Benchmark for Large-Scale Person Re-Identification
Zheng, L., Bie, Z., Sun, Y., Wang, J., Su, C., Wang, S., & Tian, Q. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_52 · Cited by 965
Gopalakrishnan, K., Khaitan, S. K., Choudhary, A., & Agrawal, A. (2017) · Construction and Building Materials · doi:10.1016/j.conbuildmat.2017.09.110 · Cited by 955
RGB-Infrared Cross-Modality Person Re-identification
Wu, A., Zheng, W.-S., Yu, H.-X., Gong, S., & Lai, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.575 · Cited by 862
Nguyen, D., Hong, H., Kim, K., & Park, K. (2017) · Sensors · doi:10.3390/s17030605 · Cited by 790
MFNet: Towards real-time semantic segmentation for autonomous vehicles with multi-spectral scenes
Ha, Q., Watanabe, K., Karasawa, T., Ushiku, Y., & Harada, T. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206396 · Cited by 693
Optically and non-optically excited thermography for composites: A review
Yang, R., & He, Y. (2016) · Infrared Physics & Technology · doi:10.1016/j.infrared.2015.12.026 · Cited by 308
Self-citationLearning discriminative representations from RGB-D video data
Liu, L., & Shao, L. (2013) · UEA Digital Repository (University of East Anglia) · Cited by 302
RGB-T Image Saliency Detection via Collaborative Graph Learning
Tu, Z., Xia, T., Li, C., Wang, X., Ma, Y., & Tang, J. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2924578 · Cited by 273
Weighted Sparse Representation Regularized Graph Learning for RGB-T Object Tracking
Li, C., Zhao, N., Lu, Y., Zhu, C., & Tang, J. (2017) · Proceedings of the 25th ACM international conference on Multimedia · doi:10.1145/3123266.3123289 · Cited by 260
VIF-Net: An Unsupervised Framework for Infrared and Visible Image Fusion
Hou, R., Zhou, D., Nie, R., Liu, D., Xiong, L., Guo, Y., & Yu, C. (2020) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2020.2965304 · Cited by 257
Lemley, J., Bazrafkan, S., & Corcoran, P. (2017) · IEEE Consumer Electronics Magazine · doi:10.1109/mce.2016.2640698 · Cited by 252
Akram, M. W., Li, G., Jin, Y., Chen, X., Zhu, C., & Ahmad, A. (2020) · Solar Energy · doi:10.1016/j.solener.2020.01.055 · Cited by 252
RGB-T Salient Object Detection via Fusing Multi-Level CNN Features
Zhang, Q., Huang, N., Yao, L., Zhang, D., Shan, C., & Han, J. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2959253 · Cited by 247
LI, Y., DU, X., WAN, F., WANG, X., & YU, H. (2020) · Chinese Journal of Aeronautics · doi:10.1016/j.cja.2019.08.014 · Cited by 214
A Unified RGB-T Saliency Detection Benchmark: Dataset, Baselines, Analysis and A Novel ApproachPreprint
Li, C., Wang, G., Ma, Y., Zheng, A.-H., Luo, B., & Tang, J. (2017) · arXiv.org · doi:10.48550/arxiv.1701.02829 · Cited by 211
Deep learning–based autonomous concrete crack evaluation through hybrid image scanning
Jang, K., Kim, N., & An, Y.-K. (2019) · Structural Health Monitoring · doi:10.1177/1475921718821719 · Cited by 198
Temporal and spatial deep learning network for infrared thermal defect detection
Luo, Q., Gao, B., Woo, W. L., & Yang, Y. (2019) · NDT & E International · doi:10.1016/j.ndteint.2019.102164 · Cited by 197
Cho, Y., Bianchi‐Berthouze, N., & Julier, S. (2017) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2017.8273639 · Cited by 180
Subsurface damage detection of a steel bridge using deep learning and uncooled micro-bolometer
Ali, R., & Cha, Y. (2019) · Construction and Building Materials · doi:10.1016/j.conbuildmat.2019.07.293 · Cited by 167
Dunderdale, C., Brettenny, W. J., Clohessy, C., & van Dyk, E. E. (2019) · Progress in Photovoltaics Research and Applications · doi:10.1002/pip.3191 · Cited by 150
Saeed, N., King, N. E., Said, Z., & Omar, M. (2019) · Infrared Physics & Technology · doi:10.1016/j.infrared.2019.103048 · Cited by 149
Infrared Thermal Imaging-Based Crack Detection Using Deep Learning
Yang, J., Wang, W., Lin, G., Li, Q., Sun, Y., & Sun, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2958264 · Cited by 149
Image processing based quantitative damage evaluation in composites with long pulse thermography
Wang, Z., Tian, G. Y., Meo, M., & Ciampa, F. (2018) · NDT & E International · doi:10.1016/j.ndteint.2018.07.004 · Cited by 145
Self-citationDeep Learning Classification for Diabetic Foot Thermograms
Cruz-Vega, I., Hernandez-Contreras, D., Peregrina-Barreto, H., Rangel-Magdaleno, J. D. J., & Ramirez-Cortes, J. M. (2020) · Sensors · doi:10.3390/s20061762 · Cited by 139
Cho, Y., Bianchi‐Berthouze, N., & Julier, S. (2018) · UCL Discovery (University College London) · Cited by 129
Deep Learning Image-Based Defect Detection in High Voltage Electrical Equipment
Ullah, I., Khan, R. U., Yang, F., & Wuttisittikulkij, L. (2020) · Energies · doi:10.3390/en13020392 · Cited by 124
LSTM-RNN-based defect classification in honeycomb structures using infrared thermography
Hu, C., Duan, Y.-X., Liu, S., Yan, Y., Tao, N. P., Osman, A., Ibarra‐Castanedo, C., Сфарра, С., Chen, D., & Zhang, C. (2019) · Infrared Physics & Technology · doi:10.1016/j.infrared.2019.103032 · Cited by 104
Pedestrian Detection in Severe Weather Conditions
Tumas, P., Nowosielski, A., & Serackis, A. (2020) · IEEE Access · doi:10.1109/access.2020.2982539 · Cited by 100
Human action recognition and retrieval using sole depth information
Lin, Y.-C., Hu, M., Cheng, W.-H., Hsieh, Y.-H., & Chen, H. (2012) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2393347.2396381 · Cited by 99
Deep Domain Adaptive Object Detection: a Survey
Li, W., Li, F., Luo, Y., Wang, P., & Sun, J. (2020) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci47803.2020.9308604 · Cited by 97
Zhang, H., Riggan, B. S., Hu, S., Short, N. J., & Patel, V. M. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-019-01175-3 · Cited by 92
WELD: Weighted Low-rank Decomposition for Robust Grayscale-Thermal Foreground Detection
Li, C., Wang, X., Zhang, L., Tang, J., Wu, H., & Lin, L. (2016) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2016.2556586 · Cited by 91
A Deep Learning Approach for Oriented Electrical Equipment Detection in Thermal Images
Gong, X., Yao, Q., Wang, M., et al. (2018) · IEEE Access · doi:10.1109/access.2018.2859048 · Cited by 87
Cao, Y., Dong, Y., Cao, Y., Yang, J., & Yang, M. Y. (2020) · NDT & E International · doi:10.1016/j.ndteint.2020.102246 · Cited by 83
Modeling and classification of defects in CFRP laminates by thermal non-destructive testing
Marani, R., Palumbo, D., Renò, V., et al. (2017) · Composites Part B Engineering · doi:10.1016/j.compositesb.2017.10.010 · Cited by 81
A Thermal Infrared Face Database With Facial Landmarks and Emotion Labels
Kopaczka, M., Kolk, R., Schock, J., Burkhard, F., & Merhof, D. (2018) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2018.2884364 · Cited by 76
Wang, Z., Zhu, J., Tian, G. Y., & Ciampa, F. (2019) · NDT & E International · doi:10.1016/j.ndteint.2019.102155 · Cited by 76
Self-citationEmotional sounds of crowds: spectrogram-based analysis using deep learning
Franzoni, V., Biondi, G., & Milani, A. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-09428-x · Cited by 75
Convolutional Neural Networks for Static and Dynamic Breast Infrared Imaging Classification
Baffa, M. D. F. O., & Lattari, L. G. (2018) · SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI) · doi:10.1109/sibgrapi.2018.00029 · Cited by 71
Deep features class activation map for thermal face detection and tracking
Kwaśniewska, A., Rumiński, J., & Rad, P. (2017) · Conference on Human System Interactions · doi:10.1109/hsi.2017.8004993 · Cited by 66
Dionysopoulos, D., Fierro, G. P. M., Meo, M., & Ciampa, F. (2018) · NDT & E International · doi:10.1016/j.ndteint.2018.01.005 · Cited by 66
Self-citationCNN-based thermal infrared person detection by domain adaptation
Beyerer, J., Ruf, M., & Herrmann, C. (2018) · Autonomous Systems: Sensors, Processing, and Security for Ground, Air, Sea, and Space Vehicles and Infrastructure · doi:10.1117/12.2304400 · Cited by 65
Deep motion templates and extreme learning machine for sign language recognition
Imran, J., & Raman, B. (2019) · The Visual Computer · doi:10.1007/s00371-019-01725-3 · Cited by 65
Infrared thermography and NDT: 2050 horizon
Khodayar, F., Sojasi, S., & Maldague, X. (2016) · Quantitative InfraRed Thermography Journal · doi:10.1080/17686733.2016.1200265 · Cited by 61
Porikli, F., & Yılmaz, A. (2012) · Studies in computational intelligence · doi:10.1007/978-3-642-28598-1_1 · Cited by 60
Convolutional decoding of thermographic images to locate and quantify honey adulterations
Izquierdo, M., Lastra-Mejías, M., González-Flores, E., Cancilla, J. C., Pérez, M., & Torrecilla, J. S. (2019) · Talanta · doi:10.1016/j.talanta.2019.120500 · Cited by 59
Action recognition from extremely low-resolution thermal image sequence
Kawashima, T., Kawanishi, Y., Ide, I., Murase, H., Deguchi, D., Aizawa, T., & Kawade, M. (2017) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2017.8078497 · Cited by 49
Maldonado, H., Bayareh-Mancilla, R., Torres, I. A., Vera, A., Gutiérrez-Martínez, J., & Leija, L. (2020) · Infrared Physics & Technology · doi:10.1016/j.infrared.2020.103187 · Cited by 47
Deep thermal imaging to compute the adulteration state of extra virgin olive oil
Izquierdo, M., Lastra-Mejías, M., González-Flores, E., Cancilla, J. C., Aroca-Santos, R., & Torrecilla, J. S. (2020) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2020.105290 · Cited by 47
Pattern Deep Region Learning for Crack Detection in Thermography Diagnosis System
Hu, J., Xu, W., Gao, B., Tian, G. Y., Wang, Y., 呉, 勇., Yin, Y., & Chen, J. (2018) · Metals · doi:10.3390/met8080612 · Cited by 44
Marani, R., Palumbo, D., Galietti, U., et al. (2016) · IEEE International Conference on Intelligent Systems · doi:10.1109/is.2016.7737471 · Cited by 41
Multimodal Sensor Fusion in Single Thermal Image Super-Resolution
Almasri, F., & Debeir, O. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-21074-8_34 · Cited by 41
Xie, J., Xu, C., Chen, G., & Huang, W. (2018) · Infrared Physics & Technology · doi:10.1016/j.infrared.2018.04.016 · Cited by 40
Improving Night-Time Pedestrian Retrieval With Distribution Alignment and Contextual Distance
Ye, M., Cheng, Y., Lan, X., & Zhu, H. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2946030 · Cited by 40
Nonlinear air-coupled thermosonics for fatigue micro-damage detection and localisation
Dyrwal, A., Meo, M., & Ciampa, F. (2018) · NDT & E International · doi:10.1016/j.ndteint.2018.03.012 · Cited by 39
Self-citationDetecting exercise-induced fatigue using thermal imaging and deep learning
López, M. B., del‐Blanco, C. R., & Garcia, N. N. (2017) · International Conference on Image Processing Theory, Tools and Applications (IPTA) · doi:10.1109/ipta.2017.8310151 · Cited by 37
Infrared and Visible Image Fusion with a Generative Adversarial Network and a Residual Network
Xu, D., Wang, Y., Xu, S., Zhu, K., Zhang, N., & Zhang, X. (2020) · Applied Sciences · doi:10.3390/app10020554 · Cited by 35
Matching Thermal to Visible Face Images Using a Semantic-Guided Generative Adversarial Network
Chen, C., & Ross, A. A. (2019) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2019.8756527 · Cited by 33
The Effect of a Diverse Dataset for Transfer Learning in Thermal Person Detection
Huda, N. U., Hansen, B. D., Gade, R., & Moeslund, T. B. (2020) · Sensors · doi:10.3390/s20071982 · Cited by 33
Rajic, N., & Street, N. A. (2014) · Quantitative InfraRed Thermography Journal · doi:10.1080/17686733.2014.962835 · Cited by 32
Cascaded CNN for View Independent Breast Segmentation in Thermal Images
Kakileti, S. T., Manjunath, G., & Madhu, H. (2019) · doi:10.1109/embc.2019.8856628 · Cited by 32
Super-resolved thermal imagery for high-accuracy facial areas detection and analysis
Kwaśniewska, A., Rumiński, J., Szankin, M., & Kaczmarek, M. (2019) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2019.103263 · Cited by 32
Segmentation of Thermal Breast Images Using Convolutional and Deconvolutional Neural Networks
Guan, S., Kamona, N., & Loew, M. H. (2018) · IEEE Applied Imagery Pattern Recognition Workshop · doi:10.1109/aipr.2018.8707379 · Cited by 31
Deep learning-based concrete crack detection using hybrid images
Jang, K., Kim, B., Cho, S., & An, Y. (2018) · Sensors and Smart Structures Technologies for Civil, Mechanical, and Aerospace Systems · doi:10.1117/12.2294959 · Cited by 30
Anomaly detection in thermal images using deep neural networks
Cai, L., & Li, Y. (2017) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2017.8296692 · Cited by 29
Algarni, A. D. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-08616-z · Cited by 28
Deep learning based thermal image segmentation for laboratory animals tracking
Mazur-Milecka, M., & Rumiński, J. (2020) · Quantitative InfraRed Thermography Journal · doi:10.1080/17686733.2020.1720344 · Cited by 25
An Integrated Coating Inspection System for Marine and Offshore Corrosion Management
Liu, L., Tan, E., Cai, Z. Q., et al. (2018) · International Conference on Control, Automation, Robotics and Vision (ICARCV) · doi:10.1109/icarcv.2018.8581327 · Cited by 20
RGB Guided Thermal Super-Resolution Enhancement
Almasri, F., & Debeir, O. (2018) · International Conference on Cloud Computing Technologies and Applications (CloudTech) · doi:10.1109/cloudtech.2018.8713356 · Cited by 19
Wu, H., Zhang, H., Hu, G., & Qiao, R. (2020) · AIP Advances · doi:10.1063/5.0004631 · Cited by 15
Multimodal Sensor Fusion In Single Thermal image Super-ResolutionPreprint
Almasri, F., & Debeir, O. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.09276 · Cited by 13
Systematic infrared image quality improvement using deep learning based techniques
Zhang, H., Casaseca‐de‐la‐Higuera, P., Luo, C., et al. (2016) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2242036 · Cited by 12
Metadata
- Authors
- He, Y., Deng, B., Wang, H., Cheng, L., Zhou, K., Cai, S., & Ciampa, F.
- Venue
- Infrared Physics & Technology
- Publisher
- Elsevier BV
- Published
- 2021-08
- Volume
- 116
- Pages
- 103754
- ISSN
- 1350-4495 (ISSN-L)
- OpenAlex
- W3152576252
- Cited by
- 319
- References
- 79
- FWCI
- 21.22
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.