An overview of deep learning methods for image registration with focus on feature-based approaches
The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
Image registration is an essential pre-processing step for several computer vision problems like image reconstruction and image fusion. In this paper, we present a review on image registration approaches using deep learning. The focus of the survey presented is on how conventional image registration methods such as area-based and feature-based methods are addressed using deep net architectures. Registration approach adopted depends on type of images and type of transformation used to describe the deformation between the images in an application. We then present a comparative performance analysis of convolutional neural networks that have shown good performance across feature extraction, matching and transformation estimation in featured-based registration. Experimentation is done on each of these approaches using a dataset of aerial images generated by inducing deformations such as scale.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Speeded-Up Robust Features (SURF)
Bay, H., Ess, A., Tuytelaars, T., & Van Gool, L. (2008) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2007.09.014 · Cited by 13,557 · cited 4×
“Three approaches adopted for registration as shown in Figure 4 are as follows: Approach I: ● Generate features descriptors of both images using AlexNet for each patch extracted around a key point detected using SIFT.”
MethodInfluentialORB-SLAM: A Versatile and Accurate Monocular SLAM System
Mur-Artal, R., Montiel, J. M. M., & Tardos, J. D. (2015) · IEEE Transactions on Robotics · doi:10.1109/tro.2015.2463671 · Cited by 6,778
A performance evaluation of local descriptors
Mikolajczyk, K., & Schmid, C. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.188 · Cited by 6,723
Image registration methods: a survey
Zitová, B., & Flusser, J. (2003) · Image and Vision Computing · doi:10.1016/s0262-8856(03)00137-9 · Cited by 6,423 · cited 3×
“…in several application pipelines, such as change detection, image fusion across domains like remote sensing, stereo vision, medical imaging, etc. Classical image registration is broadly classi-fi ed as area-based, feature-based and hybrid image registration (Zitová and Flusser 2003, Huang et al .”
BackgroundFlownet: Learning optical flow with convolutional networks
Dosovitskiy, A., Fischer, P., Ilg, E., Hausser, P., Hazirbas, C., Golkov, V., Smagt, P. V. D., Cremers, D., & Brox, T. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.316 · Cited by 4,313
Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources
Zhu, X. X., Tuia, D., Mou, L., Xia, G.-S., Zhang, L., Xu, F., & Fraundorfer, F. (2017) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2017.2762307 · Cited by 3,400
Deep learning in remote sensing applications: A meta-analysis and review
Ma, L., Liu, Y., Zhang, X., Ye, Y., Yin, G., & Johnson, B. A. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.04.015 · Cited by 2,456
Deformable medical image registration: a survey
Sotiras, A., Davatzikos, C., & Paragios, N. (2013) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2013.2265603 · Cited by 1,587 · cited 3×
“2017) or for calculating similarity (Sotiras et al .”
BackgroundInfluential
Research works printed but not linked: 88
- 10.5244/C.30.49 · DOI
- Andrade, N., Augusto Faria, F., and Cappabianco, F., 2018. A practical review on medical image registration: from rigid to deep learning based approaches. In: 2018 31st SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), Parana, 10, 463–470. · DOI
- 10.1109/JURSE.2017.7924536 · DOI
- 10.1007/978-3-319-46466-4_10 · DOI
- Balntas V., 2016, ArXiv, abs/1601.05030 · arXiv
- Baruch E.B., 2018, ArXiv , abs/1810.12941 · arXiv
- 10.1016/j.patrec.2018.12.002 · DOI
- 10.1109/TPAMI.2010.54 · DOI · Paper page
- 10.3390/rs9121244 · DOI
- 10.1080/21681163.2015.1135299 · DOI · Paper page
- Chopra S., 2005, CVPR' 05, 539
- 10.1109/IEMBS.2005.1616557 · DOI
- 10.1007/978-3-319-67558-9_24 · DOI · Paper page
- DeTone D., 2016, ArXiv, abs/1606.03798 · arXiv
- Eigen D., 2014, Advances in neural information processing systems, 2366
- 10.1109/CVPR.2017.265 · DOI · Paper page
- Eppenhof K.A., 2018, Medical Imaging 2018: Image Processing. International Society for Optics and Photonics, 10574, 105740S
- Erlik Nowruzi F., 2017, Proceedings of the IEEE International Conference on Computer Vision, 913
- 10.1088/0266-5611/24/3/034008 · DOI · Paper page
- Fischer P., 2014, arXiv, abs/1405.5769 · arXiv
- 10.1016/j.cviu.2015.02.008 · DOI · Paper page
- 10.1109/WACV.2018.00149 · DOI · Paper page
- 10.1613/jair.5756 · DOI
- 10.3390/s18030698 · DOI
- Han X., 2015, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 3279
- Herb M., 2015, Computing the stereo matching cost with a convolutional neural network, seminar recent trends in 3 d computer vision
- 10.1016/j.media.2018.07.002 · DOI · Paper page
- 10.1109/CVPR.2004.362 · DOI
- 10.1109/CVPR.2017.179 · DOI · Paper page
- 10.1145/3071073 · DOI
- Jain P., 2012, Journal of Machine Learning Research, 13, 519
- 10.1109/CVPR.2018.00185 · DOI
- Jia Y., 2011, Advances in neural information processing systems, 397
- 10.1109/TITS.2019.2917538 · DOI
- 10.1109/ICCV.2017.17 · DOI · Paper page
- 10.1007/s10278-016-9915-8 · DOI
- Krizhevsky A., 2012, Advances in neural information processing systems, 1097
- Kumar B., 2016, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 5385
- Lai W.S., 2017, Advances in neural information processing systems, 354
- LeCun Y., 1995, International conference on artificial neural networks, 60, 53
- Li H., 2017, arXiv, abs/1709.00799 · arXiv
- Liao R., 2017, Thirty-First AAAI Conference on Artificial Intelligence
- 10.1016/j.media.2017.07.005 · DOI · Paper page
- Lucas, B.D. et al. 1981. An iterative image registration technique with an application to stereo vision. Proceedings of the 7th International Joint Conference on Artificial Intelligence (IJCAI '81), vol. 81
- 10.1109/CVPR.2016.614 · DOI · Paper page
- Mambo S., 2018, International Journal of Computer and Information Sciences, 5
- Maurer D., 2018, arXiv.org, cs, arXiv:1806.00800 · arXiv
- Meister S., 2018, Thirty-Second AAAI Conference on Artificial Intelligence
- Moo Y.K., 2018, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2666
- 10.1109/LRA.2018.2809549 · DOI · Paper page
- 10.1109/TIP.83 · DOI · Paper page
- Ono Y., 2018, Advances in neural information processing systems, 6234
- Ren Z., 2017, Thirty-First AAAI Conference on Artificial Intelligence
- 10.1109/CVPR.2017.12 · DOI · Paper page
- Salakhutdinov R., 2007, Artificial intelligence and statistics, 412
- 10.1177/1753193417753261 · doi:10.1177/1753193417753261
- Shan S., 2017, arXiv, abs/1711.08608 · arXiv
- Sheikhjafari, A. et al. 2018. Unsupervised deformable image registration with fully connected generative neural network. In MIDL 2018 Conference, Amsterdam.
- 10.1007/978-3-319-46726-9_2 · DOI · Paper page
- 10.1109/TPAMI.2014.2301163 · DOI · Paper page
- Simonyan K., 2014, abs/1409.1556 · arXiv
- 10.5220/0006543700890099 · DOI · Paper page
- 10.7763/IJCTE.2014.V6.899 · DOI
- 10.5021/ad.2018.30.4.511 · doi:10.5021/ad.2018.30.4.511
- Suzuki K., 2017, Med Imaging Technol, 35, 212
- 10.1109/CVPR.2015.7298594 · DOI · Paper page
- 10.1177/1753193411419945 · doi:10.1177/1753193411419945
- 10.1016/j.image.2018.12.002 · DOI
- 10.1109/IGARSS.2016.7729469 · DOI
- 10.1109/CVPR.2015.7299165 · DOI · Paper page
- 10.1093/bioinformatics/btt309 · DOI
- 10.1109/CVPR.2018.00513 · DOI · Paper page
- 10.1097/ALN.0b013e31828744c0 · doi:10.1097/aln.0b013e31828744c0
- 10.1109/TBME.2016.2633139 · DOI
- Xing C., 2016, Journal of Sensors, 2016
- 10.1177/1753193417690669 · doi:10.1177/1753193417690669
- 10.1109/ACCESS.2018.2853100 · DOI · Paper page
- 10.1007/978-3-319-46466-4_28 · DOI · Paper page
- Yu L., 2018, Thirty-Second AAAI Conference on Artificial Intelligence
- 10.1109/CVPR.2015.7299064 · DOI · Paper page
- Zampieri, A., Charpiat, G., and Tarabalka, Y., 2018. Coarse to fine non-rigid registration: a chain of scale-specific neural networks for multimodal image alignment with application to remote sensing. arXiv, abs/1802.09816. · arXiv
- Zbontar J., 2016, Journal of Machine Learning Research, 17, 2
- 10.1109/CVPR.2019.00027 · DOI · Paper page
- Zhang L., 2018, arXiv, abs/1804.04440 · arXiv
- 10.1109/CVPR.2017.523 · DOI
- 10.1155/2015/836202 · DOI
- Zhong Y., 2017, arXiv, abs/1709.00930 · arXiv
- 10.15607/RSS.2018.XIV.062 · DOI · Paper page
Cited by
Perspectives in machine learning for wildlife conservation
Tuia, D., Kellenberger, B., Beery, S., Costelloe, B. R., Zuffi, S., Risse, B., Mathis, A., Mathis, M. W., van Langevelde, F., Burghardt, T., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-27980-y · Cited by 740
Himeur, Y., Rimal, B., Tiwary, A., & Amira, A. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.06.003 · Cited by 288
A Review of Keypoints’ Detection and Feature Description in Image Registration
Liu, C., Xu, J., & Wang, F. (2021) · Scientific Programming · doi:10.1155/2021/8509164 · Cited by 47
“have reviewed and proved that CNNs are the mostly used deep net architecture in feature detection, description, and matching in comparison with other models [49, 61, 77, 78].”
BackgroundResultHaalck, L., & Risse, B. (2021) · 2021 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv48630.2021.00189 · Cited by 3
“This is also true for most deep learning-based registration techniques which have been surveyed recently using only up to 80 images at a 1000 × 1000 pixel resolution for benchmarking purposes [21].”
BackgroundMethod
Metadata
- Authors
- Kuppala, K., Banda, S., & Barige, T. R.
- Venue
- International Journal of Image and Data Fusion
- Publisher
- Informa UK Limited
- Published
- 2020-01-06
- Volume
- 11
- Issue
- 2
- Pages
- 113-135
- ISSN
- 1947-9824 (ISSN-L)
- 1947-9832
- OpenAlex
- W2999936618
- Cited by
- 74
- References
- 20
- FWCI
- 3.60
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: An overview of deep learning methods for image registration with focus on feature-based approaches. https://app.cochat.ai/papers/10.1080/19479832.2019.1707720
- The paper
- Kuppala, K., Banda, S., & Barige, T. R. (2020). An overview of deep learning methods for image registration with focus on feature-based approaches. International Journal of Image and Data Fusion. https://doi.org/10.1080/19479832.2019.1707720
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.