The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Registration of Challenging Image Pairs: Initialization, Estimation, and Decision
Abstract
Our goal is an automated 2D-image-pair registration algorithm capable of aligning images taken of a wide variety of natural and man-made scenes as well as many medical images. The algorithm should handle low overlap, substantial orientation and scale differences, large illumination variations, and physical changes in the scene. An important component of this is the ability to automatically reject pairs that have no overlap or have too many differences to be aligned well. We propose a complete algorithm, including techniques for initialization, for estimating transformation parameters, and for automatically deciding if an estimate is correct. Keypoints extracted and matched between images are used to generate initial similarity transform estimates, each accurate over a small region. These initial estimates are rank-ordered and tested individually in succession. Each estimate is refined using the Dual-Bootstrap ICP algorithm, driven by matching of multiscale features. A three-part decision criteria, combining measurements of alignment accuracy, stability in the estimate, and consistency in the constraints, determines whether the refined transformation estimate is accepted as correct. Experimental results on a data set of 22 challenging image pairs show that the algorithm effectively aligns 19 of the 22 pairs and rejects 99.8% of the misalignments that occur when all possible pairs are tried. The algorithm substantially out-performs algorithms based on keypoint matching alone.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Model selection and multimodel inference: a practical information-theoretic approach.
Guthery, F. S., Burnham, K. P., & Anderson, D. R. (2003) · The Journal of Wildlife Management · doi:10.2307/3802723 · Cited by 41,495
Multiple View Geometry in Computer Vision
Hartley, R., & Zisserman, A. (2004) · doi:10.1017/cbo9780511811685 · Cited by 21,070
A method for registration of 3-D shapes
Besl, P. J., & McKay, N. D. (1992) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.121791 · Cited by 18,103
A Combined Corner and Edge Detector
Harris, C., & Stephens, M. (1988) · Procedings of the Alvey Vision Conference 1988 · doi:10.5244/c.2.23 · Cited by 12,901
A performance evaluation of local descriptors
Mikolajczyk, K., & Schmid, C. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.188 · Cited by 6,723
Image registration methods: a survey
Zitová, B., & Flusser, J. (2003) · Image and Vision Computing · doi:10.1016/s0262-8856(03)00137-9 · Cited by 6,423
Shape matching and object recognition using shape contexts
Belongie, S., Malik, J., & Puzicha, J. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.993558 · Cited by 6,306
Multimodality image registration by maximization of mutual information
Maes, F., Collignon, A., Vandermeulen, D., Marchal, G., & Suetens, P. (1997) · IEEE Transactions on Medical Imaging · doi:10.1109/42.563664 · Cited by 4,547
A survey of image registration techniques
Brown, L. G. (1992) · ACM Computing Surveys · doi:10.1145/146370.146374 · Cited by 4,057
Robust wide-baseline stereo from maximally stable extremal regions
Matas, J., Chum, O., Urban, M., & Pajdla, T. (2004) · Image and Vision Computing · doi:10.1016/j.imavis.2004.02.006 · Cited by 3,686
Scale & Affine Invariant Interest Point Detectors
Mikolajczyk, K., & Schmid, C. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000027790.02288.f2 · Cited by 3,436
Burnham, K. P., & Anderson, D. R. (1998) · doi:10.1007/978-1-4757-2917-7 · Cited by 3,387
Lucas-Kanade 20 Years On: A Unifying Framework
Baker, S., & Matthews, I. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000011205.11775.fd · Cited by 3,155
Object modelling by registration of multiple range images
Chen, Y., & Medioni, G. (1992) · Image and Vision Computing · doi:10.1016/0262-8856(92)90066-c · Cited by 3,154
The design and use of steerable filters
Freeman, W. T., & Adelson, E. H. (1991) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.93808 · Cited by 2,942
A comparison of affine region detectors
Mikolajczyk, K., Tuytelaars, T., Schmid, C., Zisserman, A., Matas, J., Schaffalitzky, F., Kadir, T., & Gool, L. V. (2005) · International Journal of Computer Vision · doi:10.1007/s11263-005-3848-x · Cited by 2,939
Mutual-information-based registration of medical images: a survey
Pluim, J. P. W., Maintz, J. B. A., & Viergever, M. A. (2003) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2003.815867 · Cited by 2,890
Alignment by Maximization of Mutual Information
Viola, P., & Wells III, W. M. (1997) · International Journal of Computer Vision · doi:10.1023/a:1007958904918 · Cited by 2,610
MLESAC: A New Robust Estimator with Application to Estimating Image Geometry
Torr, P. H. S., & Zisserman, A. (2000) · Computer Vision and Image Understanding · doi:10.1006/cviu.1999.0832 · Cited by 2,396
Scale-Space Theory in Computer Vision
Lindeberg, T. (1994) · Springer eBooks · doi:10.1007/978-1-4757-6465-9 · Cited by 2,169
Robust regression using iteratively reweighted least-squares.
Holland, P. W., & Welsch, R. E. (1977) · Communications in Statistics - Theory and Methods · doi:10.1080/03610927708827533 · Cited by 2,115
Hill, D. L. G., Batchelor, P. G., Holden, M., & Hawkes, D. J. (2001) · Physics in Medicine and Biology · doi:10.1088/0031-9155/46/3/201 · Cited by 2,093
Object class recognition by unsupervised scale-invariant learning
Fergus, R., Perona, P., & Zisserman, A. (2003) · 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings. · doi:10.1109/cvpr.2003.1211479 · Cited by 2,023
Evaluation of Interest Point Detectors
Schmid, C., Mohr, R., & Bauckhage, C. (2000) · International Journal of Computer Vision · doi:10.1023/a:1008199403446 · Cited by 1,484
Object modeling by registration of multiple range images
Chen, Y., & Medioni, G. (2002) · Proceedings. 1991 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.1991.132043 · Cited by 1,409
Hierarchical model-based motion estimation
Bergen, J. R., Anandan, P., Hanna, K. J., & Hingorani, R. (1992) · Lecture Notes in Computer Science · doi:10.1007/3-540-55426-2_27 · Cited by 1,154
Heyden, A., & Pollefeys, M. (2005) · Malmö University Publications (Malmö University) · Cited by 1,131
HAMMER: hierarchical attribute matching mechanism for elastic registration
Shen, D., & Davatzikos, C. (2002) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2002.803111 · Cited by 1,083
Brown, & Lowe (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238630 · Cited by 934
Image registration by maximization of combined mutual information and gradient information
Pluim, J. P. W., Maintz, J. B. A., & Viergever, M. A. (2000) · IEEE Transactions on Medical Imaging · doi:10.1109/42.876307 · Cited by 670
Matching Widely Separated Views Based on Affine Invariant Regions
Tuytelaars, T., & Van Gool, L. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000020671.28016.e8 · Cited by 617
Alignment by Maximization of Mutual Information
Viola, P. A. (1995) · doi:10.21236/ada299525 · Cited by 614
Multi-view Matching for Unordered Image Sets, or “How Do I Organize My Holiday Snaps?”
Schaffalitzky, F., & Zisserman, A. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-47969-4_28 · Cited by 533
Statistical Optimization for Geometric Computation: Theory and Practice
(1996) · Machine Intelligence and Pattern Recognition · doi:10.1016/s0923-0459(96)x8019-4 · Cited by 483
Belongie, S., Carson, C., Greenspan, H., & Malik, J. (2002) · Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271) · doi:10.1109/iccv.1998.710790 · Cited by 474
Robust Parameter Estimation in Computer Vision
Stewart, C. V. (1999) · SIAM Review · doi:10.1137/s0036144598345802 · Cited by 449
Self-citationMulti-scale EM-ICP: A Fast and Robust Approach for Surface Registration
Granger, S., & Pennec, X. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-47979-1_28 · Cited by 444
An Affine Invariant Salient Region Detector
Kadir, T., Zisserman, A., & Brady, M. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24670-1_18 · Cited by 422
Hajnal, J. V., & Hill, D. (2001) · Lecture notes in computer science · doi:10.1007/978-3-032-25169-5 · Cited by 402
Multi-Image Matching Using Multi-Scale Oriented Patches
Brown, M., Szeliski, R., & Winder, S. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.235 · Cited by 401
The dual-bootstrap iterative closest point algorithm with application to retinal image registration
Stewart, C. V., Tsai, C.-L., & Roysam, B. (2003) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2003.819276 · Cited by 346
Self-citationCan, A., Stewart, C. V., Roysam, B., & Tanenbaum, H. L. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.990136 · Cited by 272
Self-citationAffine / photometric invariants for planar intensity patterns
Van Gool, L., Moons, T., & Ungureanu, D. (1996) · Lecture Notes in Computer Science · doi:10.1007/bfb0015574 · Cited by 268
Emerging Topics in Computer Vision
Medioni, G., & Kang, S. B. (2004) · Cited by 241
Simultaneous Object Recognition and Segmentation by Image Exploration
Ferrari, V., Tuytelaars, T., & Van Gool, L. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24670-1_4 · Cited by 223
Robust multi-sensor image alignment
Irani, M., & Anandan, P. (2002) · Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271) · doi:10.1109/iccv.1998.710832 · Cited by 220
Grimson, Lozano‐Pérez, T., White, Wells, Kikinis, R., & Ettinger (1994) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1994.323862 · Cited by 120
From accurate range imaging sensor calibration to accurate model-based 3D object localization
Champleboux, G., Lavallée, S., Szeliski, R., & Brunie, L. (2003) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1992.223223 · Cited by 113
An assessment of information criteria for motion model selection
Torr, P. H. S. (2002) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1997.609296 · Cited by 111
Unsupervised learning of an atlas from unlabeled point-sets
Chui, H., Rangarajan, A., Zhang, J., & Leonard, C. M. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.1262178 · Cited by 103
Simultaneous Object Recognition and Segmentation by Image Exploration
Ferrari, V., Tuytelaars, T., & Gool, L. V. (2006) · Lecture notes in computer science · doi:10.1007/11957959_8 · Cited by 70
Shan, Y., Sawhney, H., & Kumar, R. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.70728 · Cited by 65
Image matching with scale adjustment
Dufournaud, Y., Schmid, C., & Horaud, R. (2003) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2003.07.003 · Cited by 58
Iterative Procrustes alignment with the EM algorithm
Luo, B., & Hancock, E. R. (2002) · Image and Vision Computing · doi:10.1016/s0262-8856(02)00010-0 · Cited by 53
Shan, Y., Sawhney, H., & Kumar, R. T. (2005) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2005.358 · Cited by 42
Model Selection Techniques and Merging Rules for Range Data Segmentation Algorithms
Bubna, K., & Stewart, C. V. (2000) · Computer Vision and Image Understanding · doi:10.1006/cviu.2000.0871 · Cited by 24
Self-citationMultimodal and Multiband Image Registration using Mutual Information
Strecha, C., Fransens, R., & Gool, L. V. (2004) · Cited by 12
Cited by
SIFT Flow: Dense Correspondence across Scenes and Its Applications
Liu, C., Yuen, J., & Torralba, A. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.147 · Cited by 1,582
ASIFT: A New Framework for Fully Affine Invariant Image Comparison
Morel, J.-M., & Yu, G. (2009) · SIAM Journal on Imaging Sciences · doi:10.1137/080732730 · Cited by 1,468
Visual attribute transfer through deep image analogy
Liao, J., Yao, Y., Yuan, L., Hua, G., & Kang, S. B. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073683 · Cited by 487
A Partial Intensity Invariant Feature Descriptor for Multimodal Retinal Image Registration
Chen, J., Tian, J., Lee, N., Zheng, J., Smith, R. T., & Laine, A. F. (2010) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2010.2042169 · Cited by 311
A Deep Step Pattern Representation for Multimodal Retinal Image Registration
Lee, J., Liu, P., Cheng, J., & Fu, H. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00518 · Cited by 56
Metadata
- Authors
- Yang, G., Stewart, C. V., Sofka, M., & Tsai, C.-L.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2007-11
- Volume
- 29
- Issue
- 11
- Pages
- 1973-1989
- ISSN
- 0162-8828 (ISSN-L)
- OpenAlex
- W2160341214
- Cited by
- 259
- References
- 58
- FWCI
- 19.64
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.