The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
Robust Point Matching via Vector Field Consensus
Open accessAbstract
In this paper, we propose an efficient algorithm, called vector field consensus, for establishing robust point correspondences between two sets of points. Our algorithm starts by creating a set of putative correspondences which can contain a very large number of false correspondences, or outliers, in addition to a limited number of true correspondences (inliers). Next, we solve for correspondence by interpolating a vector field between the two point sets, which involves estimating a consensus of inlier points whose matching follows a nonparametric geometrical constraint. We formulate this a maximum a posteriori (MAP) estimation of a Bayesian model with hidden/latent variables indicating whether matches in the putative set are outliers or inliers. We impose nonparametric geometrical constraints on the correspondence, as a prior distribution, using Tikhonov regularizers in a reproducing kernel Hilbert space. MAP estimation is performed by the EM algorithm which by also estimating the variance of the prior model (initialized to a large value) is able to obtain good estimates very quickly (e.g., avoiding many of the local minima inherent in this formulation). We illustrate this method on data sets in 2D and 3D and demonstrate that it is robust to a very large number of outliers (even up to 90%). We also show that in the special case where there is an underlying parametric geometrical model (e.g., the epipolar line constraint) that we obtain better results than standard alternatives like RANSAC if a large number of outliers are present. This suggests a two-stage strategy, where we use our nonparametric model to reduce the size of the putative set and then apply a parametric variant of our approach to estimate the geometric parameters. Our algorithm is computationally efficient and we provide code for others to use it. In addition, our approach is general and can be applied to other problems, such as learning with a badly corrupted training data set.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Fischler, M. A., & Bolles, R. C. (1981) · Communications of the ACM · doi:10.1145/358669.358692 · Cited by 25,893
Multiple View Geometry in Computer Vision
Hartley, R., & Zisserman, A. (2004) · doi:10.1017/cbo9780511811685 · Cited by 21,070
A method for registration of 3-D shapes
Besl, P. J., & McKay, N. D. (1992) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.121791 · Cited by 18,103
Stochastic relaxation, gibbs distributions, and the bayesian restoration of images.
Geman, S., & Geman, D. (1984) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1984.4767596 · Cited by 17,949
Advances in Neural Information Processing Systems 19
(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 15,539
Advances in Neural Information Processing Systems 25
Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653
Pattern Recognition and Machine Learning
(2006) · doi:10.1007/978-0-387-45528-0 · Cited by 9,824
Solutions of Ill-Posed Problems.
Bell, J. B., Tikhonov, A. N., & Arsenin, V. Y. (1978) · Mathematics of Computation · doi:10.2307/2006360 · Cited by 8,101
Huber, P. J. (1981) · Wiley Series in Probability and Statistics · doi:10.1002/0471725250 · Cited by 7,066
Shape matching and object recognition using shape contexts
Belongie, S., Malik, J., & Puzicha, J. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.993558 · Cited by 6,306
Robust Regression and Outlier Detection
Piepel, G. F. (1989) · Technometrics · doi:10.1080/00401706.1989.10488524 · Cited by 6,144
Robust Regression and Outlier Detection
Rousseeuw, P. J., & Leroy, A. M. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/0471725382 · Cited by 5,609
Aronszajn, N. (1950) · Transactions of the American Mathematical Society · doi:10.1090/s0002-9947-1950-0051437-7 · Cited by 5,380
Spline Models for Observational Data.
Muller, H.-G., & Wahba, G. (1991) · Journal of the American Statistical Association · doi:10.2307/2290434 · Cited by 4,928
Spline Models for Observational Data
Wahba, G. (1990) · doi:10.1137/1.9781611970128 · Cited by 4,184
Image Processing, Analysis and Machine Vision
Sonka, M., Hlavac, V., & Boyle, R. (1993) · Springer eBooks · doi:10.1007/978-1-4899-3216-7 · Cited by 3,717
Networks for approximation and learning
Poggio, T., & Girosi, F. (1990) · Proceedings of the IEEE · doi:10.1109/5.58326 · Cited by 3,252
A comparison of affine region detectors
Mikolajczyk, K., Tuytelaars, T., Schmid, C., Zisserman, A., Matas, J., Schaffalitzky, F., Kadir, T., & Gool, L. V. (2005) · International Journal of Computer Vision · doi:10.1007/s11263-005-3848-x · Cited by 2,939
Point Set Registration: Coherent Point Drift
Myronenko, A., & Song, X. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.46 · Cited by 2,762
Multiple View Geometry in Computer Vision (2nd ed)
Hartley, R. I., & Zisserman, A. (2003) · Cambridge University Press eBooks · Cited by 2,761
Vlfeat: an open and portable library of computer vision algorithms
Vedaldi, A., & Fulkerson, B. (2010) · Proceedings of the 18th ACM international conference on Multimedia · doi:10.1145/1873951.1874249 · Cited by 2,664
Using spin images for efficient object recognition in cluttered 3D scenes
Johnson, A. E., & Hebert, M. (1999) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.765655 · Cited by 2,599
Least-squares estimation of transformation parameters between two point patterns
Umeyama, S. (1991) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.88573 · Cited by 2,420
MLESAC: A New Robust Estimator with Application to Estimating Image Geometry
Torr, P. H. S., & Zisserman, A. (2000) · Computer Vision and Image Understanding · doi:10.1006/cviu.1999.0832 · Cited by 2,396
Advances in Neural Information Processing Systems 18
Murray, I., Mackay, D., Zoubin Ghahramani, A., & Skilling, J. (2006) · Cited by 1,927
The Interpretation of Visual Motion
Burt, P. J., & Ullman, S. (1980) · The American Journal of Psychology · doi:10.2307/1422246 · Cited by 1,760
The Interpretation of Visual Motion
Ullman, S. (1979) · The MIT Press eBooks · doi:10.7551/mitpress/3877.001.0001 · Cited by 1,644
SIFT Flow: Dense Correspondence across Scenes and Its Applications
Liu, C., Yuen, J., & Torralba, A. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.147 · Cited by 1,582
A new point matching algorithm for non-rigid registration
Chui, H., & Rangarajan, A. (2003) · Computer Vision and Image Understanding · doi:10.1016/s1077-3142(03)00009-2 · Cited by 1,560
Image processing, analysis and machine vision
Saarinen, K. (1994) · Signal Processing · doi:10.1016/0165-1684(94)90202-x · Cited by 1,498
Computational vision and regularization theory
Poggio, T., Torre, V., & Koch, C. (1985) · Nature · doi:10.1038/317314a0 · Cited by 1,412
Imaging vector fields using line integral convolution
Cabral, B., & Leedom, L. C. (1993) · Proceedings of the 20th annual conference on Computer graphics and interactive techniques · doi:10.1145/166117.166151 · Cited by 1,315
A spectral technique for correspondence problems using pairwise constraints
Leordeanu, M., & Hebert, M. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.20 · Cited by 1,222
Matching with PROSAC — Progressive Sample Consensus
Chum, O., & Matas, J. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.221 · Cited by 1,096
Chum, O., Matas, J., & Kittler, J. (2003) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-45243-0_31 · Cited by 843
Black, M. J., & Rangarajan, A. (1996) · International Journal of Computer Vision · doi:10.1007/bf00131148 · Cited by 757
Matching Widely Separated Views Based on Affine Invariant Regions
Tuytelaars, T., & Van Gool, L. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000020671.28016.e8 · Cited by 617
New algorithms for 2D and 3D point matching
Gold, S., Rangarajan, A., Lu, C.-P., Pappu, S., & Mjolsness, E. (1998) · Pattern Recognition · doi:10.1016/s0031-3203(98)80010-1 · Cited by 580
A Comparative Analysis of RANSAC Techniques Leading to Adaptive Real-Time Random Sample Consensus
Raguram, R., Frahm, J.-M., & Pollefeys, M. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88688-4_37 · Cited by 505
On Learning Vector-Valued Functions
Micchelli, C. A., & Pontil, M. (2005) · Neural Computation · doi:10.1162/0899766052530802 · Cited by 494
Surface feature detection and description with applications to mesh matching
Zaharescu, A., Boyer, E., Varanasi, K., & Horaud, R. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206748 · Cited by 411
Feature Correspondence Via Graph Matching: Models and Global Optimization
Torresani, L., Kolmogorov, V., & Rother, C. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88688-4_44 · Cited by 388
Dense estimation of fluid flows
Corpetti, T., Memin, E., & Perez, P. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.990137 · Cited by 360
Rejecting Mismatches by Correspondence Function
Li, X., & Hu, Z. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-010-0318-x · Cited by 238
Boyle, P., & Frean, M. R. (2004) · Cited by 225
Generalized Deformable Models, Statistical Physics, and Matching Problems
Yuille, A. L. (1990) · Neural Computation · doi:10.1162/neco.1990.2.1.1 · Cited by 222
Self-citationTwo-View Geometry Estimation Unaffected by a Dominant Plane
Chum, O., Werner, T., & Matas, J. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.354 · Cited by 217
Robust principal component analysis by self-organizing rules based on statistical physics approach
Xu, L., & Yuille, A. L. (1995) · IEEE Transactions on Neural Networks · doi:10.1109/72.363442 · Cited by 215
Self-citationComputationally Efficient Convolved Multiple Output Gaussian Processes
Álvarez, M. A., & Lawrence, N. D. (2009) · Apollo (University of Cambridge) · doi:10.17863/cam.48485 · Cited by 214
A computational theory for the perception of coherent visual motion
Yuille, A. L., & Grzywacz, N. M. (1988) · Nature · doi:10.1038/333071a0 · Cited by 210
Self-citationVECTOR VALUED REPRODUCING KERNEL HILBERT SPACES OF INTEGRABLE FUNCTIONS AND MERCER THEOREM
Carmeli, C., Vito, E. D., & Toigo, A. (2006) · Analysis and Applications · doi:10.1142/s0219530506000838 · Cited by 210
Regularized vector field learning with sparse approximation for mismatch removal
Ma, J., Zhao, J., Tian, J., Bai, X., & Tu, Z. (2013) · Pattern Recognition · doi:10.1016/j.patcog.2013.05.017 · Cited by 193
Self-citationCommon visual pattern discovery via spatially coherent correspondences
Liu, H., & Yan, S. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5539780 · Cited by 191
A mathematical analysis of the motion coherence theory
Yuille, A. L., & Grzywacz, N. M. (1989) · International Journal of Computer Vision · doi:10.1007/bf00126430 · Cited by 190
Self-citationA common framework for image segmentation
Geiger, D., & Yuille, A. (1991) · International Journal of Computer Vision · doi:10.1007/bf00115697 · Cited by 177
Self-citationRobust Estimation of Nonrigid Transformation for Point Set Registration
Ma, J., Zhao, J., Tian, J., Tu, Z., & Yuille, A. L. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.279 · Cited by 176
Self-citationOn the Spatial Statistics of Optical Flow
Roth, S., & Black, M. J. (2007) · International Journal of Computer Vision · doi:10.1007/s11263-006-0016-x · Cited by 168
Progressive graph matching: Making a move of graphs via probabilistic voting
Cho, M., & Lee, K. M. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247701 · Cited by 133
Slow and Smooth: A Bayesian theory for the combination of local motion signals in human vision
Weiss, Y., & Adelson, E. H. (1998) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 120
A robust method for vector field learning with application to mismatch removing
Zhao, J. Y., Ma, J., Tian, J., Ma, J., & Zhang, D. (2011) · doi:10.1109/cvpr.2011.5995336 · Cited by 102
Self-citationRobust Graph Mode Seeking by Graph Shift
Liu, H., & Yan, S. (2010) · Cited by 88
Robust multi-task learning witht-processes
Yu, S., Volker Tresp, C., & Yu, K. (2007) · International Conference on Machine Learning · doi:10.1145/1273496.1273635 · Cited by 77
In Defence of RANSAC for Outlier Rejection in Deformable Registration
Tran, Q.-H., Chin, T.-J., Carneiro, G., Brown, M. S., & Suter, D. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33765-9_20 · Cited by 71
Multi-output learning via spectral filtering
Baldassarre, L., Rosasco, L., Barla, A., & Verri, A. (2012) · Machine-mediated learning · doi:10.1007/s10994-012-5282-y · Cited by 69
Wang, H., Mirota, D. J., Ishii, M., & Hager, G. D. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587687 · Cited by 41
Mismatch removal via coherent spatial mapping
Ma, J., Zhao, J. Y., Zhou, Y. C., & Tian, J. (2012) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2012.6466780 · Cited by 29
Self-citationIdeal Observers for Detecting Motion: Correspondence Noise
Lu, H., & Yuille, A. (2005) · eScholarship (California Digital Library) · Cited by 17
Self-citation
Cited by
Infrared and visible image fusion methods and applications: A survey
Ma, J., Ma, Y., & Li, C. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.02.004 · Cited by 1,732
Self-citationInfrared and visible image fusion via gradient transfer and total variation minimization
Ma, J., Chen, C., Li, C., & Huang, J. (2016) · Information Fusion · doi:10.1016/j.inffus.2016.02.001 · Cited by 1,128
Self-citationImage Matching from Handcrafted to Deep Features: A Survey
Ma, J., Jiang, X., Fan, A., Jiang, J., & Yan, J. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-020-01359-2 · Cited by 990
Self-citationMa, J., Zhao, J., Jiang, J., Zhou, H., & Guo, X. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-018-1117-z · Cited by 601
Self-citationA review of multimodal image matching: Methods and applications
Jiang, X., Ma, J., Xiao, G., Shao, Z., & Guo, X. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.02.012 · Cited by 532
Self-citation
Metadata
- Authors
- Ma, J., Zhao, J., Tian, J., Yuille, A. L., & Tu, Z.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2014-04
- Volume
- 23
- Issue
- 4
- Pages
- 1706-1721
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2071730188
- Cited by
- 566
- References
- 69
- FWCI
- 46.36
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.