Efficient region tracking with parametric models of geometry and illumination
Abstract
As an object moves through the field of view of a camera, the images of the object may change dramatically. This is not simply due to the translation of the object across the image plane; complications arise due to the fact that the object undergoes changes in pose relative to the viewing camera, in illumination relative to light sources, and may even become partially or fully occluded. We develop an efficient general framework for object tracking, which addresses each of these complications. We first develop a computationally efficient method for handling the geometric distortions produced by changes in pose. We then combine geometry and illumination into an algorithm that tracks large image regions using no more computation than would be required to track with no accommodation for illumination changes. Finally, we augment these methods with techniques from robust statistics and treat occluded regions on the object as statistical outliers. Experimental results are given to demonstrate the effectiveness of our methods.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Cites
(1981) · Cited by 11,963 · see citing works
Shi, J., & Tomasi (1994) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition CVPR-94 · doi:10.1109/cvpr.1994.323794 · Cited by 7,724 · see citing works
Huber, P. J. (1981) · Wiley Series in Probability and Statistics · doi:10.1002/0471725250 · Cited by 7,066 · see citing works
Ballard, D. H., & Brown, C. M. (1982) · Cited by 5,235 · see citing works
Haralock, R. M., & Shapiro, L. G. (1991) · Addison-Wesley Longman Publishing Co., Inc. eBooks · Cited by 3,942 · see citing works
A tutorial on visual servo control
Hutchinson, S., Hager, G. D., & Corke, P. (1996) · IEEE Transactions on Robotics and Automation · doi:10.1109/70.538972 · Cited by 3,546 · see citing works
Self-citationShape and motion from image streams under orthography: a factorization method
Tomasi, C., & Takeo Kanade, A. (1992) · International Journal of Computer Vision · doi:10.1007/bf00129684 · Cited by 2,879 · see citing works
Visual learning and recognition of 3-d objects from appearance
Murase, H., & Nayar, S. K. (1995) · International Journal of Computer Vision · doi:10.1007/bf01421486 · Cited by 1,873 · see citing works
A computational framework and an algorithm for the measurement of visual motion
Anandan, P. (1989) · International Journal of Computer Vision · doi:10.1007/bf00158167 · Cited by 1,073 · see citing works
Contour tracking by stochastic propagation of conditional density
Isard, M., & Blake, A. (1996) · Lecture notes in computer science · doi:10.1007/bfb0015549 · Cited by 872 · see citing works
Recognition by linear combinations of models
Ullman, S., & Basri, R. (1991) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.99234 · Cited by 816 · see citing works
Learning and recognizing human dynamics in video sequences
Bregler, C. (2002) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1997.609382 · Cited by 621 · see citing works
Papanikolopoulos, N., Khosla, P. K., & Kanade, T. (1993) · IEEE Transactions on Robotics and Automation · doi:10.1109/70.210792 · Cited by 570 · see citing works
Trucco, E. (1995) · AI Communications · doi:10.3233/aic-1995-8111 · Cited by 473 · see citing works
Visual tracking of high DOF articulated structures: An application to human hand tracking
Rehg, J. M., & Kanade, T. (1994) · Lecture notes in computer science · doi:10.1007/bfb0028333 · Cited by 458 · see citing works
Black, M. J., & Yacoob, Y. (2002) · Proceedings of IEEE International Conference on Computer Vision · doi:10.1109/iccv.1995.466915 · Cited by 457 · see citing works
Automated tracking and grasping of a moving object with a robotic hand-eye system
Allen, P. K., Timčenko, A., Yoshimi, B. H., & Michelman, P. (1993) · IEEE Transactions on Robotics and Automation · doi:10.1109/70.238279 · Cited by 447 · see citing works
EigenTracking: Robust matching and tracking of articulated objects using a view-based representation
Black, M. J., & Jepson, A. D. (1996) · Lecture notes in computer science · doi:10.1007/bfb0015548 · Cited by 414 · see citing works
A framework for spatiotemporal control in the tracking of visual contours
Blake, A., Curwen, R. W., & Zisserman, A. (1993) · International Journal of Computer Vision · doi:10.1007/bf01469225 · Cited by 381 · see citing works
What is the set of images of an object under all possible lighting conditions?
Belhumeur, P. N., & Kriegman, D. (1996) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1996.517085 · Cited by 380 · see citing works
Self-citationImage mosaicing for tele-reality applications
Szeliski, R. (2002) · doi:10.1109/acv.1994.341287 · Cited by 369 · see citing works
Dynamic monocular machine vision
Dickmanns, E. D., & Graefe, V. (1988) · Machine Vision and Applications · doi:10.1007/bf01212361 · Cited by 353 · see citing works
Robust model-based motion tracking through the integration of search and estimation
Lowe, D. G. (1992) · International Journal of Computer Vision · doi:10.1007/bf00127170 · Cited by 311 · see citing works
A low-dimensional representation of human faces for arbitrary lighting conditions
Hallinan (1994) · doi:10.1109/cvpr.1994.323941 · Cited by 293 · see citing works
Visual tracking of known three-dimensional objects
Gennery, D. B. (1992) · International Journal of Computer Vision · doi:10.1007/bf00126395 · Cited by 259 · see citing works
Geometry and Photometry in 3D Visual Recognition
Shashua, A. (1992) · doi:10.21236/ada259443 · Cited by 194 · see citing works
X Vision: A Portable Substrate for Real-Time Vision Applications
Hager, G. D., & Toyama, K. (1998) · Computer Vision and Image Understanding · doi:10.1006/cviu.1997.0586 · Cited by 181 · see citing works
Self-citation5±2 eigenimages suffice: an empirical investigation of low-dimensional lighting models
Epstein, R., Hallinan, P. W., & Yuille, A. (2002) · doi:10.1109/pbmcv.1995.514675 · Cited by 174 · see citing works
Analysing images of curved surfaces
Woodham, R. J. (1981) · Artificial Intelligence · doi:10.1016/0004-3702(81)90022-9 · Cited by 168 · see citing works
A state-based technique for the summarization and recognition of gesture
Bobick, A., & Wilson, A. D. (2002) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.1995.466914 · Cited by 168 · see citing works
Affine Analysis of Image Sequences
Shapiro, L. S. (1995) · Cambridge University Press eBooks · doi:10.1017/cbo9780511526657 · Cited by 128 · see citing works
Active face tracking and pose estimation in an interactive room
Darrell, T. J., Moghaddam, B., & Pentland, A. ‘. (1996) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1996.517055 · Cited by 110 · see citing works
Fast object recognition in noisy images using simulated annealing
Betke, M., & Makris, N. C. (2002) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.1995.466895 · Cited by 96 · see citing works
A fruit-tracking system for robotic harvesting
Harrell, R. C., Slaughter, D. C., & Adsit, P. D. (1989) · Machine Vision and Applications · doi:10.1007/bf01212369 · Cited by 82 · see citing works
Learning dynamics of complex motions from image sequences
Reynard, D., Wildenberg, A., Blake, A., et al. (1996) · Lecture notes in computer science · doi:10.1007/bfb0015550 · Cited by 75 · see citing works
Face Tracking and Pose Representation
McKenna, S. J., Gong, S., & Collins, J. J. (1996) · British Machine Vision Conference (BMVC) · doi:10.5244/c.10.31 · Cited by 54 · see citing works
Numerical methods for the nonlinear robust regression problem
Dutter, R., & Huber, P. J. (1981) · Journal of Statistical Computation and Simulation · doi:10.1080/00949658108810482 · Cited by 49 · see citing works
Object models from contour sequences
Boyer, E. (1996) · Lecture notes in computer science · doi:10.1007/3-540-61123-1_131 · Cited by 46 · see citing works
Visual tracking with deformation models
Rehg, J. M., & Witkin, A. (2002) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.1991.131693 · Cited by 46 · see citing works
Tracking of occluded vehicles in traffic scenes
Frank, T., Haag, M., Kollnig, H., et al. (1996) · Lecture notes in computer science · doi:10.1007/3-540-61123-1_163 · Cited by 32 · see citing works
Visual surveillance monitoring and watching
Howarth, R., & Buxton, H. (1996) · Lecture notes in computer science · doi:10.1007/3-540-61123-1_150 · Cited by 31 · see citing works
Shi, P., Robinson, G., Constable, R. T., et al. (2002) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.1995.466872 · Cited by 27 · see citing works
Tracking medical 3D data with a deformable parametric model
Bardinet, É., Cohen, L., & Ayache, N. (1996) · Lecture notes in computer science · doi:10.1007/bfb0015547 · Cited by 26 · see citing works
Tracking in 3D: Image Variability Decomposition for Recovering Object Pose and Illumination
Belhumeur, P. N., & Hager, G. D. (1999) · Pattern Analysis and Applications · doi:10.1007/s100440050017 · Cited by 15 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Online Object Tracking: A Benchmark
Wu, Y., Lim, J., & Yang, M.-H. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.312 · Cited by 4,138 · see citing works
Wu, Y., Lim, J., & Yang, M.-H. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2388226 · Cited by 3,371 · see citing works
Robust object tracking with online multiple instance learning
Babenko, B., Yang, M.-H., & Belongie, S. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.226 · Cited by 2,007 · see citing works
Real-Time Tracking via On-line Boosting
Grabner, H., Grabner, M., & Bischof, H. (2006) · Procedings of the British Machine Vision Conference 2006 · doi:10.5244/c.20.6 · Cited by 1,198 · see citing works
Pose estimation for augmented reality: a hands-on survey
Marchand, E., Uchiyama, H., & Spindler, F. (2016) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2015.2513408 · Cited by 746 · see citing works
A survey of appearance models in visual object tracking
Li, X., Hu, W., Shen, C., Zhang, Z., Dick, A., & Hengel, A. V. D. (2013) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2508037.2508039 · Cited by 705 · see citing works
Visual tracking and recognition using appearance-adaptive models in particle filters
Zhou, S. K., Chellappa, R., & Moghaddam, B. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2004.836152 · Cited by 668 · see citing works
Monocular model-based 3D tracking of rigid objects: a survey
Lepetit, V., & Fua, P. (2005) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000001 · Cited by 484 · see citing works
In defense of color-based model-free tracking
Possegger, H., Mauthner, T., & Bischof, H. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298823 · Cited by 370 · see citing works
Efficient, robust and accurate fitting of a 3D morphable model
Romdhani, & Vetter (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238314 · Cited by 189 · see citing works
- Authors
- Hager, G. D., & Belhumeur, P. N.
- Affiliations
- Yale University (US)
- ORCID
- Hager, G.D.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 1998
- Volume
- 20
- Issue
- 10
- Pages
- 1025-1039
- ISSN
- 0162-8828 (ISSN-L)
- OpenAlex
- W2103876808
- Cited by
- 1,066
- References
- 44
- Citations by year
- 2025: 2 · 2024: 3 · 2023: 4 · 2022: 1 · 2021: 8 · 2020: 7 · 2019: 15 · 2018: 24 · 2017: 22 · 2016: 31 · 2015: 42 · 2014: 47 · 2013: 46 · 2012: 50
- FWCI
- 21.90
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Vision and Imaging
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Keywords
- region tracking, object tracking, parametric models, geometric distortion, illumination variation, occlusion, robust statistics, outliers
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review