The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Data Fusion for Visual Tracking With Particles
Abstract
The effectiveness of probabilistic tracking of objects in image sequences has been revolutionized by the development of particle filtering. Whereas Kalman filters are restricted to Gaussian distributions, particle filters can propagate more general distributions, albeit only approximately. This is of particular benefit in visual tracking because of the inherent ambiguity of the visual world that stems from its richness and complexity. One important advantage of the particle filtering framework is that it allows the information from different measurement sources to be fused in a principled manner. Although this fact has been acknowledged before, it has not been fully exploited within a visual tracking context. Here we introduce generic importance sampling mechanisms for data fusion and discuss them for fusing color with either stereo sound, for teleconferencing, or with motion, for surveillance with a still camera. We show how each of the three cues can be modeled by an appropriate data likelihood function, and how the intermittent cues (sound or motion) are best handled by generating proposal distributions from their likelihood functions. Finally, the effective fusion of the cues by particle filtering is demonstrated on real teleconference and surveillance data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Novel approach to nonlinear/non-Gaussian Bayesian state estimation
Gordon, N. J., Salmond, D. J., & Smith, A. F. M. (1993) · IEE Proceedings F Radar and Signal Processing · doi:10.1049/ip-f-2.1993.0015 · Cited by 7,550
Sequential Monte Carlo Methods in Practice
(2001) · Springer eBooks · doi:10.1007/978-1-4757-3437-9 · Cited by 7,366
CONDENSATION—Conditional Density Propagation for Visual Tracking
Isard, M., & Blake, A. (1998) · International Journal of Computer Vision · doi:10.1023/a:1008078328650 · Cited by 4,886
Self-citationComaniciu, D., Ramesh, V., & Meer, P. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1195991 · Cited by 4,560
The generalized correlation method for estimation of time delay
Knapp, C., & Carter, G. (1976) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1976.1162830 · Cited by 4,433 · cited 2×
“ular strategy that satisfies these requirements involves the maximization of the generalized cross-correlation function (GCCF) [5], [27].”
BackgroundOn sequential Monte Carlo sampling methods for Bayesian filtering
Doucet, A., Godsill, S., & Andrieu, C. (2000) · Statistics and Computing · doi:10.1023/a:1008935410038 · Cited by 4,411
Pfinder: real-time tracking of the human body
Wren, C. R., Azarbayejani, A., Darrell, T., & Pentland, A. P. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598236 · Cited by 4,169
Anderson, B. D. O., Moore, J. B., & Eslami, M. (1982) · IEEE Transactions on Systems Man and Cybernetics · Cited by 3,195
Real-time tracking of non-rigid objects using mean shift
Comaniciu, D., Ramesh, V., & Meer, P. (2002) · Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662) · doi:10.1109/cvpr.2000.854761 · Cited by 2,906
W/sup 4/: real-time surveillance of people and their activities
Haritaoglu, I., Harwood, D., & Davis, L. S. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.868683 · Cited by 2,523
Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space Models
Kitagawa, G. (1996) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1996.10474692 · Cited by 2,404
Sequential Monte Carlo Methods for Dynamic Systems
Liu, J. S., & Chen, R. (1998) · Journal of the American Statistical Association · doi:10.1080/01621459.1998.10473765 · Cited by 2,191
A Survey of Computer Vision-Based Human Motion Capture
Moeslund, T. B., & Granum, E. (2001) · Computer Vision and Image Understanding · doi:10.1006/cviu.2000.0897 · Cited by 1,768
Bayesian Inference in Econometric Models Using Monte Carlo Integration
Geweke, J. (1989) · Econometrica · doi:10.2307/1913710 · Cited by 1,563
Color-Based Probabilistic Tracking
Pérez, P., Hue, C., Vermaak, J., & Gangnet, M. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-47969-4_44 · Cited by 1,389
Self-citationCoherence and time delay estimation
Carter, G. C. (1987) · Proceedings of the IEEE · doi:10.1109/proc.1987.13723 · Cited by 1,200
Malis, E., Chaumette, F., & Boudet, S. (1999) · IEEE Transactions on Robotics and Automation · doi:10.1109/70.760345 · Cited by 970
Blake, A., & Isard, M. (1998) · Springer eBooks · doi:10.1007/978-1-4471-1555-7 · Cited by 760
Self-citationStochastic Tracking of 3D Human Figures Using 2D Image Motion
Sidenbladh, H., Black, M. J., & Fleet, D. J. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45053-x_45 · Cited by 700
BraMBLe: a Bayesian multiple-blob tracker
Isard, M., & MacCormick, J. (2002) · Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001 · doi:10.1109/iccv.2001.937594 · Cited by 628
Real time face and object tracking as a component of a perceptual user interface
Bradski, G. R. (2002) · Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201) · doi:10.1109/acv.1998.732882 · Cited by 627
Tracking deformable objects in the plane using an active contour model
Leymarie, F., & Levine, M. D. (1993) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.216733 · Cited by 554
Icondensation: Unifying low-level and high-level tracking in a stochastic framework
Isard, M., & Blake, A. (1998) · Lecture Notes in Computer Science · doi:10.1007/bfb0055711 · Cited by 545
Self-citationAnderson, B. D. O., Moore, J. B., & Eslami, M. (1982) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1982.4308806 · Cited by 485
Partitioned Sampling, Articulated Objects, and Interface-Quality Hand Tracking
MacCormick, J., & Isard, M. (2000) · Lecture notes in computer science · doi:10.1007/3-540-45053-x_1 · Cited by 469
Real-time markerless tracking for augmented reality: the virtual visual servoing framework
Comport, A. I., Marchand, E., Pressigout, M., & Chaumette, F. (2006) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2006.78 · Cited by 445
Looking at people: sensing for ubiquitous and wearable computing
Pentland, A. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.824823 · Cited by 403
A framework for spatiotemporal control in the tracking of visual contours
Blake, A., Curwen, R., & Zisserman, A. (1993) · International Journal of Computer Vision · doi:10.1007/bf01469225 · Cited by 380
Self-citationImplicit Probabilistic Models of Human Motion for Synthesis and Tracking
Sidenbladh, H., Black, M. J., & Sigal, L. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-47969-4_52 · Cited by 314
Shape context and chamfer matching in cluttered scenes
Thayananthan, A., Stenger, B., Torr, P. H. S., & Cipolla, R. (2003) · 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings. · doi:10.1109/cvpr.2003.1211346 · Cited by 308
Covariance scaled sampling for monocular 3D body tracking
Sminchisescu, C., & Triggs, B. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990509 · Cited by 290
Better proposal distributions: object tracking using unscented particle filter
Rui, Y., & Chen, Y. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.991045 · Cited by 283
A Probabilistic Exclusion Principle for Tracking Multiple Objects
MacCormick, J., & Blake, A. (2000) · International Journal of Computer Vision · doi:10.1023/a:1008122218374 · Cited by 267
Self-citationRobust online appearance models for visual tracking
Jepson, A. D., Fleet, D. J., & El-Maraghi, T. R. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990505 · Cited by 248
Using the CONDENSATION algorithm for robust, vision-based mobile robot localization
Dellaert, F., Burgard, W., Fox, D., & Thrun, S. (2003) · Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149) · doi:10.1109/cvpr.1999.784976 · Cited by 239
On-line selection of discriminative tracking features
Collins, & Liu (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238365 · Cited by 238
Voice source localization for automatic camera pointing system in videoconferencing
Wang, H., & Chu, P. (2002) · 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1997.599595 · Cited by 211
Probabilistic tracking in a metric space
Toyama, K., & Blake, A. (2002) · Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001 · doi:10.1109/iccv.2001.937599 · Cited by 197
Self-citationPeople tracking using hybrid Monte Carlo filtering
Choo, K., & Fleet, D. J. (2002) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2001.937643 · Cited by 181
Virtual Visual Servoing: a framework for real-time augmented reality
Marchand, É., & Chaumette, F. (2002) · Computer Graphics Forum · doi:10.1111/1467-8659.t01-1-00588 · Cited by 159
Towards robust multi-cue integration for visual tracking
Spengler, M., & Schiele, B. (2003) · Machine Vision and Applications · doi:10.1007/s00138-002-0095-9 · Cited by 154
Perceptual user interfaces: things that see
Crowley, J. L., Coutaz, J., & Bérard, F. (2000) · Communications of the ACM · doi:10.1145/330534.330540 · Cited by 148
Learning the Statistics of People in Images and Video
Sidenbladh, H., & Black, M. J. (2003) · International Journal of Computer Vision · doi:10.1023/a:1023765619733 · Cited by 128
A co-inference approach to robust visual tracking
Wu, Y. N., & Huang, T. S. (2002) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2001.937590 · Cited by 125
Sequential Monte Carlo fusion of sound and vision for speaker tracking
Vermaak, J., Gangnet, M., Blake, A., et al. (2002) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2001.937600 · Cited by 104
Self-citationA DSP implementation of source location using microphone arrays.
Rabinkin, D. V., Ranomeron, R. J., Dahl, A. J., French, J., Flanagan, J. L., & Bianchi, M. H. (1996) · The Journal of the Acoustical Society of America · doi:10.1121/1.415678 · Cited by 97
Acoustic source location in a three-dimensional space using crosspower spectrum phase
Svaizer, P., Matassoni, M., & Omologo, M. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1997.599611 · Cited by 89
A smoothing filter for condensation
Isard, M., & Blake, A. (1998) · Lecture notes in computer science · doi:10.1007/bfb0055703 · Cited by 88
Self-citationTowards Improved Observation Models for Visual Tracking: Selective Adaptation
Vermaak, J., Pérez, P., Gangnet, M., & Blake, A. (2002) · Lecture notes in computer science · doi:10.1007/3-540-47969-4_43 · Cited by 82
Self-citationTracking multiple objects using the Condensation algorithm
Koller-Meier, E., & Ade, F. (2001) · Robotics and Autonomous Systems · doi:10.1016/s0921-8890(00)00114-7 · Cited by 73
A two-stage algorithm for determining talker location from linear microphone array data
Silverman, H. F., & Kirtman, S. E. (1992) · Computer Speech & Language · doi:10.1016/0885-2308(92)90023-w · Cited by 70
Towards Robust Multi-cue Integration for Visual Tracking
Spengler, M., & Schiele, B. (2001) · Lecture notes in computer science · doi:10.1007/3-540-48222-9_7 · Cited by 56
DSP implementation of source location using microphone arrays
Rabinkin, D. V., Renomeron, R. J., Dahl, A. J., French, J. C., Flanagan, J. L., & Bianchi, M. (1996) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.255464 · Cited by 55
Quasi-Random Sampling for Condensation
Philomin, V., Ramani Duraiswami, B., & Davis, L. S. (2000) · Lecture notes in computer science · doi:10.1007/3-540-45053-x_9 · Cited by 51
Trust-region methods for real-time tracking
Chen, H.-T., & Liu, T.-L. (2002) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2001.937697 · Cited by 47
Cited by
Intelligent multi-camera video surveillance: A review
Wang, X. (2013) · Pattern Recognition Letters · doi:10.1016/j.patrec.2012.07.005 · Cited by 694
A Review of Human Activity Recognition Methods
Vrigkas, M., Nikou, C., & Kakadiaris, I. A. (2015) · Frontiers in Robotics and AI · doi:10.3389/frobt.2015.00028 · Cited by 566
Metadata
- Authors
- Perez, P., Vermaak, J., & Blake, A.
- Venue
- Proceedings of the IEEE
- Published
- 2004-03
- Volume
- 92
- Issue
- 3
- Pages
- 495-513
- ISSN
- 0018-9219 (ISSN-L)
- OpenAlex
- W2154496665
- Cited by
- 469
- References
- 55
- FWCI
- 44.15
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.