The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
Segmentation of Moving Objects by Long Term Video Analysis
Abstract
Motion is a strong cue for unsupervised object-level grouping. In this paper, we demonstrate that motion will be exploited most effectively, if it is regarded over larger time windows. Opposed to classical two-frame optical flow, point trajectories that span hundreds of frames are less susceptible to short-term variations that hinder separating different objects. As a positive side effect, the resulting groupings are temporally consistent over a whole video shot, a property that requires tedious post-processing in the vast majority of existing approaches. We suggest working with a paradigm that starts with semi-dense motion cues first and that fills up textureless areas afterwards based on color. This paper also contributes the Freiburg-Berkeley motion segmentation (FBMS) dataset, a large, heterogeneous benchmark with 59 sequences and pixel-accurate ground truth annotation of moving objects.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Normalized cuts and image segmentation
Shi, J., & Malik, J. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.868688 · Cited by 15,502
Self-citation(1981) · Cited by 11,963
On Spectral Clustering: Analysis and an algorithm
Ng, A. Y., Jordan, M. I., & Weiss, Y. (2001) · Cited by 8,159
Shi, J., & Tomasi (1994) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition CVPR-94 · doi:10.1109/cvpr.1994.323794 · Cited by 7,724
Contour Detection and Hierarchical Image Segmentation
Arbeláez, P., Maire, M., Fowlkes, C., & Malik, J. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.161 · Cited by 5,454
Self-citationA First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging
Chambolle, A., & Pock, T. (2011) · Journal of Mathematical Imaging and Vision · doi:10.1007/s10851-010-0251-1 · Cited by 4,336
Principles Of Gestalt Psychology
Koffka, K. (2013) · Routledge eBooks · doi:10.4324/9781315009292 · Cited by 4,263
Sparse Subspace Clustering: Algorithm, Theory, and Applications
Elhamifar, E., & Vidal, R. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.57 · Cited by 3,106
Random Walks for Image Segmentation
Grady, L. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.233 · Cited by 2,624
Principles of Gestalt Psychology
Pratt, C. C., & Koffka, K. (1936) · The American Journal of Psychology · doi:10.2307/1415906 · Cited by 2,182
Graph Cuts and Efficient N-D Image Segmentation
Boykov, Y., & Funka-Lea, G. (2006) · International Journal of Computer Vision · doi:10.1007/s11263-006-7934-5 · Cited by 1,910
Robust Subspace Segmentation by Low-Rank Representation
Liu, G., Lin, Z., & Yu, Y. H. (2010) · Cited by 1,534
Large Displacement Optical Flow: Descriptor Matching in Variational Motion Estimation
Brox, T., & Malik, J. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.143 · Cited by 1,295
Self-citationRepresenting moving images with layers
Wang, J. Y. A., & Adelson, E. H. (1994) · IEEE Transactions on Image Processing · doi:10.1109/83.334981 · Cited by 1,090
Segmentation and Recognition Using Structure from Motion Point Clouds
Brostow, G. J., Shotton, J., Fauqueur, J., & Cipolla, R. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88682-2_5 · Cited by 1,050
Algorithms for Finding Global Minimizers of Image Segmentation and Denoising Models
Chan, T. F., Esedoglu, S., & Nikolova, M. (2006) · SIAM Journal on Applied Mathematics · doi:10.1137/040615286 · Cited by 1,049
Scene Text Recognition using Higher Order Language Priors
Mishra, A., Alahari, K., & Jawahar, C. (2012) · Procedings of the British Machine Vision Conference 2012 · doi:10.5244/c.26.127 · Cited by 831
Object Segmentation by Long Term Analysis of Point Trajectories
Brox, T., & Malik, J. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15555-0_21 · Cited by 744
Self-citationA Benchmark for the Comparison of 3-D Motion Segmentation Algorithms
Tron, R., & Vidal, R. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.382974 · Cited by 658
Efficient hierarchical graph-based video segmentation
Grundmann, M., Kwatra, V., Han, M., & Essa, I. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539893 · Cited by 628
A real-time computer vision system for measuring traffic parameters
Beymer, D., McLauchlan, P., Coifman, B., & Malik, J. (2002) · Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1997.609371 · Cited by 493
Self-citationYan, J., & Pollefeys, M. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744085_8 · Cited by 489
Learning object class detectors from weakly annotated video
Prest, A., Leistner, C., Civera, J., Schmid, C., & Ferrari, V. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248065 · Cited by 443
A Geodesic Framework for Fast Interactive Image and Video Segmentation and Matting
Bai, X., & Sapiro, G. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408931 · Cited by 438
Dense Point Trajectories by GPU-Accelerated Large Displacement Optical Flow
Sundaram, N., Brox, T., & Keutzer, K. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15549-9_32 · Cited by 422
Self-citationUnsupervised Bayesian Detection of Independent Motion in Crowds
Brostow, G. J., & Cipolla, R. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.320 · Cited by 413
Particle Video: Long-Range Motion Estimation Using Point Trajectories
Sand, P., & Teller, S. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-008-0136-6 · Cited by 365
Motion segmentation and tracking using normalized cuts
Shi, J., & Malik, J. (2002) · Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271) · doi:10.1109/iccv.1998.710861 · Cited by 336
Self-citationSinop, A. K., & Grady, L. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408927 · Cited by 277
Motion Competition: A Variational Approach to Piecewise Parametric Motion Segmentation
Cremers, D., & Soatto, S. (2005) · International Journal of Computer Vision · doi:10.1007/s11263-005-4882-4 · Cited by 253
Approximate Labeling via Graph Cuts Based on Linear Programming
Komodakis, N., & Tziritas, G. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1061 · Cited by 227
Multiframe Motion Segmentation with Missing Data Using PowerFactorization and GPCA
Vidal, R., Tron, R., & Hartley, R. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0099-z · Cited by 216
Ochs, P., & Brox, T. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126418 · Cited by 205
Self-citationFeature tracking and matching in video using programmable graphics hardware
Sinha, S. N., Frahm, J., Pollefeys, M., et al. (2007) · Machine Vision and Applications · doi:10.1007/s00138-007-0105-z · Cited by 200
Combining Appearance and Structure from Motion Features for Road Scene Understanding
Sturgess, P., Alahari, K., Ladicky, L., & Torr, P. H. S. (2009) · Procedings of the British Machine Vision Conference 2009 · doi:10.5244/c.23.62 · Cited by 189
Track to the future: Spatio-temporal video segmentation with long-range motion cues
Lezama, J., Alahari, K., Sivic, J., & Laptev, I. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.6044588 · Cited by 184
Komodakis, N., Tziritas, G., & Paragios, N. (2008) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2008.06.007 · Cited by 183
Video segmentation by tracing discontinuities in a trajectory embedding
Fragkiadaki, K., Zhang, G., & Shi, J. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247883 · Cited by 174
A Convex Approach to Minimal Partitions
Chambolle, A., Cremers, D., & Pock, T. (2012) · SIAM Journal on Imaging Sciences · doi:10.1137/110856733 · Cited by 171
Fixed-rank representation for unsupervised visual learning
Liu, R., Lin, Z., de la Torre, F. N., & Su, Z. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247726 · Cited by 150
LIVEcut: Learning-based interactive video segmentation by evaluation of multiple propagated cues
Price, B. L., Morse, B. S., & Cohen, S. D. (2009) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2009.5459293 · Cited by 150
Multiple Hypothesis Video Segmentation from Superpixel Flows
Vázquez-Reina, A., Avidan, S., Pfister, H., & Miller, E. L. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15555-0_20 · Cited by 145
Motion layer extraction in the presence of occlusion using graph cuts
Xiao, J., & Shah, M. A. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.202 · Cited by 139
Visual Parsing After Recovery From Blindness
Ostrovsky, Y., Meyers, E. M., Ganesh, S., Mathur, U., & Sinha, P. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02471.x · Cited by 135
Brox, T., & Cremers, D. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-008-0153-5 · Cited by 128
Self-citationTVSeg - Interactive Total Variation Based Image Segmentation
Unger, M., Pock, T., Trobin, W., Cremers, D., & Bischof, H. (2008) · British Machine Vision Conference (BMVC) · doi:10.5244/c.22.40 · Cited by 119
Learning Layered Motion Segmentations of Video
Kumar, M. P. P., Torr, P. H. S., & Zisserman, A. (2007) · International Journal of Computer Vision · doi:10.1007/s11263-007-0064-x · Cited by 112
Variational Motion Segmentation with Level Sets
Brox, T., Bruhn, A., & Weickert, J. (2006) · Lecture notes in computer science · doi:10.1007/11744023_37 · Cited by 108
Self-citationSparse Occlusion Detection with Optical Flow
Ayvacı, A., Raptis, M., & Soatto, S. (2011) · International Journal of Computer Vision · doi:10.1007/s11263-011-0490-7 · Cited by 102
Layered segmentation and optical flow estimation over time
Sun, D., Sudderth, E. B., & Black, M. J. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247873 · Cited by 90
Object Level Grouping for Video Shots
Šivic, J., Schaffalitzky, F., & Zisserman, A. (2006) · International Journal of Computer Vision · doi:10.1007/s11263-005-4264-y · Cited by 88
Monocular Visual Scene Understanding: Understanding Multi-Object Traffic Scenes
Wojek, C., Walk, S., Roth, S., Konrad Schindler, B., & Schiele, B. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.174 · Cited by 87
Two-Granularity Tracking: Mediating Trajectory and Detection Graphs for Tracking under Occlusions
Fragkiadaki, K., Zhang, W., Zhang, G., & Shi, J. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33715-4_40 · Cited by 66
Fast gain-adaptive KLT tracking on the GPU
Zach, C., Gallup, D., & Frahm, J. (2008) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2008.4563089 · Cited by 64
Piecewise-Smooth Dense Optical Flow via Level Sets
Amiaz, T., & Kiryati, N. (2006) · International Journal of Computer Vision · doi:10.1007/s11263-005-6206-0 · Cited by 62
Projective Factorization of Multiple Rigid-Body Motions
Li, T., Kallem, V., Singaraju, D., & Vidal, R. (2007) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2007.383090 · Cited by 52
Joint tracking of features and edges
Birchfield, S. T., & Pundlik, S. J. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587486 · Cited by 41
Seeing the Objects Behind the Dots: Recognition in Videos from a Moving Camera
Ommer, B., Mader, T., & Buhmann, J. M. (2009) · International Journal of Computer Vision · doi:10.1007/s11263-009-0211-7 · Cited by 38
Finding boundaries in natural images: A new method using point descriptors and area completion
Belongie, S., & Malik, J. (1998) · Lecture notes in computer science · doi:10.1007/bfb0055702 · Cited by 31
Self-citationInteractive Motion Segmentation
Nieuwenhuis, C., Berkels, B., Rumpf, M., & Cremers, D. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15986-2_49 · Cited by 5
Cited by
FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networks
Ilg, E., Mayer, N., Saikia, T., Keuper, M., Dosovitskiy, A., & Brox, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.179 · Cited by 3,152
Self-citationOne-Shot Video Object Segmentation
Caelles, S., Maninis, K.-K., Pont-Tuset, J., Leal-Taixe, L., Cremers, D., & Van Gool, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.565 · Cited by 927
MOTS: Multi-Object Tracking and Segmentation
Voigtlaender, P., Krause, M., Osep, A., Luiten, J., Sekar, B. B. G., Geiger, A., & Leibe, B. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00813 · Cited by 658
Learning a Neural Solver for Multiple Object Tracking
Braso, G., & Leal-Taixe, L. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00628 · Cited by 504
Yang, L., Fan, Y., & Xu, N. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00529 · Cited by 470
Metadata
- Authors
- Ochs, P., Malik, J., & Brox, T.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2014-06
- Volume
- 36
- Issue
- 6
- Pages
- 1187-1200
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2076756823
- Cited by
- 585
- References
- 60
- FWCI
- 50.15
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.