The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Multiple People Tracking by Lifted Multicut and Person Re-identification
Abstract
Tracking multiple persons in a monocular video of a crowded scene is a challenging task. Humans can master it even if they loose track of a person locally by re-identifying the same person based on their appearance. Care must be taken across long distances, as similar-looking persons need not be identical. In this work, we propose a novel graph-based formulation that links and clusters person hypotheses over time by solving an instance of a minimum cost lifted multicut problem. Our model generalizes previous works by introducing a mechanism for adding long-range attractive connections between nodes in the graph without modifying the original set of feasible solutions. This allows us to reward tracks that assign detections of similar appearance to the same person in a way that does not introduce implausible solutions. To effectively match hypotheses over longer temporal gaps we develop new deep architectures for re-identification of people. They combine holistic representations extracted with deep networks and body pose layout obtained with a state-of-the-art pose estimation model. We demonstrate the effectiveness of our formulation by reporting a new state-of-the-art for the MOT16 benchmark. The code and pre-trained models are publicly available.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Parkhi, O. M., Vedaldi, A., & Zisserman, A. (2015) · Procedings of the British Machine Vision Conference 2015 · doi:10.5244/c.29.41 · Cited by 5,479
Scalable Person Re-identification: A Benchmark
Zheng, L., Shen, L., Tian, L., Wang, S., Wang, J., & Tian, Q. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.133 · Cited by 4,506
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1408.5093 · Cited by 3,752
Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics
Bernardin, K., & Stiefelhagen, R. (2008) · EURASIP Journal on Image and Video Processing · doi:10.1155/2008/246309 · Cited by 2,918
DeepReID: Deep Filter Pairing Neural Network for Person Re-identification
Li, W., Zhao, R., Xiao, T., & Wang, X. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.27 · Cited by 2,611
MOT16: A Benchmark for Multi-Object Tracking
Milan, A., Leal-Taixe, L., Reid, I., Roth, S., & Schindler, K. (2016) · arXiv · doi:10.48550/arxiv.1603.00831 · Cited by 1,309 · cited 4×
“Multiple people tracking has improved considerably in the last two years, driven also by the MOT challenges [18, 20].”
BackgroundMethodResultInfluentialDeepCut: Joint Subset Partition and Labeling for Multi Person Pose Estimation
Pishchulin, L., Insafutdinov, E., Tang, S., Andres, B., Andriluka, M., Gehler, P., & Schiele, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.533 · Cited by 1,051
Self-citationMultiple Object Tracking Using K-Shortest Paths Optimization
Berclaz, J., Fleuret, F., Turetken, E., & Fua, P. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.21 · Cited by 1,015
DeepFlow: Large Displacement Optical Flow with Deep Matching
Weinzaepfel, P., Revaud, J., Harchaoui, Z., & Schmid, C. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.175 · Cited by 997
Global data association for multi-object tracking using network flows
Zhang, L., Li, Y., & Nevatia, R. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587584 · Cited by 925
Globally-optimal greedy algorithms for tracking a variable number of objects
Pirsiavash, H., Ramanan, D., & Fowlkes, C. C. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995604 · Cited by 790
MOTChallenge 2015: Towards a Benchmark for Multi-Target Tracking
Leal-Taixé, L., Milan, A., Reid, I. D., Roth, S., & Schindler, K. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.01942 · Cited by 743
Learning to Track: Online Multi-object Tracking by Decision Making
Xiang, Y., Alahi, A., & Savarese, S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.534 · Cited by 674
Multiple Hypothesis Tracking Revisited
Kim, C., Li, F., Ciptadi, A., & Rehg, J. M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.533 · Cited by 666
Continuous Energy Minimization for Multitarget Tracking
Milan, A., Roth, S., & Schindler, K. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.103 · Cited by 565
Learning by Tracking: Siamese CNN for Robust Target Association
Leal-Taixe, L., Canton-Ferrer, C., & Schindler, K. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.59 · Cited by 444
3D Traffic Scene Understanding From Movable Platforms
Geiger, A., Lauer, M., Wojek, C., Stiller, C., & Urtasun, R. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.185 · Cited by 397
Near-Online Multi-target Tracking with Aggregated Local Flow Descriptor
Choi, W. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.347 · Cited by 396
GMCP-Tracker: Global Multi-object Tracking Using Generalized Minimum Clique Graphs
Roshan Zamir, A., Dehghan, A., & Shah, M. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33709-3_25 · Cited by 353
Correlation clustering in general weighted graphs
Demaine, E. D., Emanuel, D., Fiat, A., & Immorlica, N. (2006) · Theoretical Computer Science · doi:10.1016/j.tcs.2006.05.008 · Cited by 283
Multiobject tracking as maximum weight independent set
Brendel, W., Amer, M., & Todorovic, S. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995395 · Cited by 265
Subgraph decomposition for multi-target tracking
Tang, S., Andres, B., Andriluka, M., & Schiele, B. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299138 · Cited by 193
Self-citationDetection and Tracking of Occluded People
Tang, S., Andriluka, M., & Schiele, B. (2014) · International Journal of Computer Vision · doi:10.1007/s11263-013-0664-6 · Cited by 173
Self-citationMultiple Target Tracking Based on Undirected Hierarchical Relation Hypergraph
Wen, L., Li, W., Yan, J., Lei, Z., Yi, D., & Li, S. Z. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.167 · Cited by 170
Efficient Decomposition of Image and Mesh Graphs by Lifted Multicuts
Keuper, M., Levinkov, E., Bonneel, N., Lavoué, G., Brox, T., & Andres, B. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.204 · Cited by 129
Self-citationTracking Interacting Objects Using Intertwined Flows
Wang, X., Türetken, E., Fleuret, F., & Fua, P. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2513406 · Cited by 120
Target Identity-aware Network Flow for online multiple target tracking
Dehghan, A., Tian, Y., Torr, P. H. S., & Shah, M. A. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298718 · Cited by 106
A Multi-cut Formulation for Joint Segmentation and Tracking of Multiple ObjectsPreprint
Keuper, M., Tang, S., Zhongjie, Y., Andres, B., Brox, T., & Schiele, B. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.06317 · Cited by 95
Self-citationFagot-Bouquet, L., Audigier, R., Dhome, Y., & Lerasle, F. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46484-8_47 · Cited by 94
Learning People Detectors for Tracking in Crowded Scenes
Tang, S., Andriluka, M., Milan, A., Konrad Schindler, B., Roth, S., & Schiele, B. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.134 · Cited by 91
Self-citationTracking Multiple Persons Based on a Variational Bayesian Model
Ban, Y., Ba, S., Alameda-Pineda, X., & Horaud, R. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-48881-3_5 · Cited by 67
Tracking Multiple People Online and in Real Time
Ristani, E., & Tomasi, C. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16814-2_29 · Cited by 64
Long-Term Time-Sensitive Costs for CRF-Based Tracking by Detection
Le, N., Heili, A., & Odobez, J. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-48881-3_4 · Cited by 43
Multiple Object Tracking by Efficient Graph Partitioning
Kumar, R., Charpiat, G., & Thonnat, M. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16817-3_29 · Cited by 28
Lifting of MulticutsPreprint
Andres, B. (2015) · arXiv (Cornell University) · Cited by 10
Self-citation
Cited by
High Performance Visual Tracking with Siamese Region Proposal Network
Li, B., Yan, J., Wu, W., Zhu, Z., & Hu, X. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00935 · Cited by 3,023
Deep Learning for Person Re-Identification: A Survey and Outlook
Ye, M., Shen, J., Lin, G., Xiang, T., Shao, L., & Hoi, S. C. H. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3054775 · Cited by 2,259
FairMOT: On the Fairness of Detection and Re-identification in Multiple Object Tracking
Zhang, Y., Wang, C., Wang, X., Zeng, W., & Liu, W. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01513-4 · Cited by 1,861
Zhou, X., Koltun, V., & Krähenbühl, P. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58548-8_28 · Cited by 1,428
Towards Real-Time Multi-Object Tracking
Wang, Z., Zheng, L., Liu, Y., Li, Y., & Wang, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58621-8_7 · Cited by 1,195
Metadata
- Authors
- Tang, S., Andriluka, M., Andres, B., & Schiele, B.
- Venue
- 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2017-07
- Pages
- 3701-3710
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2739491435
- Cited by
- 543
- References
- 37
- FWCI
- 17.39
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.