The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.
See More, Know More: Unsupervised Video Object Segmentation With Co-Attention Siamese Networks
Open accessAbstract
We introduce a novel network, called as CO-attention Siamese Network (COSNet), to address the unsupervised video object segmentation task from a holistic view. We emphasize the importance of inherent correlation among video frames and incorporate a global co-attention mechanism to improve further the state-of-the-art deep learning based solutions that primarily focus on learning discriminative foreground representations over appearance and motion in short-term temporal segments. The co-attention layers in our network provide efficient and competent stages for capturing global correlations and scene context by jointly computing and appending co-attention responses into a joint feature space. We train COSNet with pairs of video frames, which naturally augments training data and allows increased learning capacity. During the segmentation stage, the co-attention model encodes useful information by processing multiple reference frames together, which is leveraged to infer the frequently reappearing and salient foreground objects better. We propose a unified and end-to-end trainable framework where different co-attention variants can be derived for mining the rich context within videos. Our extensive experiments over three large benchmarks manifest that COSNet outperforms the current alternatives by a large margin. We will publicly release our implementation and models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
Wang, X., Girshick, R., Gupta, A., & He, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00813 · Cited by 11,596
Rethinking Atrous Convolution for Semantic Image Segmentation
Chen, L.-C., Papandreou, G., Schroff, F., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1706.05587 · Cited by 7,517
Residual Attention Network for Image Classification
Wang, F., Jiang, M., Qian, C., Yang, S., Li, C., Zhang, H., Wang, X., & Tang, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.683 · Cited by 4,073
Global contrast based salient region detection
Cheng, M.-M., Zhang, G.-X., Mitra, N. J., Huang, X., & Hu, S.-M. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995344 · Cited by 2,976
Recurrent Models of Visual Attention
Mnih, V., Heess, N., Graves, A., & Kavukcuoglu, K. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.6247 · Cited by 2,568
Saliency Detection via Graph-Based Manifold Ranking
Yang, C., Zhang, L., Lu, H., Ruan, X., & Yang, M.-H. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.407 · Cited by 2,554
Global Contrast Based Salient Region Detection
Cheng, M.-M., Mitra, N. J., Huang, X., Torr, P. H. S., & Hu, S.-M. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2345401 · Cited by 2,463
SCA-CNN: Spatial and Channel-Wise Attention in Convolutional Networks for Image Captioning
Chen, L., Zhang, H., Xiao, J., Nie, L., Shao, J., Liu, W., & Chua, T.-S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.667 · Cited by 1,992
A Benchmark Dataset and Evaluation Methodology for Video Object Segmentation
Perazzi, F., Pont-Tuset, J., McWilliams, B., Van Gool, L., Gross, M., & Sorkine-Hornung, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.85 · Cited by 1,989
Hierarchical Question-Image Co-Attention for Visual Question Answering
Lu, J., Yang, J., Batra, D., & Parikh, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.00061 · Cited by 1,129
One-Shot Video Object Segmentation
Caelles, S., Maninis, K.-K., Pont-Tuset, J., Leal-Taixe, L., Cremers, D., & Van Gool, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.565 · Cited by 927
SVDNet for Pedestrian Retrieval
Sun, Y., Zheng, L., Deng, W., & Wang, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.410 · Cited by 825
Object Segmentation by Long Term Analysis of Point Trajectories
Brox, T., & Malik, J. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15555-0_21 · Cited by 744
Multi-context Attention for Human Pose Estimation
Chu, X., Yang, W., Ouyang, W., Ma, C., Yuille, A. L., & Wang, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.601 · Cited by 737
Self-citationSegmentation of Moving Objects by Long Term Video Analysis
Ochs, P., Malik, J., & Brox, T. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.242 · Cited by 585
Deep Visual Attention Prediction
Wang, W., & Shen, J. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2787612 · Cited by 585
Self-citationLearning Video Object Segmentation from Static Images
Perazzi, F., Khoreva, A., Benenson, R., Schiele, B., & Sorkine-Hornung, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.372 · Cited by 581
Fast Object Segmentation in Unconstrained Video
Papazoglou, A., & Ferrari, V. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.223 · Cited by 533
Saliency-aware geodesic video object segmentation
Wang, W., Shen, J., & Porikli, F. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298961 · Cited by 524
Self-citationPyramid Dilated Deeper ConvLSTM for Video Salient Object Detection
Song, H., Wang, W., Zhao, S., Shen, J., & Lam, K.-M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01252-6_44 · Cited by 492
Self-citationDynamic Coattention Networks For Question Answering
Xiong, C., Zhong, V., & Socher, R. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01604 · Cited by 450
SegFlow: Joint Learning for Video Object Segmentation and Optical Flow
Cheng, J., Tsai, Y.-H., Wang, S., & Yang, M.-H. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.81 · Cited by 446
Learning object class detectors from weakly annotated video
Prest, A., Leistner, C., Civera, J., Schmid, C., & Ferrari, V. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248065 · Cited by 443
Key-segments for video object segmentation
Lee, Y. J., Kim, J., & Grauman, K. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126471 · Cited by 443
Learning Features by Watching Objects Move
Pathak, D., Girshick, R., Dollar, P., Darrell, T., & Hariharan, B. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.638 · Cited by 436
Efficient Video Object Segmentation via Network Modulation
Yang, L., Wang, Y., Xiong, X., Yang, J., & Katsaggelos, A. K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00680 · Cited by 386
Jetley, S., Lord, N. A., Lee, N., & Torr, P. H. S. (2018) · arXiv · doi:10.48550/arxiv.1804.02391 · Cited by 383
Video SnapCut: robust video object cutout using localized classifiers
Bai, X., Wang, J., Simons, D., & Sapiro, G. (2009) · ACM Transactions on Graphics · doi:10.1145/1531326.1531376 · Cited by 367
Jain, S. D., Xiong, B., & Grauman, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.228 · Cited by 361
Hierarchical Question-Image Co-Attention for Visual Question Answering
Lu, J. (2024) · TIB Data Manager · doi:10.57702/uhdmfu1r · Cited by 357
Nguyen, D.-K., & Okatani, T. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00637 · Cited by 347
Video Segmentation via Object Flow
Tsai, Y.-H., Yang, M.-H., & Black, M. J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.423 · Cited by 318
Learning Video Object Segmentation with Visual Memory
Tokmakov, P., Alahari, K., & Schmid, C. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.480 · Cited by 316
Zhang, D., Javed, O., & Shah, M. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.87 · Cited by 309
Neural Photo Editing with Introspective Adversarial Networks
Brock, A., Lim, T., Ritchie, J. M., & Weston, N. (2016) · arXiv · doi:10.48550/arxiv.1609.07093 · Cited by 275
Fast and Accurate Online Video Object Segmentation via Tracking Parts
Cheng, J., Tsai, Y.-H., Hung, W.-C., Wang, S., & Yang, M.-H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00774 · Cited by 275
VideoMatch: Matching Based Video Object Segmentation
Hu, Y.-T., Huang, J.-B., & Schwing, A. G. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01237-3_4 · Cited by 274
Learning Motion Patterns in Videos
Tokmakov, P., Alahari, K., & Schmid, C. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.64 · Cited by 267
Deep Regression Tracking with Shrinkage Loss
Lu, X., Ma, C., Ni, B., Yang, X., Reid, I., & Yang, M.-H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_22 · Cited by 243
Self-citationVideo Segmentation by Non-Local Consensus voting.
Faktor, A., & Irani, M. (2014) · Cited by 235
Person Re-identification via Recurrent Feature Aggregation
Yan, Y., Ni, B., Song, Z., Ma, C., Yan, Y., & Yang, X. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_42 · Cited by 233
Self-citationJampani, V., Gadde, R., & Gehler, P. V. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.336 · Cited by 224
Video Object Segmentation with Joint Re-identification and Attention-Aware Mask Propagation
Li, X., & Loy, C. C. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01219-9_6 · Cited by 207
Ochs, P., & Brox, T. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126418 · Cited by 205
Motion Trajectory Segmentation via Minimum Cost Multicuts
Keuper, M., Andres, B., & Brox, T. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.374 · Cited by 199
CNN in MRF: Video Object Segmentation via Inference in a CNN-Based Higher-Order Spatio-Temporal MRF
Bao, L., Wu, B., & Liu, W. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00626 · Cited by 199
Learning to segment moving objects in videos
Fragkiadaki, K., Arbelaez, P., Felsen, P., & Malik, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299035 · Cited by 193
Neural Photo Editing With Introspective Adversarial Networks
Brock, A., Lim, T., Ritchie, J. M., & Weston, N. (2017) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.807637 · Cited by 189
Pixel-Level Matching for Video Object Segmentation Using Convolutional Neural Networks
Yoon, J. S., Rameau, F., Kim, J., Lee, S., Shin, S., & Kweon, I. S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.238 · Cited by 188
Learning Where to Attend with Deep Architectures for Image Tracking
Denil, M., Bazzani, L., Larochelle, H., & de Freitas, N. (2012) · Neural Computation · doi:10.1162/neco_a_00312 · Cited by 180
Maximum weight cliques with mutex constraints for video object segmentation
Ma, T., & Latecki, L. J. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247735 · Cited by 175
Video segmentation by tracing discontinuities in a trajectory embedding
Fragkiadaki, K., Zhang, G., & Shi, J. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247883 · Cited by 174
Fully Connected Object Proposals for Video Segmentation
Perazzi, F., Wang, O., Gross, M., & Sorkine-Hornung, A. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.369 · Cited by 173
Primary Object Segmentation in Videos Based on Region Augmentation and Reduction
Koh, Y. J., & Kim, C.-S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.784 · Cited by 171
MoNet: Deep Motion Exploitation for Video Object Segmentation
Xiao, H., Feng, J., Lin, G., Liu, Y., & Zhang, M. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00125 · Cited by 151
Pairwise Body-Part Attention for Recognizing Human-Object Interactions
Fang, H.-S., Cao, J., Tai, Y., & Lu, C. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01249-6_4 · Cited by 145
Unsupervised Video Object Segmentation with Motion-Based Bilateral Networks
Li, S., Seybold, B., Vorobyov, A., Lei, X., & Kuo, C. ‐. J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01219-9_13 · Cited by 145
Robust Video Object Cosegmentation
Wang, W., Shen, J., Li, X., & Porikli, F. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2438550 · Cited by 135
Self-citationAre You Talking to Me? Reasoned Visual Dialog Generation Through Adversarial Learning
Wu, Q., Wang, P., Shen, C., Reid, I. D., & van den Hengel, A. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00639 · Cited by 134
Learning Support Correlation Filters for Visual Tracking
Zuo, W., Wu, X., Lin, L., Zhang, L., & Yang, M. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2829180 · Cited by 126
Regularizing CNNs with Locally Constrained DecorrelationsPreprint
Rodríguez, P., Gonzàlez, J., Cucurull, G., Gonfaus, J. M., & Roca, F. X. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01967 · Cited by 121
Causal video object segmentation from persistence of occlusions
Taylor, B., Karasev, V. I., & Soattoc, S. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7299055 · Cited by 119
Unsupervised Video Object Segmentation Using Motion Saliency-Guided Spatio-Temporal Propagation
Hu, Y.-T., Huang, J., & Schwing, A. G. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01246-5_48 · Cited by 113
Instance Embedding Transfer to Unsupervised Video Object Segmentation
Li, S., Seybold, B., Vorobyov, A., Fathi, A., Huang, Q., & Kuo, C. ‐. J. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00683 · Cited by 111
Lucid Data Dreaming for Object Tracking
Khoreva, A., Benenson, R., Ilg, E., Brox, T., & Schiele, B. (2017) · MPG.PuRe (Max Planck Society) · Cited by 92
Object-Based Multiple Foreground Video Co-segmentation
Fu, H., Xu, D., Zhang, B., et al. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.405 · Cited by 79
Video Object Segmentation by Learning Location-Sensitive Embeddings
Ci, H., Wang, C., & Wang, Y. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01252-6_31 · Cited by 62
Super-Trajectory for Video Segmentation
Wang, W.-G., Shen, J.-B., Xie, J., & Porikli, F. (2017) · IEEE International Conference on Computer Vision · doi:10.1109/iccv.2017.185 · Cited by 50
Self-citationSequential Clique Optimization for Video Object Segmentation
Koh, Y. J., Lee, Y.-Y., & Kim, C. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01264-9_32 · Cited by 23
Cited by
Li, R., Zheng, S., Zhang, C., Duan, C., Wang, L., & Atkinson, P. M. (2021) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2021.09.005 · Cited by 443
PARE: Part Attention Regressor for 3D Human Body Estimation
Kocabas, M., Huang, C.-H. P., Hilliges, O., & Black, M. J. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01094 · Cited by 417
Shen, Z., Wang, W., Lu, X., Shen, J., Ling, H., Xu, T., & Shao, L. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00567 · Cited by 359
Self-citationRGB-D salient object detection: A survey
Zhou, T., Fan, D.-P., Cheng, M.-M., Shen, J., & Shao, L. (2021) · Computational Visual Media · doi:10.1007/s41095-020-0199-z · Cited by 331
Self-citationZero-Shot Video Object Segmentation via Attentive Graph Neural Networks
Wang, W., Lu, X., Shen, J., Crandall, D., & Shao, L. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00933 · Cited by 303
Self-citation
Metadata
- Authors
- Lu, X., Wang, W., Ma, C., Shen, J., Shao, L., & Porikli, F.
- Venue
- 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2019-06
- Pages
- 3618-3627
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2955084925
- Cited by
- 521
- References
- 73
- FWCI
- 27.32
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.