The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Instance Segmentation by Jointly Optimizing Spatial Embeddings and Clustering Bandwidth
Open accessAbstract
Current state-of-the-art instance segmentation methods are not suited for real-time applications like autonomous driving, which require fast execution times at high accuracy. Although the currently dominant proposal-based methods have high accuracy, they are slow and generate masks at a fixed and low resolution. Proposal-free methods, by contrast, can generate masks at high resolution and are often faster, but fail to reach the same accuracy as the proposal-based methods. In this work we propose a new clustering loss function for proposal-free instance segmentation. The loss function pulls the spatial embeddings of pixels belonging to the same instance together and jointly learns an instance-specific clustering bandwidth, maximizing the intersection-over-union of the resulting instance mask. When combined with a fast architecture, the network can perform instance segmentation in real-time while maintaining a high accuracy. We evaluate our method on the challenging Cityscapes benchmark and achieve top results (5% improvement over Mask R-CNN) at more than 10 fps on 2MP images.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
Path Aggregation Network for Instance Segmentation
Liu, S., Qi, L., Qin, H., Shi, J., & Jia, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00913 · Cited by 10,011
Multi-task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semantics
Cipolla, R., Gal, Y., & Kendall, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00781 · Cited by 3,151
What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?
Kendall, A., & Gal, Y. (2017) · arXiv · doi:10.48550/arxiv.1703.04977 · Cited by 3,088
ERFNet: Efficient Residual Factorized ConvNet for Real-Time Semantic Segmentation
Romera, E., Alvarez, J. M., Bergasa, L. M., & Arroyo, R. (2018) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2017.2750080 · Cited by 1,484
Instance-aware Semantic Segmentation via Multi-task Network Cascades
Dai, J., He, K., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1512.04412 · Cited by 1,273
Instance-Aware Semantic Segmentation via Multi-task Network Cascades
Dai, J., He, K., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.343 · Cited by 1,244
Fully Convolutional Instance-Aware Semantic Segmentation
Li, Y., Qi, H., Dai, J., Ji, X., & Wei, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.472 · Cited by 1,116
Berman, M., Triki, A. R., & Blaschko, M. B. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00464 · Cited by 1,027
An Intriguing Failing of Convolutional Neural Networks and the CoordConv Solution
Liu, R., Lehman, J., Molino, P., Such, F. P., Frank, E., Sergeev, A., & Yosinski, J. (2018) · arXiv · doi:10.48550/arxiv.1807.03247 · Cited by 784
Learning to Refine Object Segments
Pinheiro, P. O., Lin, T.-Y., Collobert, R., & Dollár, P. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_5 · Cited by 731
Learning to Segment Object Candidates
Pinheiro, P. O., Collobert, R., & Dollár, P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.06204 · Cited by 648
Deep Watershed Transform for Instance Segmentation
Bai, M., & Urtasun, R. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.305 · Cited by 539
Associative Embedding: End-to-End Learning for Joint Detection and Grouping
Newell, A., Huang, Z., & Deng, J. H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.05424 · Cited by 461
Efficient Interactive Annotation of Segmentation Datasets with Polygon-RNN++
Acuna, D., Ling, H., Kar, A., & Fidler, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00096 · Cited by 414
Semantic Instance Segmentation with a Discriminative Loss Function
Brabandere, B. D., Neven, D., & Gool, L. V. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.02551 · Cited by 392
Self-citationSGN: Sequential Grouping Networks for Instance Segmentation
Liu, S., Jia, J., Fidler, S., & Urtasun, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.378 · Cited by 269
Proposal-Free Network for Instance-Level Object Segmentation
Liang, X., Lin, L., Wei, Y., Shen, X., Yang, J., & Yan, S. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2775623 · Cited by 224
Pixelwise Instance Segmentation with a Dynamically Instantiated Network
Arnab, A., & Torr, P. H. S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.100 · Cited by 222
Semantic Instance Segmentation via Deep Metric Learning
Fathi, A., Wojna, Z., Rathod, V., Wang, P., Song, H. O., Guadarrama, S., & Murphy, K. P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.10277 · Cited by 182
Recurrent Pixel Embedding for Instance Grouping
Kong, S., & Fowlkes, C. C. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00940 · Cited by 172
Boundary-Aware Instance Segmentation
Hayder, Z., He, X., & Salzmann, M. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.70 · Cited by 158
Affinity Derivation and Graph Merge for Instance Segmentation
Liu, Y., Yang, S., Li, B., Zhou, W., Xu, J., Li, H., & Lu, Y. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01219-9_42 · Cited by 112
Semi-convolutional Operators for Instance Segmentation
Novotný, D., Albanie, S., Larlus, D., & Vedaldi, A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01246-5_6 · Cited by 85
Box2Pix: Single-Shot Instance Segmentation by Assigning Pixels to Object Boxes
Uhrig, J., Rehder, E., Fröhlich, B., Franke, U., & Brox, T. (2018) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2018.8500621 · Cited by 68
Berman, M., Triki, A. R., & Blaschko, M. B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.08790 · Cited by 65
Learning Submodular Losses with the Lovász Hinge
Yu, J., & Blaschko, M. B. (2015) · HAL · Cited by 33
Instance-Level Segmentation of Vehicles by Deep Contours
van den Brand, J., Ochs, M., & Mester, R. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-54407-6_32 · Cited by 15
Semi-convolutional Operators for Instance SegmentationPreprint
Novotný, D., Albanie, S., Larlus, D., & Vedaldi, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.10712 · Cited by 8
Cited by
Cellpose: a generalist algorithm for cellular segmentation
Stringer, C., Wang, T., Michaelos, M., & Pachitariu, M. (2021) · Nature Methods · doi:10.1038/s41592-020-01018-x · Cited by 4,369
Axial-DeepLab: Stand-Alone Axial-Attention for Panoptic Segmentation
Wang, H., Zhu, Y., Green, B., Adam, H., Yuille, A., & Chen, L.-C. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58548-8_7 · Cited by 809
Conditional Convolutions for Instance Segmentation
Tian, Z., Shen, C., & Chen, H. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_17 · Cited by 712
Panoptic-DeepLab: A Simple, Strong, and Fast Baseline for Bottom-Up Panoptic Segmentation
Cheng, B., Collins, M. D., Zhu, Y., Liu, T., Huang, T. S., Adam, H., & Chen, L.-C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01249 · Cited by 635
BlendMask: Top-Down Meets Bottom-Up for Instance Segmentation
Chen, H., Sun, K., Tian, Z., Shen, C., Huang, Y., & Yan, Y. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00860 · Cited by 601
Metadata
- Authors
- Neven, D., Brabandere, B. D., Proesmans, M., & Van Gool, L.
- Venue
- 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2019-06
- Pages
- 8829-8837
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2955671438
- Cited by
- 258
- References
- 30
- FWCI
- 14.93
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.