The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Cross-Batch Memory for Embedding Learning
Open accessAbstract
Mining informative negative instances are of central importance to deep metric learning (DML). However, the hard-mining ability of existing DML methods is intrinsically limited by mini-batch training, where only a mini-batch of instances are accessible at each iteration. In this paper, we identify a “slow drift” phenomena by observing that the embedding features drift exceptionally slow even as the model parameters are updating throughout the training process. It suggests that the features of instances computed at preceding iterations can considerably approximate to their features extracted by current model. We propose a cross-batch memory (XBM) mechanism that memorizes the embeddings of past iterations, allowing the model to collect sufficient hard negative pairs across multiple mini-batches - even over the whole dataset. Our XBM can be directly integrated into general pair-based DML framework.We demonstrate that, without bells and whistles, XBM augmented DML can boost the performance considerably on image retrieval. In particular, with XBM, a simple contrastive loss can have large R@1 improvements of 12%-22.5% on three large-scale datasets, easily surpassing the most sophisticated state-of-the-art methods [38, 27, 2], by a large margin. Our XBM is conceptually simple, easy to implement - using several lines of codes, and is memory efficient - with a negligible 0.2 GB extra GPU memory.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
FaceNet: A unified embedding for face recognition and clustering
Schroff, F., Kalenichenko, D., & Philbin, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298682 · Cited by 15,267
Momentum Contrast for Unsupervised Visual Representation Learning
He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00975 · Cited by 13,347
Dimensionality Reduction by Learning an Invariant Mapping
Hadsell, R., Chopra, S., & LeCun, Y. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.100 · Cited by 5,336
A Discriminative Feature Learning Approach for Deep Face Recognition
Wen, Y., Zhang, K., Li, Z., & Qiao, Y. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46478-7_31 · Cited by 4,077
Learning a Similarity Metric Discriminatively, with Application to Face Verification
Chopra, S., Hadsell, R., & LeCun, Y. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.202 · Cited by 4,036
Unsupervised Feature Learning via Non-parametric Instance Discrimination
Wu, Z., Xiong, Y., Yu, S. X., & Lin, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00393 · Cited by 3,664
In Defense of the Triplet Loss for Person Re-Identification
Hermans, A., Beyer, L., & Leibe, B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.07737 · Cited by 2,687
DeepFashion: Powering Robust Clothes Recognition and Retrieval with Rich Annotations
Liu, Z., Luo, P., Qiu, S., Wang, X., & Tang, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.124 · Cited by 1,803
Self-citationDeep Metric Learning via Lifted Structured Feature Embedding
Song, H. O., Xiang, Y., Jegelka, S., & Savarese, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.434 · Cited by 1,630
(2016) · neural information processing systems · Cited by 1,572
Siamese Instance Search for Tracking
Tao, R., Gavves, E., & Smeulders, A. W. M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.158 · Cited by 1,208
Joint Detection and Identification Feature Learning for Person Search
Xiao, T., Li, S., Wang, B., Lin, L., & Wang, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.360 · Cited by 890
Self-citationMulti-Similarity Loss With General Pair Weighting for Deep Metric Learning
Wang, X., Han, X., Huang, W., Dong, D., & Scott, M. R. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00516 · Cited by 854
Self-citationSampling Matters in Deep Embedding Learning
Wu, C.-Y., Manmatha, R., Smola, A. J., & Krahenbuhl, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.309 · Cited by 836
Deep Relative Distance Learning: Tell the Difference between Similar Vehicles
Liu, H., Tian, Y., Wang, Y., Pang, L., & Huang, T. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.238 · Cited by 782
Invariance Matters: Exemplar Memory for Domain Adaptive Person Re-Identification
Zhong, Z., Zheng, L., Luo, Z., Li, S., & Yang, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00069 · Cited by 685
No Fuss Distance Metric Learning Using Proxies
Movshovitz-Attias, Y., Toshev, A., Leung, T. K., Ioffe, S., & Singh, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.47 · Cited by 626
Deep Metric Learning with Hierarchical Triplet Loss
Ge, W., Huang, W., Dong, D., & Scott, M. R. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01231-1_17 · Cited by 445
Self-citationLearning by Tracking: Siamese CNN for Robust Target Association
Leal-Taixe, L., Canton-Ferrer, C., & Schindler, K. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.59 · Cited by 444 · cited 1×
“As a fundamental problem in computer vision, DML has been applied to various tasks, including image retrieval [39, 12, 7], face recognition [38], zero-shot learning [47, 1, 16], visual tracking [17, 34] and person re-identification [44, 13].”
MethodSoftTriple Loss: Deep Metric Learning Without Triplet Sampling
Qian, Q., Shang, L., Sun, B., Hu, J., Tacoma, T., Li, H., & Jin, R. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00655 · Cited by 402
Triplet-Center Loss for Multi-view 3D Object Retrieval
He, X., Zhou, Y., Zhou, Z., Bai, S., & Bai, X. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00208 · Cited by 390
Learning descriptors for object recognition and 3D pose estimation
Wohlhart, P., & Lepetit, V. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298930 · Cited by 358
Smart Mining for Deep Metric Learning
Harwood, B., Kumar B.G., V., Carneiro, G., Reid, I., & Drummond, T. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.307 · Cited by 344
Zero-Shot Learning via Joint Latent Similarity Embedding
Zhang, Z., & Saligrama, V. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.649 · Cited by 336
Hard-Aware Deeply Cascaded Embedding
Yuan, Y., Yang, K., & Zhang, C. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.94 · Cited by 307
Deep Metric Learning via Facility Location
Song, H. O., Jegelka, S., Rathod, V., & Murphy, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.237 · Cited by 287
Cakir, F., He, K., Xia, X., Kulis, B., & Sclaroff, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00196 · Cited by 248
Attention-Based Ensemble for Deep Metric Learning
Kim, W., Goyal, B., Chawla, K., Lee, J., & Kwon, K. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01246-5_45 · Cited by 234
Learning Deep Embeddings with Histogram Loss
Ustinova, E., & Lempitsky, V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.00822 · Cited by 222
Vehicle Re-Identification With Viewpoint-Aware Metric Learning
Chu, R., Sun, Y., Li, Y., Liu, Z., Zhang, C., & Wei, Y. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00837 · Cited by 203
A Zero-Shot Framework for Sketch Based Image Retrieval
Yelamarthi, S. K., Reddy, S. K., Mishra, A., & Mittal, A. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01225-0_19 · Cited by 198
Improving Semantic Embedding Consistency by Metric Learning for Zero-Shot Classiffication
Bucher, M., Herbin, S., & Jurie, F. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46454-1_44 · Cited by 178
Improving Generalization via Scalable Neighborhood Component Analysis
Wu, Z., Efros, A. A., & Yu, S. X. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01234-2_42 · Cited by 163
Deep Metric Learning with BIER: Boosting Independent Embeddings Robustly
Opitz, M., Waltner, G., Possegger, H., & Bischof, H. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2848925 · Cited by 159
3D Pose Estimation and 3D Model Retrieval for Objects in the Wild
Grabner, A., Roth, P. M., & Lepetit, V. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00319 · Cited by 154
Hard-Aware Point-to-Set Deep Metric for Person Re-identification
Yu, R., Dou, Z., Bai, S., Zhang, Z., Xu, Y., & Bai, X. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01270-0_12 · Cited by 147
BIER — Boosting Independent Embeddings Robustly
Opitz, M., Waltner, G., Possegger, H., & Bischof, H. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.555 · Cited by 138
Stochastic Class-Based Hard Example Mining for Deep Metric Learning
Suh, Y., Han, B., Kim, W., & Lee, K. M. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00742 · Cited by 138
Divide and Conquer the Embedding Space for Metric Learning
Sanakoyeu, A., Tschernezki, V., Büchler, U., & Ommer, B. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00056 · Cited by 135
MIC: Mining Interclass Characteristics for Improved Metric Learning
Brattoli, B., Roth, K., & Ommer, B. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00809 · Cited by 113
No Fuss Distance Metric Learning using ProxiesPreprint
Movshovitz-Attias, Y., Toshev, A., Leung, T. K., Ioffe, S., & Singh, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.07464 · Cited by 105
Memory-Based Neighbourhood Embedding for Visual Recognition
Li, S., Chen, D., 刘, 斌., Yu, N., & Zhao, R. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00620 · Cited by 48
Divide and Conquer the Embedding Space for Metric LearningPreprint
Sanakoyeu, A., Tschernezki, V., Büchler, U., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.05990 · Cited by 10
Cited by
Exploring Cross-Image Pixel Contrast for Semantic Segmentation
Wang, W., Zhou, T., Yu, F., Dai, J., Konukoglu, E., & Gool, L. V. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00721 · Cited by 604
Cross-Image Relational Knowledge Distillation for Semantic Segmentation
Yang, C., Zhou, H., An, Z., Jiang, X., Xu, Y., & Zhang, Q. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01200 · Cited by 265
Wu, Y., Rabe, M. N., Hutchins, D., & Szegedy, C. (2022) · arXiv · doi:10.48550/arxiv.2203.08913 · Cited by 90
Solving Inefficiency of Self-supervised Representation Learning
Wang, G., Wang, K., Wang, G., Torr, P. H. S., & Lin, L. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00937 · Cited by 65
An Improved Inter-Intra Contrastive Learning Framework on Self-Supervised Video Representation
Tao, L., Wang, X., & Yamasaki, T. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3141051 · Cited by 50
Self-citation
Metadata
- Authors
- Wang, X., Zhang, H., Huang, W., & Scott, M. R.
- Venue
- 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2020-06
- Pages
- 6387-6396
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3035014997
- Cited by
- 254
- References
- 47
- FWCI
- 14.03
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.