The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Dual Encoding for Zero-Example Video Retrieval
Abstract
This paper attacks the challenging problem of zero-example video retrieval. In such a retrieval paradigm, an end user searches for unlabeled videos by ad-hoc queries described in natural language text with no visual example provided. Given videos as sequences of frames and queries as sequences of words, an effective sequence-to-sequence cross-modal matching is required. The majority of existing methods are concept based, extracting relevant concepts from queries and videos and accordingly establishing associations between the two modalities. In contrast, this paper takes a concept-free approach, proposing a dual deep encoding network that encodes videos and queries into powerful dense representations of their own. Dual encoding is conceptually simple, practically effective and end-to-end. As experiments on three benchmarks, i.e. MSR-VTT, TRECVID 2016 and 2017 Ad-hoc Video Search show, the proposed solution establishes a new state-of-the-art for zero-example video retrieval.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“R-ConvED [48] retrieves relevant sentences and videos via Dual Encoding [70], and predicts the target word with a convolutional encoderdecoder network.”
From Retrieval-Augmented Generation for AI-Generated Content: A Survey (2024) · cites this paper as [70]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Bidirectional recurrent neural networks
Schuster, M., & Paliwal, K. K. (1997) · IEEE Transactions on Signal Processing · doi:10.1109/78.650093 · Cited by 10,172 · cited 1×
“Bi-directional recurrent neural network [27] is known to be effective for making use of both past and future contextual information of a given sequence.”
BackgroundLearning Spatiotemporal Features with 3D Convolutional Networks
Tran, D., Bourdev, L., Fergus, R., Torresani, L., & Paluri, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.510 · Cited by 9,593
Research works printed but not linked: 31
- 10.1109/CVPR.2016.571 · DOI · Paper page
- 10.1109/CVPR.2017.634 · DOI · Paper page
- 10.1109/CVPR.2014.341 · DOI
- ueki, 2017, Waseda_Meisei at TRECVID 2017: Ad-hoc video search, TRECVID Workshop
- 10.1109/CVPR.2017.347 · DOI · Paper page
- 10.1007/978-3-030-01234-2_29 · DOI · Paper page
- 10.1162/tacl_a_00166 · DOI · Paper page
- xu, 2015, Jointly modeling deep video and compositional text to bridge vision and language in a unified framework, AAAI, 10.1609/aaai.v29i1.9512 · DOI · Paper page
- 10.1109/TPAMI.2016.2627563 · DOI
- 10.1145/2647868.2654918 · DOI · Paper page
- 10.3115/v1/D14-1181 · DOI · Paper page
- le, 2016, NII-HITACHI-UIT at TRECVID 2016, TRECVID Workshop
- li, 2018, Renmin University of China and Zhejiang Gongshang University at TRECVID 2018: Deep cross-modal embeddings for videotext retrieval, TRECVID Workshop
- 10.1109/CVPR.2016.502 · DOI · Paper page
- liang, 2016, Informedia @ Trecvid 2016, TRECVID Workshop
- lin, 2014, Microsoft coco: Common objects in context, ECCV
- snoek, 2017, University of Amsterdam and Renmin university at TRECVID 2017: Searching video, detecting events and describing video, TRECVID Workshop
- chen, 2011, Collecting highly parallel data for paraphrase evaluation, ACL
- chang, 2015, Semantic concept discovery for large-scale zero-shot event detection, AAAI
- dalton, 2013, Zero-shot video retrieval using content and concepts, CIKM
- faghri, 2018, VSE++: Improved visual-semantic embeddings, BMVC
- 10.1109/TMM.2018.2832602 · DOI · Paper page
- awad, 2016, Trecvid 2016: Evaluating video search, video event detection, localization, and hyperlinking, TRECVID Workshop
- 10.1145/2578726.2578746 · DOI
- awad, 2017, TRECVID 2017: Evaluating ad-hoc and instance video search, events detection, video captioning and hyperlinking, TRECVID Workshop
- 10.1145/2911996.2912015 · DOI
- markatopoulou, 2016, ITI-CERTH participation in TRECVID 2016, TRECVID Workshop
- 10.1145/3078971.3079041 · doi:10.1145/3078971.3079041
- 10.1145/3206025.3206064 · DOI · Paper page
- 10.1109/CVPR.2015.7298940 · DOI · Paper page
- nguyen, 2017, Vireo @ TRECVID 2017: Video-to-text, ad-hoc video search and video hyperlinking, TRECVID Workshop
Cited by
End-to-End Learning of Visual Representations From Uncurated Instructional Videos
Miech, A., Alayrac, J.-B., Smaira, L., Laptev, I., Sivic, J., & Zisserman, A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00990 · Cited by 580
Fine-Grained Video-Text Retrieval With Hierarchical Graph Reasoning
Chen, S., Zhao, Y., Jin, Q., & Wu, Q. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01065 · Cited by 335
X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval
Ma, Y., Xu, G., Sun, X., Yan, M., Zhang, J., & Ji, R. (2022) · Proceedings of the 30th ACM International Conference on Multimedia · doi:10.1145/3503161.3547910 · Cited by 321
Dense Regression Network for Video Grounding
Zeng, R., Xu, H., Huang, W., Chen, P., Tan, M., & Gan, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01030 · Cited by 286
Retrieval-Augmented Generation for AI-Generated Content: A Survey
Zhao, P., Zhang, H., Yu, Q., Wang, Z., Geng, Y., Fu, F., Yang, L., Zhang, W., Jiang, J., & Cui, B. (2024) · arXiv · doi:10.48550/arxiv.2402.19473 · Cited by 240
“For instance, a recent study on the trade-off between attribution and fluency in prompt-augmentation-style RAG demonstrates that using top-k retrieval for generation improves attribution, but hurts fluency in turns [373].”
Metadata
- Authors
- Dong, J., Li, X., Xu, C., Ji, S., He, Y., Yang, G., & Wang, X.
- Affiliations
- Zhejiang Gongshang Univ.
- Renmin Univ. of China
- Zhejiang Univ.
- Alibaba Group
- Venue
- 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2019-06
- Pages
- 9338-9347
- Cited by
- 236
- References
- 6
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.