The DOI matches its Crossref record; 68 of the 69 references it cites were found in a registry or an index.
HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clips
Open accessAbstract
Learning text-video embeddings usually requires a dataset of video clips with manually provided captions. However, such datasets are expensive and time consuming to create and therefore difficult to obtain on a large scale. In this work, we propose instead to learn such embeddings from video data with readily available natural language annotations in the form of automatically transcribed narrations. The contributions of this work are three-fold. First, we introduce HowTo100M: a large-scale dataset of 136 million video clips sourced from 1.22M narrated instructional web videos depicting humans performing and describing over 23k different visual tasks. Our data collection procedure is fast, scalable and does not require any additional manual annotation. Second, we demonstrate that a text-video embedding trained on this data leads to state-of-the-art results for text-to-video retrieval and action localization on instructional video datasets such as YouCook2 or CrossTask. Finally, we show that this embedding transfers well to other domains: fine-tuning on generic Youtube videos (MSR-VTT dataset) and movies (LSMDC dataset) outperforms models trained on these datasets alone. Our dataset, code and models are publicly available.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The beginning and end of videos, especially tutorial videos (Miech et al., 2019), often consist of an intro, respectively an outro. These sections are not as related to the content of the videos and contain fewer movements and actions.”
From Intuitive physics understanding emerges from self-supervised pretraining on natural videos (2025) · cites this paper as Miech et al., 2019
Experimental — accuracy not yet measuredIn the citing paper
“More modalities.In addition to the general modalities of vision, text, and audio, further diverse modalities are emerging, e.g., Pano-AVQA [144] -the first large-scale spatial and audio-visual question answering dataset on 360 • videos, YouTube-360 (YT-360) [145] (360 • videos), AIST++ [146] (a new multimodal dataset of 3D dance motion and music), Artemis [147] (affective language for visual arts)”
From Multimodal learning with transformers: A survey (2023) · cites this paper as [144]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset
Carreira, J., & Zisserman, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.502 · Cited by 9,570
Revisiting Unreasonable Effectiveness of Data in Deep Learning Era
Sun, C., Shrivastava, A., Singh, S., & Gupta, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.97 · Cited by 2,484
Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet?
Hara, K., Kataoka, H., & Satoh, Y. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00685 · Cited by 2,346
MSR-VTT: A Large Video Description Dataset for Bridging Video and Language
Xu, J., Mei, T., Yao, T., & Rui, Y. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.571 · Cited by 1,888
Image Captioning with Semantic Attention
You, Q., Jin, H., Wang, Z., Chen, F., & Luo, J. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.503 · Cited by 1,869
Flagged first, then by citations
1 of the 69 references couldn’t be matched to a known paper.
Research works printed but not linked: 4
- radford, 2018, Improving Language Understandingby Generative Pre-Training, Preprint
- 2019, Project webpage
- radford, 2019, Language models are unsupervised multitask learners, Preprint
- damen, 2018, Scaling egocentric vision: The epic-kitchens dataset, ECCV
Cited by
Sorted by citations
Items 801–900 of 989
Product promotion copywriting from multimodal data: New benchmark and model
Ren, J., Lin, L., & Zheng, W. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127253 · Cited by 4
MULTISCRIPT: Multimodal Script Learning for Supporting Open Domain Everyday Tasks
Qi, J., Liu, M., Shen, Y., Xu, Z., & Huang, L. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29854 · Cited by 1
Fang, J. Z., Zheng, S., Sharma, V., & Piramuthu, R. (2024) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw60836.2024.00062 · Cited by 1
Wei, C. Y., & Deng, Z. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611454 · Cited by 1
Multimodality-guided Visual-Caption Semantic Enhancement
Che, N., Liu, J., Yu, F., Cheng, L., Wang, Y., Li, Y., & Liu, C. (2024) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2024.104139 · Cited by 1
Cross-Modal Learning for Free-Text Video Search
Galanopoulos, D., & Mezaris, V. (2024) · Advances in information quality and management · doi:10.4018/978-1-6684-7366-5.ch088 · Cited by 1
Liu, Z., Wu, X., Wang, S., & Qian, J. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3680778 · Cited by 1
Data Collection-Free Masked Video Modeling
Ishikawa, Y., Kondo, M., & Aoki, Y. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73247-8_3 · Cited by 1
LocoMotion: Learning Motion-Focused Video-Language Representations
Doughty, H., Thoker, F. M., & Snoek, C. G. M. (2024) · Lecture notes in computer science · doi:10.1007/978-981-96-0908-6_1 · Cited by 1
PDPP: Projected Diffusion for Procedure Planning in Instructional Videos
Wang, H., Wu, Y., Guo, S., & Wang, L. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3518762 · Cited by 2
Video DataFlywheel: Resolving the Impossible Data Trinity in Video-Language Understanding
Wang, X., Wu, J., Lin, Z., Zhang, F., Zhang, D., & Nie, L. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3528394 · Cited by 1
Robust Audiovisual Speech Recognition Models with Mixture-of-Experts
Wu, Y., Peng, Y., Lu, Y., Chang, X., Song, R., & Watanabe, S. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832196 · Cited by 1
Abdari, A., Falcon, A., & Serra, G. (2025) · International Journal on Digital Libraries · doi:10.1007/s00799-025-00433-9 · Cited by 1
QUERYD: A Video Dataset with High-Quality Text and Audio Narrations
Oncescu, A.-M., Henriques, J. F., Liu, Y., Zisserman, A., & Albanie, S. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414640 · Cited by 1
A Multi-interaction Model with Cross-Branch Feature Fusion for Video-Text Retrieval
Li, J., Wu, D., Zhu, Y., & Bai, Z. (2021) · Communications in computer and information science · doi:10.1007/978-3-030-92310-5_55 · Cited by 1
When Did It Happen? Duration-informed Temporal Localization of Narrated Actions in Vlogs
Ignat, O., Castro, S., Zhou, Y., Bao, J., Shan, D., & Mihalcea, R. F. (2022) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3495211 · Cited by 1
IVIST: Interactive Video Search Tool in VBS 2022
Lee, S., Park, S., & Ro, Y. M. (2022) · Lecture notes in computer science · doi:10.1007/978-3-030-98355-0_49 · Cited by 1
Conditional Cross Correlation Network for Video Question Answering
Ouenniche, K., Țapu, R., & Zaharia, T. B. (2023) · IEEE International Conference on Semantic Computing (ICSC) · doi:10.1109/icsc56153.2023.00011 · Cited by 1
YouMakeup VQA Challenge: Towards Fine-grained Action Understanding in Domain-Specific VideosPreprint
Chen, S., Wang, W., Ruan, L., Yao, L., & Jin, Q. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.05573 · Cited by 1
A Dataset and Benchmarks for Multimedia Social AnalysisPreprint
Xue, B., Chan, D. M., & Canny, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.08335 · Cited by 1
Almeida, A., de Villiers, J. P., Freitas, A. D., & Velayudan, M. (2020) · arXiv (Cornell University) · Cited by 1
Automatic Curation of Large-Scale Datasets for Audio-Visual Representation Learning.Preprint
Lee, S., Chung, J., Yu, Y., Kim, G., Breuel, T. M., Chechik, G., & Song, Y. (2021) · arXiv (Cornell University) · Cited by 1
Designing Multimodal Datasets for NLP ChallengesPreprint
Pustejovsky, J. D., Holderness, E., Tu, J., Glenn, P., Rim, K., Lynch, K., & Brutti, R. A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.05999 · Cited by 4
Multi-Granularity Network with Modal Attention for Dense Affective UnderstandingPreprint
Yan, B., Wang, L., Gao, K., Gao, B., Liu, X., Ban, C., Jiang, Y., & Li, X. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.09964 · Cited by 1
Multi-modal Dense Video CaptioningPreprint
Iashin, V., & Rahtu, E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.07758
Supervision Levels Scale (SLS)Preprint
Damen, D., & Wray, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.09890
Watch and Learn: Mapping Language and Noisy Real-world Videos with Self-supervisionPreprint
Zhong, Y., Xie, L., Wang, S., Specia, L., & Miao, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.09634
Learning a Video-Text Joint Embedding using Korean Tagged Movie Clips
Hahm, G.-J., Kwak, C.-U., & Kim, S.-J. (2020) · International Conference on Information and Communication Technology Convergence (ICTC) · doi:10.1109/ictc49870.2020.9289342
Let Your Heart Speak in its Mother Tongue: Multilingual Captioning of Cardiac SignalsPreprint
Kiyasseh, D., Zhu, T., & Clifton, D. A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.11011 · Cited by 1
2020 Sequestered Data Evaluation for Known Activities in Extended Video: Summary and Results
Godil, A., Lee, Y., Fiscus, J., Delgado, A., Godard, E., Chocot, B., Diduch, L. L., Golden, J., & Zhang, J. (2021) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw52041.2021.00010
Video-aided Unsupervised Grammar InductionPreprint
Zhang, S., Song, L., Jin, L., Xu, K., Yu, D., & Luo, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.04369
Collaborative Dual-Stream Modeling for Video Understanding
Wang, X. (2021) · UTS ePRESS (University of Technology Sydney)
Reconstructing and grounding narrated instructional videos in 3DPreprint
Zhukov, D., Rocco, I., Ivan Laptev, A., Šivic, J., Schönberger, J. L., Tekin, B., & Pollefeys, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.04409
Self-citationSpoken ObjectNet: A Bias-Controlled Spoken Caption DatasetPreprint
Palmer, I., Rouditchenko, A., Barbu, A., Katz, B., & Glass, J. R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.07575 · Cited by 1
From Driver Talk To Future Action: Vehicle Maneuver Prediction by Learning from Driving Exam Dialogs
Roitberg, A., Reiß, S., & Stiefelhagen, R. (2021) · 2021 IEEE Intelligent Vehicles Symposium (IV) · doi:10.1109/iv48863.2021.9575655
Cascaded Multilingual Audio-Visual Learning from VideosPreprint
Rouditchenko, A., Boggust, A., Harwath, D. F., Thomas, S., Kuehne, H., Chen, B., Panda, R., Feris, R., Kingsbury, B. E. D., Picheny, M., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.04823
SwAMP: Swapped Assignment of Multi-Modal Pairs for Cross-Modal RetrievalPreprint
Kim, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.05814 · Cited by 1
Understanding Manipulation Contexts by Vision and Language for Robotic Vision
Jiang, C. (2021) · ERA: Education and Research Archive (University of Alberta) · doi:10.7939/r3-tra9-cw93
Video2Subtitle: Matching Weakly-Synchronized Sequences via Dynamic Temporal Alignment
Ben, X., Liu, C., & Mu, Y. (2022) · International Conference on Multimedia Retrieval · doi:10.1145/3512527.3531371
Cross-modal Representation Learning for Understanding Manufacturing Procedure
Hashimoto, A., Nishimura, T., Ushiku, Y., Kameko, H., & Mori, S. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-06047-2_4
Learning actionness from action/background discrimination
Simsek, O. Y., Russakovsky, O., & Duygulu, P. (2022) · Signal Image and Video Processing · doi:10.1007/s11760-022-02369-y
A Multi-Stream Approach for Video Understanding
Kunam, L., Rossetto, L., & Bernstein, A. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3551567
A Framework for Video-Text Retrieval with Noisy Supervision
Vaseqi, Z., Fan, P., Clark, J. J., & Levine, M. D. (2022) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3536221.3556597
A Survey on Video Description and Summarization Using Deep Learning-Based Methods
Rakshit, P., Kumar, A., & Chakraborty, A. (2022) · Lecture notes in networks and systems · doi:10.1007/978-981-19-5090-2_21
New Trends in Image Recognition Competitions
Nakayama, H. (2019) · The Journal of The Institute of Image Information and Television Engineers · doi:10.3169/itej.73.1084
Video in 10 Bits: Few-Bit VideoQA for Efficiency and Privacy
Huang, S., Piramuthu, R., Chang, S., & Sigurdsson, G. A. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-25072-9_49
Review on Optimizing Text-Video Retrieval Using CLIP (Contrastive Language-Image Pre-training)
Sinha, S., Anupriya, A., & Chary, M. R. (2023) · Lecture notes in electrical engineering · doi:10.1007/978-981-19-6383-4_27
Utilizing Language-Image Pretraining for Efficient and Robust Bilingual Word Alignment
Dinh, T., Sohn, J.-Y., Rajput, S., Ossowski, T., Ming, Y., Hu, J., Papailiopoulos, D., & Lee, K. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.12 · Cited by 1
Find-2-Find: Multitask Learning for Anaphora Resolution and Object Localization
Oguz, C., Denis, P., Emmanuel Vincent, A., Ostermann, S., & van Genabith, J. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.504
ORANGE: Text-video Retrieval via Watch-time-aware Heterogeneous Graph Contrastive Learning
Lin, Y., Chang, T., Chang, Y., Ma, J., Li, D., Peng, T., Li, Z., Zhou, Z., & Wang, F. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-industry.27
Video-and-Language (VidL) models and their cognitive relevance
Zonneveld, A. W., Albert Gatt, A., & Calixto, I. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00040
Action Recognition via Fine-Tuned CLIP Model and Temporal Transformer
Yang, X., Fu, Y., & Liu, T. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-50075-6_39
Automated Analysis of Chemistry Experiment Videos: New Challenges for Video Understanding
Zheng, Z., Wang, B., Wang, Z., Chen, Y., Zhou, J., & Kong, L. J. (2024) · Communications in computer and information science · doi:10.1007/978-981-97-0730-0_18 · Cited by 1
Smart Contextual Modeling for Customer Data Interchange
Saravanan, M., & Perepu, S. K. (2023) · IEEE India Conference · doi:10.1109/indicon59947.2023.10440762
Implicit Affordance Acquisition via Causal Action–Effect Modeling in the Video Domain
Yang, H.-Y., & Silberer, C. (2023) · International Joint Conference on Natural Language Processing and Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (IJCNLP-AACL) · doi:10.18653/v1/2023.ijcnlp-main.55 · Cited by 1
Ontology-Semantic Alignment On Contrastive Video-Language Model for Multimodel Video Retrieval Task
Zhou, Y., Ding, Y., Dong, Y., & He, H. (2023) · doi:10.1145/3638584.3638635
PolarDB: Formula-Driven Dataset for Pre-Training Trajectory Encoders
Miyamoto, S., Yagi, T., Makimoto, Y., Ukai, M., Ushiku, Y., Hashimoto, A., & Inoue, N. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448448
Implicit and Explicit Commonsense for Multi-Sentence Video CaptioninPreprint
Chou, S.-H., Little, J. J., & Sigal, L. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4768719
IMF-MF: Interactive moment localization with adaptive multimodal fusion and self-attention
Singh, P., Kushwaha, A. K. S., & Varshney, N. (2024) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-233071
Tyagi, E. A. H. (2023) · International Journal on Recent and Innovation Trends in Computing and Communication · doi:10.17762/ijritcc.v11i9.10081
Cross-modal learning representation using new margin combination for speech recognition task
Karim, D. O., & Mars, A. (2024) · Journal of Applied Research and Technology · doi:10.22201/icat.24486736e.2024.22.3.2417
ST-CLIP: Spatio-Temporal Enhanced CLIP Towards Dense Video Captioning
Chen, H., Duan, P., Huang, M., Guo, J., & Xiong, S. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-5612-4_34
Unsupervised Feature Learning for Video Understanding
Wu, Z., & Jiang, Y. (2024) · Wireless networks · doi:10.1007/978-3-031-57679-9_6
Deep Learning for Video Localization
Wu, Z., & Jiang, Y. (2024) · Wireless networks · doi:10.1007/978-3-031-57679-9_4
Zheng, L., Guo, P., Miao, Z., & Xu, W. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10651205
Yang, Q., Chen, H., Zhang, Y., Xia, M., Cun, X., Su, Z., & Shan, Y. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72764-1_18
Meta-optimized Angular Margin Contrastive Framework for Video-Language Representation Learning
Nguyen, T. T., Bin, Y., Wu, X., Dong, X., Hu, Z., Le, K., Nguyen, C.-D. T., Ng, S.-K., & Tuan, L. A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72989-8_5
Rethinking Video-Text Understanding: Retrieval from Counterfactually Augmented Data
Ma, W., Li, K., Jiang, Z., Meshry, M., Liu, Q., Wang, H., Häne, C., & Yuille, A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72624-8_15 · Cited by 4
Self-expressive induced clustered attention for video-text retrieval
Zhu, J., Shen, X., Mehta, S., Abeo, T. A., & Zhan, Y. (2024) · Multimedia Systems · doi:10.1007/s00530-024-01549-9
Kumar, H., & Singh, V. (2024) · Lecture notes in networks and systems · doi:10.1007/978-981-97-6318-4_8
Enhancing Video-Language Alignment Via Mining Entity KnowledgePreprint
Wang, C., Dong, X., Gu, J., Wen, Y., Hunag, R., Han, J., Xu, H., Jie, Z., Ma, L., Qian, Y., et al. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.5039908
Rethinking Video-Text Pretraining Via Masked AutoencoderPreprint
Chen, S., Ma, Y., Jia, B., Li, X., Xiao, Y., & Yang, T. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.5071942
Beyond Essentials: Nuanced and Diverse Text-to-video Retrieval
Yang, Y.-C. B. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825297
Audio-Guided Visual Knowledge Representation
Yu, F., Wan, Z., & Li, Y. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-0914-7_9
Lee, D., Shim, J. Y., Yoon, S., & Yoo, C. D. (2025) · Lecture notes in computer science · doi:10.1007/978-981-97-8702-9_8
Estimation of Chronic Academic Stress among college students using short form video contents
Aadharsh Aadhithya, A., Kalyan Sundaram, M., Sunil, S., Bijlani, K., Kumar, S. S., & Soman, K. P. (2024) · International Conference on Emerging Frontiers in Electrical and Electronic Technologies (ICEFEET) · doi:10.1109/icefeet64463.2024.10867145
Moment-Aware Video Retrieval for Video Corpus Moment Retrieval
Choi, Y., Ahn, D., & Choi, J. (2025) · IEEE Access · doi:10.1109/access.2025.3542720
Zhao, Y., Jiang, X., Zhang, J., & Yi, G. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-2911-4_20
Yue, T., Xiao, M., Zhang, D., Liu, X., Li, Y., & Wang, S. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890678
Dynamic semantic prototype perception for text–video retrieval
Zhao, H., Yan, R., & Li, Z. (2025) · Image and Vision Computing · doi:10.1016/j.imavis.2025.105515
Cci: A Causal Counterfactual Inference-Based Method for Object State ChangesPreprint
Wang, Z., Huang, S., Zhang, Z., & Li, M. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5202372
ACE: Action Concept Enhancement of Video-Language Models in Procedural Videos
Ghoddoosian, R., Agarwal, N., Dwivedi, I., & Darisuh, B. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00922
Multimodal Speech Recognition Assisted by Slide Information in Classroom Scenes
Li, J., Mei, J., Wu, D., Zhou, M., & Jiang, L. (2024) · International Conference on Vision, Image and Signal Processing (ICVISP) · doi:10.1109/icvisp64524.2024.10959642
VFE: A large-scale video future event description dataset for evaluating video temporal prediction
Lai, C., & Wang, H. (2025) · Applied Intelligence · doi:10.1007/s10489-025-06547-6
Dialogue-to-Video Retrieval via Multi-Grained Attention Network
Yu, Y., Zhang, J., Tang, S., & Li, W. (2025) · IEEE Access · doi:10.1109/access.2025.3567086
Self-Supervised Learning for Action Recognition: Trends, Models, and Applications
Al-Qaisieh, M. S. A. (2025) · Journal of Information Systems Engineering & Management · doi:10.52783/jisem.v10i48s.9738
EPRVR: Efficient Partially Relevant Video Retrieval with Disentangled Video Representation Learning
Li, Z., Zhang, Z., Liu, D., Chai, Y., Dai, J., Tu, B., & Han, J. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-7005-5_3
Macrì, G., Bazzana, L., Falcon, A., & Serra, G. (2025) · International Conference on Multimedia Retrieval · doi:10.1145/3731715.3733358
Weakly-Supervised Multimodal Video Pre-Training via Image-Caption Pseudo-LabelingPreprint
Rhodes, C., Marwood, E., & Hale, J. (2025) · Preprints.org · doi:10.20944/preprints202506.2276.v1
FLAG3D++: A Benchmark for 3D Fitness Activity Comprehension With Language Instruction
Tang, Y., Liu, A., Liu, J., Zhang, S., Dai, W., Zhou, J., Li, X., & Lu, J. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3590012
Explicit-implicit feature modeling in drama videos: dataset and benchmark
Du, Z., & Wu, X. (2025) · Applied Intelligence · doi:10.1007/s10489-025-06699-5
Prompt2LVideos: Exploring Prompts for Understanding Long-Form Multimodal Videos
Jahagirdar, S., Saha, J., & Jawahar, C. V. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-93688-3_31
V2 Dial: Unification of Video and Visual Dialog via Multimodal Experts
Abdessaied, A., Rohrbach, A., Rohrbach, M., & Bulling, A. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00807
Annotation-Efficient Hybrid Learning for Temporal Sentence Grounding
Dong, J., & Yin, Z. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3603110
Foundations of Vision-Language Models: Concepts and Roadmap
Zhou, K., Liu, Z., & Gao, P. (2025) · Advances in computer vision and pattern recognition · doi:10.1007/978-3-031-94969-2_1
Multimodal Large Language Models for Video Understanding
Wang, Y., Yu, J., He, Y., Wang, L., & Qiao, Y. (2025) · Advances in computer vision and pattern recognition · doi:10.1007/978-3-031-94969-2_3
Xie, Q., Zhang, D., Liu, M., Zhang, J., Su, R., Shan, C., & Zhang, J. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-04978-0_7
HAN: Korean Heritage Augmented Narrative Visual-Language Description Dataset
Moon, S., Zhakatayev, A., & Lee, S. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3758229
Metadata
- Authors
- Miech, A., Zhukov, D., Alayrac, J.-B., Tapaswi, M., Laptev, I., & Sivic, J.
- Affiliations
- Centre National de la Recherche Scientifique (FR)
- Institut national de recherche en sciences et technologies du numérique (FR)
- Venue
- 2019 IEEE/CVF International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2019-10
- Pages
- 2630-2640
- OpenAlex
- W2948859046
- Cited by
- 986
- References
- 69
- Citations by year
- 2026: 77 · 2025: 138 · 2024: 170 · 2023: 213 · 2022: 161 · 2021: 155 · 2020: 65 · 2019: 7
- FWCI
- 31.62
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE/CVF International Conference on Computer Vision (ICCV) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- HAL (submittedVersion)
- arXiv (Cornell University)
- Funders
- Canadian Institute for Advanced Research
- European Regional Development Fund (02.1.01/0.0/0.0, CZ.02, CZ.02.1.01, CZ.02.1.01/0.0, CZ.02.1.01/0.0/0.0)
- FP7 Ideas: European Research Council (336845)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Analysis and Summarization
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Keywords
- video-text retrieval, action localization, domain transfer, large-scale video datasets
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
