The DOI matches its Crossref record; 68 of the 69 references it cites were found in a registry or an index.
HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clips
Open accessAbstract
Learning text-video embeddings usually requires a dataset of video clips with manually provided captions. However, such datasets are expensive and time consuming to create and therefore difficult to obtain on a large scale. In this work, we propose instead to learn such embeddings from video data with readily available natural language annotations in the form of automatically transcribed narrations. The contributions of this work are three-fold. First, we introduce HowTo100M: a large-scale dataset of 136 million video clips sourced from 1.22M narrated instructional web videos depicting humans performing and describing over 23k different visual tasks. Our data collection procedure is fast, scalable and does not require any additional manual annotation. Second, we demonstrate that a text-video embedding trained on this data leads to state-of-the-art results for text-to-video retrieval and action localization on instructional video datasets such as YouCook2 or CrossTask. Finally, we show that this embedding transfers well to other domains: fine-tuning on generic Youtube videos (MSR-VTT dataset) and movies (LSMDC dataset) outperforms models trained on these datasets alone. Our dataset, code and models are publicly available.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The beginning and end of videos, especially tutorial videos (Miech et al., 2019), often consist of an intro, respectively an outro. These sections are not as related to the content of the videos and contain fewer movements and actions.”
From Intuitive physics understanding emerges from self-supervised pretraining on natural videos (2025) · cites this paper as Miech et al., 2019
Experimental — accuracy not yet measuredIn the citing paper
“More modalities.In addition to the general modalities of vision, text, and audio, further diverse modalities are emerging, e.g., Pano-AVQA [144] -the first large-scale spatial and audio-visual question answering dataset on 360 • videos, YouTube-360 (YT-360) [145] (360 • videos), AIST++ [146] (a new multimodal dataset of 3D dance motion and music), Artemis [147] (affective language for visual arts)”
From Multimodal learning with transformers: A survey (2023) · cites this paper as [144]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset
Carreira, J., & Zisserman, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.502 · Cited by 9,570
Revisiting Unreasonable Effectiveness of Data in Deep Learning Era
Sun, C., Shrivastava, A., Singh, S., & Gupta, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.97 · Cited by 2,484
Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet?
Hara, K., Kataoka, H., & Satoh, Y. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00685 · Cited by 2,346
MSR-VTT: A Large Video Description Dataset for Bridging Video and Language
Xu, J., Mei, T., Yao, T., & Rui, Y. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.571 · Cited by 1,888
Image Captioning with Semantic Attention
You, Q., Jin, H., Wang, Z., Chen, F., & Luo, J. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.503 · Cited by 1,869
Flagged first, then by citations
1 of the 69 references couldn’t be matched to a known paper.
Research works printed but not linked: 4
- radford, 2018, Improving Language Understandingby Generative Pre-Training, Preprint
- 2019, Project webpage
- radford, 2019, Language models are unsupervised multitask learners, Preprint
- damen, 2018, Scaling egocentric vision: The epic-kitchens dataset, ECCV
Cited by
Sorted by citations
Items 701–800 of 990
Multi-Modal Retrieval Augmented Visual Understanding and Generation
Xue, Z. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3756866 · Cited by 3
Multimodal Large Language Models: Developments and Directions
Munir, M. B., Khan, L. R., & Thuraisingham, B. M. (2025) · IEEE International Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr67560.2025.00048 · Cited by 2
He, Y., Huang, Y., Guo, C., Lü, L., Pei, B., Xu, J., Lu, T., & Sato, Y. (2026) · International Journal of Computer Vision · doi:10.1007/s11263-025-02608-y · Cited by 9
A variational causal inference-based method for recognizing object state changes in videos
Wang, Z., Ge, W., Huang, S., & Li, M. (2026) · Multimedia Systems · doi:10.1007/s00530-025-02185-7 · Cited by 2
Dropletvideo: A Dataset and Approach to Explore Integral Spatio-Temporal Consistent Video Generation
Zhang, R., Du, G., Li, X., Jia, Q., Jin, L., Liu, L., Wang, J., Xu, C., Guo, Z., Zhao, Y., et al. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01446 · Cited by 2
Streaming Videollms for Real-Time Procedural Video Understanding
Chatterjee, D., Remelli, E., Song, Y., Tekin, B., Mittal, A., Bhatnagar, B., Camgöz, N. C., Hampali, S., Sauser, E. L., Ma, S., et al. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.02097 · Cited by 3
范越, Ma, X., Su, R., Guo, J., Wu, R., Chen, X., & Li, Q. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00598 · Cited by 21
Nakashima, M., Qiu, J., Huang, P., Lee, J., Chen, P. M., Grimm, R. A., Nguyen, C. T., Kim, B.-H., Zhao, D., Kwon, D. H., et al. (2026) · Nature Communications · doi:10.1038/s41467-026-73022-2 · Cited by 2
Multimodal Video Understanding: A Capability-Based Survey of Alignment, Expression, and Reasoning
Zhao, R., Pu, D., Li, C., Zhang, Z. D., Xingzhu, P., & Ma, Y. (2026) · Applied Sciences · doi:10.3390/app16147154 · Cited by 2
Text-video retrieval method based on enhanced self-attention and multi-task learning
Wu, X., Qian, J., & Wang, T. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-14589-6 · Cited by 2
Xiang, Y., Liu, K., Tang, S., Bai, L., Zhu, F., Zhao, R., & Lin, X. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10097061 · Cited by 2
Shot Retrieval and Assembly with Text Script for Video Montage Generation
Yang, G., Lu, H., Sun, Z., & Lu, Z. (2023) · International Conference on Multimedia Retrieval · doi:10.1145/3591106.3592247 · Cited by 2
Robust Contrastive Learning With Dynamic Mixed Margin
So, J., Lim, Y., Kim, Y., Oh, C., & Song, K. (2023) · IEEE Access · doi:10.1109/access.2023.3286931 · Cited by 2
A Convolutional Autoencoder Approach for Weakly Supervised Anomaly Video Detection
Hieu, P. N. D., & Hung, P. D. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-41456-5_11 · Cited by 2
MuMUR: Multilingual Multimodal Universal Retrieval
Madasu, A., Aflalo, E., Stan, G. B. M., Rosenman, S., Tseng, S.-Y., Bertasius, G., & Lal, V. (2023) · Information Retrieval · doi:10.1007/s10791-023-09422-5 · Cited by 2
Multimodal Fashion Knowledge Extraction as Captioning
Yuan, Y., Zhang, W., Deng, Y., & Lam, W. P. (2023) · Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region (SIGIR-AP) · doi:10.1145/3624918.3625315 · Cited by 2
Zero-shot Video Retrieval using CLIP with Temporally Ordered Multi-query Scoring
Bui, H. H., Trinh, M.-H., Le, C. D., Vu, Q.-L., & Vo, K.-T. (2023) · International Symposium on Information and Communication Technology · doi:10.1145/3628797.3628984 · Cited by 2
In-Style: Bridging Text and Uncurated Videos with Style Transfer for Text-Video Retrieval
Shvetsova, N., Kukleva, A., Schiele, B., & Kuehne, H. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02009 · Cited by 2
FELGA: Unsupervised Fragment Embedding for Fine-Grained Cross-Modal Association
Zhuo, Y., & Li, B. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00554 · Cited by 2
QAVidCap: Enhancing Video Captioning through Question Answering Techniques
Liu, H. L., & Wan, X. (2024) · International Conference on Multimedia Retrieval · doi:10.1145/3652583.3658061 · Cited by 2
Human-Centric Behavior Description in Videos: New Benchmark and Model
Zhou, L., Gao, Y., Zhang, M., Wu, P., Wang, P., & Zhang, Y. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3414263 · Cited by 2
Automatic Text-based Clip Composition for Video News
Quandt, D., Altmeyer, P., Ruppel, W., & Narroschke, M. (2024) · International Conference on Multimedia and Image Processing (ICMIP) · doi:10.1145/3665026.3665042 · Cited by 2
Multi Modal Fusion for Video Retrieval based on CLIP Guide Feature Alignment
Wu, G., Haider, A., Spence, I. T. A., & Wang, H. (2024) · doi:10.1145/3664524.3675369 · Cited by 2
A Survey of Video Datasets for Grounded Event Understanding
Sanders, K., & Durme, B. V. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00727 · Cited by 2
DeCMG: Denoise with Cross-modality Guidance Makes Better Text-Video Retrieval
Deng, R., & Li, Y. (2024) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme57554.2024.10687750 · Cited by 2
Efficient Pre-training for Localized Instruction Generation of Procedural Videos
Batra, A., Moltisanti, D., Sevilla-Lara, L., Rohrbach, M., & Keller, F. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72933-1_20 · Cited by 2
Neighbor Does Matter: Curriculum Global Positive-Negative Sampling for Vision-Language Pre-training
Huang, B., He, F., Wang, Q., Chen, H., Li, G., Feng, Z., Wang, X. Y., & Zhu, W. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681502 · Cited by 2
Kundu, S., Trehan, S., & Aakur, S. N. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73202-7_3 · Cited by 5
It’s Just Another Day: Unique Video Captioning by Discriminitive Prompting
Perrett, T., Han, T., Damen, D., & Zisserman, A. (2024) · Lecture notes in computer science · doi:10.1007/978-981-96-0908-6_16 · Cited by 2
Personalized decision-making for agents in face-to-face interaction in virtual reality
Dongye, X., Weng, D., Jiang, H., Tian, Z., Bao, Y., & Chen, P. (2024) · Multimedia Systems · doi:10.1007/s00530-024-01591-7 · Cited by 2
Spina, D., Roitero, K., Mizzaro, S., Mea, V. D., Ros, F. D., Soprano, M., Akebli, H., Falcon, A., Fasihi, M., Fiorin, A., et al. (2024) · ACM SIGIR Forum · doi:10.1145/3722449.3722456 · Cited by 2
Dam: Dynamic Adapter Merging for Continual Video QA Learning
Cheng, F., Wang, Z., Sung, Y.-L., Lin, Y.-B., Bansal, M., & Bertasius, G. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00662 · Cited by 2
UAL-Bench: The First Comprehensive Unusual Activity Localization Benchmark
Abdullah, H. M., Liu, T., Wei, K., Kong, S., & Huang, R. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00566 · Cited by 2
Agent-Based Control Prompt Tuning for Video-Text Retrieval
Lai, H., Wei, X., Sun, R., & Zhang, T. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3574726 · Cited by 2
DistinctAD: Distinctive Audio Description Generation in Contexts
Fang, B., Wu, W., Wu, Q., Song, Y., & Chan, A. B. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01267 · Cited by 2
SCA3D: Enhancing Cross-Modal 3D Retrieval via 3D Shape and Caption Paired Data Augmentation
Ren, J., Wu, H., Xiong, H., & Wang, H. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11128851 · Cited by 8
Structured Visual Search via Composition-aware Learning
Kilickaya, M., & Smeulders, A. W. M. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00174 · Cited by 2
Ohishi, Y., Tanaka, Y., & Kashino, K. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412233 · Cited by 2
Video action re-localization using spatio-temporal correlation
Ramaswamy, A., Seemakurthy, K., Gubbi, J., & Balamuralidhar, P. (2022) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw54805.2022.00025 · Cited by 2
ConTra: (Con)text (Tra)nsformer for Cross-Modal Video Retrieval
Fragomeni, A., Wray, M., & Damen, D. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-26316-3_27 · Cited by 2
SST-VLM: Sparse Sampling-Twice Inspired Video-Language Model
Gao, Y., & Lu, Z. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-26316-3_32 · Cited by 2
A Unified framework based on Large-scale Momentum Contrastive learning for Text-Video Retrieval
Kim, E., Lee, N., & Cho, Y.-S. (2023) · International Conference on Electronics, Information, and Communication (ICEIC) · doi:10.1109/iceic57457.2023.10049967 · Cited by 2
Barotsi, R., Fanchi, M., & Tarantino, M. (2023) · doi:10.21428/93b7ef64.ddf0a578 · Cited by 2
YuYin: a multi-task learning model of multi-modal e-commerce background music recommendation
Ma, L., Wu, X., Tang, R., Zhong, C., & Zhang, K. (2023) · EURASIP Journal on Audio Speech and Music Processing · doi:10.1186/s13636-023-00306-6 · Cited by 2
A prompt tuning method for few-shot action recognition
Yang, S., Li, Y., & Wang, S. (2023) · IEEE International Conference on Visual Communications and Image Processing (VCIP) · doi:10.1109/vcip59821.2023.10402721 · Cited by 2
More than Vision: A Multi-Modal Assisted Model to Text-Video Retrieval
Ni, F., Zhang, X., Wu, J., Dong, G., Zhu, A., & Zhu, X. (2023) · China Automation Congress (CAC) · doi:10.1109/cac59555.2023.10451811 · Cited by 2
Action Modifiers: Learning From Adverbs in Instructional Videos
Doughty, H., Laptev, I., Mayol-Cuevas, W. W., & Damen, D. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00095 · Cited by 2
Kalayeh, M. M., Kamath, N., Liu, L., & Chandrashekar, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.08513 · Cited by 2
Learning Video Models from Text: Zero-Shot Anticipation for Procedural Actions.Preprint
Şener, F., Saraf, R., & Yao, A. (2021) · arXiv (Cornell University) · Cited by 2
ViSeRet: A simple yet effective approach to moment retrieval via fine-grained video segmentationPreprint
Lee, A. S., Oh, H., & Seo, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.05146 · Cited by 2
Routing with Self-Attention for Multimodal Capsule NetworksPreprint
Duarte, K., Chen, B., Shvetsova, N., Rouditchenko, A., Thomas, S., Liu, A. H., Harwath, D. F., Glass, J. R., Kuehne, H., & Shah, M. A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2112.00775 · Cited by 5
AssistSR: Affordance-centric Question-driven Video Segment RetrievalPreprint
Lei, S. W., Wang, Y., Mao, D., Gao, D., & Shou, M. Z. (2021) · arXiv (Cornell University) · Cited by 2
Enhanced visual multi-modal fusion framework for dense video captioningPreprint
Zhong, R., Zhang, Q., & Zuo, M. (2023) · Research Square · doi:10.21203/rs.3.rs-2563235/v1 · Cited by 2
Diverse Perceptual Representations Across Visual Pathways Emerge from A Single ObjectivePreprint
Tang, Y., Gökce, A., Jedoui, K., Yamins, D. L. K., & Schrimpf, M. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.07.22.664908 · Cited by 10
Multimodal Pretraining from Monolingual to Multilingual
Zhang, L., Ruan, L., Hu, A., & Jin, Q. (2023) · Machine Intelligence Research · doi:10.1007/s11633-022-1414-4 · Cited by 1
Video Retrieval with Tree-Based Video Segmentation
Kang, S., Jung, D., & Cho, Y.-S. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-30675-4_29 · Cited by 1
MovieUN: A Dataset for Movie Understanding and Narrating
Zhang, Q., Yue, Z., Hu, A., Wang, Z., & Jin, Q. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.135 · Cited by 1
News-MESI: A Dataset for Multimodal News Excerpt Segmentation and Identification
Song, Q., Jia, Z., Jia, W., Zhao, W., Hu, M., & Liu, C. (2024) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2024.3369866 · Cited by 1
VCR: Video representation for Contextual Retrieval
Nir, O., Vidra, I., Neeman, A., Kinarti, B., & Shamir, A. (2024) · International Conference on Computing, Machine Learning, and Data Science (CMLDS) · doi:10.1145/3661725.3661766 · Cited by 1
CLIP-Guided Bidirectional Prompt and Semantic Supervision for Dynamic Facial Expression Recognition
Zhang, J., Liu, X., Yu, L., Xian, X., Xie, W., Shen, L., & Song, S. (2024) · IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/ijcb62174.2024.10744485 · Cited by 1
CVLP-NaVD: Contrastive Visual-language Pre-training Models for Non-annotated Visual Description
Li, H., Hao, Y., Yu, J., Zhu, B., Wang, S., & Xu, T. (2024) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3708348 · Cited by 2
Fine-grained Video Semantic Distillation for Video-Text Retrieval
pei, Z., Sun, B., Wang, Z., & Li, H. (2024) · ACM International Conference on Multimedia in Asia (MMAsia) · doi:10.1145/3696409.3700287 · Cited by 1
Ego-VPA: Egocentric Video Understanding with Parameter-Efficient Adaptation
Wu, T.-Y., Min, K., Tripathi, S., & Vasconcelos, N. M. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00897 · Cited by 1
Temporally Grounding Instructional Diagrams in Unconstrained Videos
Zhang, J., Zhang, F. Z., Rodriguez, C., Ben-Shabat, Y., Cherian, A., & Gould, S. J. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00786 · Cited by 1
Guo, Z., Cheng, X., Wu, Y., & Jin, T. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i16.33868 · Cited by 4
Semantic Distance-Aware Cross-Modal Attention Mechanism for Video Question Answering
Liu, M., Zhou, F., Wang, R., Zhao, B., & Zhang, F. (2025) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2025.3571119 · Cited by 3
VATE: A Large Scale Multimodal Spontaneous Dataset for Affective Evaluation
Agnelli, F., Grossi, G., D’Amelio, A., Paoli, M. D., & Lanzarotti, R. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-91575-8_13 · Cited by 1
Egocentric expert guidance for procedural activities using Smart Glasses, Computer Vision and RAG
Sörqvist, E., Altenbuchner, A. M., Krüger, J., & Karbouj, B. (2025) · Procedia CIRP · doi:10.1016/j.procir.2025.02.243 · Cited by 1
VideoConviction: A Multimodal Benchmark for Human Conviction and Stock Market Recommendations
Galarnyk, M., Kejriwal, V., Shah, A., Bhardwaj, Y., Meyer, N. W., Krishnan, A. V., & Chava, S. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3711896.3737417 · Cited by 2
Hemashree, M., Banerjee, S., & Rashmi, R. (2025) · IEEE Access · doi:10.1109/access.2025.3597801 · Cited by 2
Efficient VideoMAE via Temporal Progressive Training
Li, X., Wang, P., Li, X., Wang, H., Zhu, H., & Xie, C. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00250 · Cited by 1
AdaVid: Adaptive Video-Language Pretraining
Patel, C., Niebles, J. C., & Adeli, E. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00635 · Cited by 1
SoccerHigh: A Benchmark Dataset for Automatic Soccer Video Summarization
Díaz-Juan, A., Ballester, C., & Haro, G. (2025) · ACM International Workshop on Multimedia Content Analysis in Sports (MMSports) · doi:10.1145/3728423.3759410 · Cited by 1
Multimedia-Aware Question Answering: A Review of Retrieval and Cross-Modal Reasoning Architectures
Raja, R., & Vats, A. (2025) · doi:10.1145/3746274.3760393 · Cited by 3
Çelik, A. (2025) · Signal Image and Video Processing · doi:10.1007/s11760-025-04887-x · Cited by 1
A Dataset and Metric for Textual Video Content Description
Arzberger, S. J., Raith, P., Werner Bailer, A., & Jaks, M. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3758224 · Cited by 1
Enhanced Cross-modal 3D Retrieval via Tri-modal Reconstruction
Ren, J., & Wang, H. (2025) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme59968.2025.11209398 · Cited by 1
ADGen: A Multimodal Advertisement Generation Dataset and Video Captioning Framework
Pragathi, Y. P., Bharadwaj, S. S., Kolli, P., Sanjith, S., Sooda, K., & Sunayana, S. (2025) · Lecture notes in networks and systems · doi:10.1007/978-981-96-5370-6_2 · Cited by 1
Question Understanding and Temporality Guiding for Video Question Answering
Lu, J., You, S., & Bao, B.-K. (2026) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2026.3651064 · Cited by 1
Qian, Y., Kargarandehkordi, A., Sun, Y., Azizian, P., Mutlu, O. C., Surabhi, S., Jabbar, Z., Wall, D. P., Washington, P. Y., & Chen, H. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00312 · Cited by 1
Generating Tennis Action Instruction Based on a Large Language Model
Wang, Z., Xia, Z., Zhao, G., Lu, K., Xia, H., & Xia, S. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00683 · Cited by 1
Dual-Attention Video Representation Learning for Parameter Efficient Text-Video Retrieval
Bian, Z., Luo, Y., Zhu, F., Shu, X., & Zhang, Z. (2026) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2026.3673509 · Cited by 1
Event-Aware Video Corpus Moment Retrieval
Hou, D., Pang, L., Yanyan, L., Shen, H., & Cheng, X. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-21289-4_1 · Cited by 1
LoVR: A Benchmark for Long Video Retrieval in Multimodal Contexts
Liang, H., Cai, Q., Han, Z., Dong, H., Qiang, M., An, R., Xu, Q., Cui, B., & Zhang, W. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792099 · Cited by 17
CARIM: Caption-Based Autonomous Driving Scene Retrieval via Inclusive Text Matching
Ki, M., 김대중, Kim, K., Kim, S. J., & Lee, J. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.02046 · Cited by 1
SPOC: Spatially-Progressing Object State Change Segmentation in Video
Mandikal, P., Nagarajan, T., Stoken, A., Xue, Z., & Grauman, K. L. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00342 · Cited by 1
Toward a Unified Vision-Language Generative Model
Wang, P. (2026) · IntechOpen eBooks · doi:10.5772/intechopen.1014640 · Cited by 4
Implicit Chain-of-Thought Reasoning via Task-Aware Latent Motion for transferable VLA
Jing, Y., Li, X., Wang, X., & Wu, L. (2026) · Pattern Recognition · doi:10.1016/j.patcog.2026.114060 · Cited by 1
From Videos to Conversations: Egocentric Instructions for Task Assistance
Aggarwal, L., Bahirwani, V., & Colaço, A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-31438-3_31 · Cited by 1
Fischer, S., Gemmell, C., Mackie, I., & Dalton, J. (2022) · doi:10.1145/3552467.3554794 · Cited by 1
CLOP: Video-and-Language Pre-Training with Knowledge Regularizations
Li, G., Yang, H., He, F., Feng, Z., Lyu, Y., Wu, H. R., & Wang, H. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3548346 · Cited by 1
SHERLock: Self-Supervised Hierarchical Event Representation Learning
Roychowdhury, S., Sontakke, S., Itti, L., Sarkar, M., Aggarwal, M., Badjatiya, P., Puri, N., & Krishnamurthy, B. (2022) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr56361.2022.9956696 · Cited by 1
State-aware video procedural captioning
Nishimura, T., Hashimoto, A., Ushiku, Y., Kameko, H., & Mori, S. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-14774-7 · Cited by 1
Inferential Knowledge-Enhanced Integrated Reasoning for Video Question Answering
Mao, J., Jiang, W., Liu, H., Wang, X., & Lyu, Y. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i11.26570 · Cited by 1
Improving language-supervised object detection with linguistic structure analysis
Rai, A., & Kovashka, A. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00588 · Cited by 1
Leveraging Temporal Context in Low Representational Power Regimes
Fosco, C. L., Jin, S., Josephs, E., & Oliva, A. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01030 · Cited by 1
Visual Recipe Flow: A Dataset for Learning Visual State Changes of Objects with Recipe Flows
Shirai, K., Hashimoto, A., Nishimura, T., Kameko, H., Kurita, S., & Mori, S. (2023) · Journal of Natural Language Processing · doi:10.5715/jnlp.30.1042 · Cited by 1
End-to-end Image Captioning via Visual Region Aggregation and Dual-level Collaboration
Song, J., Zeng, P., Gu, J., Zhu, J., & Gao, L. (2023) · International Journal of Software and Informatics · doi:10.21655/ijsi.1673-7288.00316 · Cited by 1
Video Turing Test: A first step towards human‐level AI
Lee, M., Heo, Y., Choi, S.-H., Choi, W. S., & Zhang, B. (2023) · AI Magazine · doi:10.1002/aaai.12128 · Cited by 3
SpaceCLIP: A Vision-Language Pretraining Framework With Spatial Reconstruction On Text
Zou, B., Chao, Y., Quan, C., & Zhao, Y. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612379 · Cited by 1
Metadata
- Authors
- Miech, A., Zhukov, D., Alayrac, J.-B., Tapaswi, M., Laptev, I., & Sivic, J.
- Affiliations
- Centre National de la Recherche Scientifique (FR)
- Institut national de recherche en sciences et technologies du numérique (FR)
- Venue
- 2019 IEEE/CVF International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2019-10
- Pages
- 2630-2640
- OpenAlex
- W2948859046
- Cited by
- 986
- References
- 69
- Citations by year
- 2026: 77 · 2025: 138 · 2024: 170 · 2023: 213 · 2022: 161 · 2021: 155 · 2020: 65 · 2019: 7
- FWCI
- 31.62
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE/CVF International Conference on Computer Vision (ICCV) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- HAL (submittedVersion)
- arXiv (Cornell University)
- Funders
- Canadian Institute for Advanced Research
- European Regional Development Fund (02.1.01/0.0/0.0, CZ.02, CZ.02.1.01, CZ.02.1.01/0.0, CZ.02.1.01/0.0/0.0)
- FP7 Ideas: European Research Council (336845)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Analysis and Summarization
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Keywords
- video-text retrieval, action localization, domain transfer, large-scale video datasets
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
