The DOI matches its Crossref record; 68 of the 69 references it cites were found in a registry or an index.
HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clips
Open accessAbstract
Learning text-video embeddings usually requires a dataset of video clips with manually provided captions. However, such datasets are expensive and time consuming to create and therefore difficult to obtain on a large scale. In this work, we propose instead to learn such embeddings from video data with readily available natural language annotations in the form of automatically transcribed narrations. The contributions of this work are three-fold. First, we introduce HowTo100M: a large-scale dataset of 136 million video clips sourced from 1.22M narrated instructional web videos depicting humans performing and describing over 23k different visual tasks. Our data collection procedure is fast, scalable and does not require any additional manual annotation. Second, we demonstrate that a text-video embedding trained on this data leads to state-of-the-art results for text-to-video retrieval and action localization on instructional video datasets such as YouCook2 or CrossTask. Finally, we show that this embedding transfers well to other domains: fine-tuning on generic Youtube videos (MSR-VTT dataset) and movies (LSMDC dataset) outperforms models trained on these datasets alone. Our dataset, code and models are publicly available.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The beginning and end of videos, especially tutorial videos (Miech et al., 2019), often consist of an intro, respectively an outro. These sections are not as related to the content of the videos and contain fewer movements and actions.”
From Intuitive physics understanding emerges from self-supervised pretraining on natural videos (2025) · cites this paper as Miech et al., 2019
Experimental — accuracy not yet measuredIn the citing paper
“More modalities.In addition to the general modalities of vision, text, and audio, further diverse modalities are emerging, e.g., Pano-AVQA [144] -the first large-scale spatial and audio-visual question answering dataset on 360 • videos, YouTube-360 (YT-360) [145] (360 • videos), AIST++ [146] (a new multimodal dataset of 3D dance motion and music), Artemis [147] (affective language for visual arts)”
From Multimodal learning with transformers: A survey (2023) · cites this paper as [144]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset
Carreira, J., & Zisserman, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.502 · Cited by 9,570
Revisiting Unreasonable Effectiveness of Data in Deep Learning Era
Sun, C., Shrivastava, A., Singh, S., & Gupta, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.97 · Cited by 2,484
Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet?
Hara, K., Kataoka, H., & Satoh, Y. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00685 · Cited by 2,346
MSR-VTT: A Large Video Description Dataset for Bridging Video and Language
Xu, J., Mei, T., Yao, T., & Rui, Y. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.571 · Cited by 1,888
Image Captioning with Semantic Attention
You, Q., Jin, H., Wang, Z., Chen, F., & Luo, J. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.503 · Cited by 1,869
Research works printed but not linked: 4
- radford, 2018, Improving Language Understandingby Generative Pre-Training, Preprint
- 2019, Project webpage
- radford, 2019, Language models are unsupervised multitask learners, Preprint
- damen, 2018, Scaling egocentric vision: The epic-kitchens dataset, ECCV
Cited by
Sorted by citations
Items 901–990 of 990
HAN: Korean Heritage Augmented Narrative Visual-Language Description Dataset
Moon, S., Zhakatayev, A., & Lee, S. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3758229
Hu, C., Chen, Y., & Ma, L. (2025) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme59968.2025.11209266
Dual-Strategy Knowledge-Semantics Guided Network for Video Captioning
Qian, Y., & Fang, B. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11228107
Quality Over Quantity? LLM-Based Curation for a Data-Efficient Audio-Video Foundation Model
Vosoughi, A., Emmanouilidou, D., & Gamper, H. (2025) · European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco63237.2025.11226207 · Cited by 1
Fang, F., Yang, M., Wu, M., Yang, Y., Xu, Q., Lim, J., Yang, X., & Zhu, H. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3641798
LEARNet: A Learning Entropy-Aware Representation Network for Educational Video Understanding
Chitrakala, S., Nivedha, V. V., & R, N. S. (2025) · Entropy · doi:10.3390/e28010003
Language-Driven Graphs for Short Video Similarity
Yugoshi, J. K., & Marcacini, R. M. (2025) · doi:10.5753/eniac.2025.14276
Plou, C., Mur-Labadia, L., Guerrero, J. J., Martínez-Cantín, R., & Murillo, A. C. (2025) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2025.104622
A Video Retrieval System with EVA-CLIP and Customized Keyframes Extraction
Quan, K.-A. C., & Nguyen, Q. N. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-00972-2_32
Basics and Advances of Video Grounding
Wang, X., Lan, X., & Zhu, W. (2025) · Springer eBooks · doi:10.1007/978-3-031-94837-4_2
A Study on Multimodal Foundation Models for Affective Video Prediction
Agnelli, F., Ditroia, M., Blandano, G., D’Amelio, A., Ghezzi, O., Paoli, M. D., & Lanzarotti, R. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-10192-1_19
ASR-Enhanced Multimodal Representation Learning for Cross-Domain Product Retrieval
Zhao, R., Jia, J., Li, Y., Bai, X., Chen, Q., Li, H., Jiang, P., & Li, X. (2026) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2026.3651039
It’s Just Another Day: Unique Video Captioning by Discriminitive Prompting
Perrett, T., Han, T., Damen, D., & Zisserman, A. (2026) · International Journal of Computer Vision · doi:10.1007/s11263-025-02664-4
Dialogue-AV: A Dialogue-Attended Audiovisual Dataset
Vilaça, L., Viana, P., & Yu, Y. (2025) · International Workshop on Content-Based Multimedia Indexing (CBMI) · doi:10.1109/cbmi66578.2025.11339348
Dual-Grained Alignment with Dynamic Clip Modeling for Partially Relevant Video Retrieval
Jiang, D., Jiang, B., Yang, C., & Zhang, Q. F. (2026) · Communications in computer and information science · doi:10.1007/978-981-95-5294-8_19
Kruthika, C. G., Gagana, B. R., & Namithadevi, N. N. (2025) · IEEE Global Conference for Advancement in Technology (GCAT) · doi:10.1109/gcat66372.2025.11368428
Beyond Real Versus Fake: Towards Intent-Aware Video Analysis
Atreya, S., Quignon, N., Chopin, B., Das, A., & Dantcheva, A. (2026) · IEEE Transactions on Biometrics Behavior and Identity Science · doi:10.1109/tbiom.2026.3663642 · Cited by 1
Multimodal fusion and knowledge enhancement for accurate video captioning
Zhong, R., Zhang, Q., Li, H., & Zuo, M. (2026) · The Journal of Supercomputing · doi:10.1007/s11227-026-08284-0
Preserving Identity in Portrait Video Generation via Facial Structure Injection
Liao, Z., Dai, D., Yang, L., & Zhang, C. (2025) · International Conference on Computer, Big Data and Artificial Intelligence (ICCBD+AI) · doi:10.1109/iccbdai66607.2025.11389014
HierVision: Standardized and Reproducible Hierarchical Sources for Vision Datasets
Kasarla, T., Rooparaghunath, R. H., D’Arrigo, S., Mago, G., Jha, A., Ayoughi, M., Mishra, S. S., Rodriguez, A. M., Long, T., Atigh, M. G., et al. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00076
A Focused Survey on Multimodal Recipe Extraction from Cooking Videos
Alj, K. S., Smith, K. S., & Salih-Alj, Y. (2025) · International Conference on Innovation and Intelligence for Informatics, Computing, and Technologies (3ICT) · doi:10.1109/3ict68299.2025.11442087
Structured deep learning for video analysis
Baradel, F. (2020) · theses.fr (ABES) · doi:10.70675/2a8e4991z61e3z4030z8b4cz030a297ed81c
Learning to localize goal-oriented actions with weak supervision
Zhukov, D. (2021) · doi:10.70675/46949df1z20a0z45b9zaa69ze59147934f9d
Self-citationDeep learning and neuroscience : a match made in heaven?
Choksi, B. (2022) · theses.fr (ABES) · doi:10.70675/42802d90z0c77z4de8z829dz508145498217
How to train your global workspace? Evaluating and efficiently learning multimodal representations
Devillers, B. (2022) · theses.fr (ABES) · doi:10.70675/101815c7zb6faz411czaa4bz7149c56f0e5d
From weakly supervised learning to active labeling
Cabannes, V. (2022) · theses.fr (ABES) · doi:10.70675/7153dc52z3c48z4a31z8b7bzd0b3fa4a7b66
Video question answering with limited supervision
Engin, D. (2024) · theses.fr (ABES) · doi:10.70675/c9c7dcf2z4ca3z4e91z9d27zdacd00f76581
Multimodal deep learning for audiovisual production
Ouenniche, K. (2023) · theses.fr (ABES) · doi:10.70675/a01becf4z4ed9z4955z940cz49c821c1b8a8
Learning effective video representations for action recognition
Yang, D. (2024) · theses.fr (ABES) · doi:10.70675/4046013fz7818z4acdza84bze9be293f2334
InstrAct: Towards Action-Centric Understanding in Instructional Videos
Yang, Z., Yu, J., Tan, R., Li, B., & Xu, H. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37429-5_2
Javaheri, H., Ghamarnejad, O., Schwarzkopf, P. D. K., Karolus, J., Stavrou, G. A., & Lukowicz, P. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790327
Causal Counterfactual Inference Network for Video Object State Changes in Open-World Scenarios
Wang, Z., Huang, S., Li, M., & Jiao, Y. (2026) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2026.3678945
Ethical and Practical Trade-Offs in Human Action Recognition Models for Assistive Systems
Chiroiu-Jitianu, D., Nan, M., & Mocanu, I. G. (2025) · International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC) · doi:10.1109/synasc69064.2025.00068
Text Semantics-Guided Dual-Teacher Knowledge Distillation for Partially Relevant Video Retrieval
Zeng, R., Wang, Y., Zhuo, Y., Liang, F., Duan, H., & Li, H. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11464179
Million-Scale Text-to-Video Retrieval with Hyperdimensional Computing
Lee, H., Gwak, J., Jang, S., Lee, J. D., & Kim, Y. (2026) · European Conference on Computer Systems · doi:10.1145/3767295.3803610
Farid, O., & Mahmoud, H. A. (2026) · Computational Discovery and Intelligent Systems (CDIS) · doi:10.66279/292sm294
Before the First Token: Benchmarking Data Preprocessing in Vision-Language Models
Zohdi, S., & Wang, L. (2026) · Workshop on Machine Learning and Systems (EuroMLSys) · doi:10.1145/3805621.3807641
Text-Video Retrieval With Global-Local Contrastive Consistency Learning
Jing, X., Yang, X., & Yang, G. (2025) · China Automation Congress (CAC) · doi:10.1109/cac67268.2025.11487249
Switch-a-View: View Selection Learned from Unlabeled In-the-Wild Videos
Majumder, S., Nagarajan, T., Al-Halah, Z., & Grauman, K. L. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01113
Tang, Z., Krishnan, R. M., Yu, Z., & Sun, C. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00435
CoreCaption: Core Caption based Text-to-Video Retrieval
Jang, J. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00638
Rai, A., & Kovashka, A. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00785
When Visual Bias Overrides Symbolic Evidence: A Case Study on Tool-augmented VLMs for Block Assembly
Oomori, K., & Higuchi, K. (2026) · Augmented Humans International Conference (AHs) · doi:10.1145/3795011.3795064
Li, N. (2026) · International Conference on Artificial Intelligence, Digital Media Technology and Social Computing (ICAIDS) · doi:10.1145/3806262.3806312
EvoCap: Enhancing video captioning via self-evolving video-LLMs with knowledge consolidation
Hu, Y., Wu, M., Yu, J., Chen, Y. P., & Yang, W. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116075
Traylor, T., Bernard, B., & Ajjimaporn, P. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-22205-3_35
Quantifying Audio-Visual Fusion Gains Under Fixed-Feature Constraints on YouTube-8M
Huang, B. (2026) · International Conference on Intelligent Computing and Signal Processing (ICSP) · doi:10.1109/icsp69961.2026.11540586
Li, Z., Wen, Y., Yang, L., Pan, J., & Zhou, P. (2026) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2026.3695575
Query-based digital forensic triage using vision language models and explainable AI
Philip, A. O., U., S. M., Raju, M., P., A. A., & Swathi, R. (2026) · Cluster Computing · doi:10.1007/s10586-026-06138-1
Optimize Multimodal Data Mixture for Pre-Training with Loss Regression
Shang, L., Cheng, H., Zhou, B., & Zhang, Y. (2026) · Algorithms · doi:10.3390/a19060482
Fine-grained Text-Video Retrieval with Patch-level Temporal Difference and Aggregation
Hu, J., Song, Z., Wang, Y., Hu, Z., Li, J., Ma, Y., & Hong, R. (2026) · International Conference on Multimedia Retrieval · doi:10.1145/3805622.3810695
Xu, S., & Zhao, J. (2026) · Systems and Control Transactions · doi:10.69997/sct.104078
CapVA: Towards hierarchical understanding in Text–Video Retrieval With Caption as Video Assistant
Yu, Z., Jiang, Y., & Xu, Q. (2026) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2026.104879
Audio-Related Multimodal Learning
Chen, W., Sun, Y., & Xu, K. (2026) · Springer eBooks · doi:10.1007/978-981-95-0836-5_21
MJEPA: A Simple and Scalable Joint-Embedding Predictive Architecture for Audio-Visual Learning
Teotia, R., Bardes, A., Rabbat, M., Chopra, S., Muckley, M. J., & Ballas, N. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-36969-7_6 · Cited by 2
A survey on audio–visual large language models
Yao, W., Yahyaabadi, R., Hassani, H., & Nikan, S. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116569
HyperVLP: Enhancing Hierarchical Surgical Video-Language Pre-training in Hyperbolic Space
Hu, Y., Yuan, K., Navab, N., Ying, H., Wu, J., & Padoy, N. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38233-7_21
AID‐VLM: The Vision‐Language Model for Traffic Incident Understanding
Zhu, S., Du, Y., Li, Y., Liu, C. X., Wan, J., & Wu, D. (2026) · IET Intelligent Transport Systems · doi:10.1049/itr2.70271
Bayesian Implementation of the Factor‐Analytic Mixed Model and Application to Embeddings
Marchal, A., Lamure, M., Lefort, T., & Imbach, F. (2026) · Stat · doi:10.1002/sta4.70164 · Cited by 1
GuideMe: Multi-domain Task Guidance and Intervention in Streaming Video
Liu, F., Chen, J., Xu, K., Liu, Y., Guan, H., Lu, X., Yang, B., Hancke, G. P., Liu, R., & Lau, R. W. H. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37592-6_4
Efficient video captioning annotation: a semi-automated framework via LLM-driven heuristics
Cao, Q., 廖桂心, & Tang, T. (2026) · Multimedia Systems · doi:10.1007/s00530-026-02436-1
A Lightweight Temporal-Structural Enhancement for CLIP-Based Video-Text Retrieval
Wan, Y., Mao, X., & Yao, L. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-3432-5_46
Prompting-MammAlps: Fine-Grained Text-to-Video Retrieval for Camera-Trap Data
Gabeff, V., Maquignaz, B., Shan, J., Mamooler, S., Sümbül, G., Costelloe, B. R., Tuia, D., & Mathis, A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37574-2_3
Distribution-Alignment Bridge for Uncertainty-Aware Text-to-Video Retrieval
Chae, K., Lee, J., & Ahn, S. H. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37020-4_19
Pretraining Body Part Representations for Text–Motion Retrieval
Lin, K., Chen, S., Hu, A., & Jin, Q. (2026) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3830084
Blocking Visual Leakage: Visually-Agnostic Text Decomposition for Composed Video Retrieval
Hwang, J., Ma, M., Pham, T. X., & Kim, J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-31930-2_45
Yashima, D., Kurita, S., Oda, Y., Suzuki, S., Otsuki, S., & Sugiura, K. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-31654-7_28
Visual Semantic Decomposition and Textual Concept Enhancement for Text-Video Retrieval
Zhang, D., Wang, Z., & Wu, X. (2026) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2026.3719812
Cross-modal Fusion Transformer for Integrating Retrieved Knowledge into Video Caption Generation
Abubakirova, K., Ullah, W., Khan, L. U., & Guizani, M. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818170
Long Story Short: Story-level Video Understanding from 20K Short Films
Ghermi, R., Wang, X., Kalogeiton, V. S., & Laptev, I. (2026) · International Journal of Computer Vision · doi:10.1007/s11263-026-02940-x · Cited by 22
Temporal Coherence in Video-Language Models for Long-Form Narrative Understanding
M, T. S. M. (2026) · Eduschool Journal of Artificial Intelligence Research (EJAIR) · doi:10.63090/ejair/3139.7336.0006
Banik, M., & Hossain, I. (2025) · IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT) · doi:10.1109/wi-iat67162.2025.00031 · Cited by 1
Survey on Multimodal Product Reviews Summarisation in E-Commerce
Subbapurmath, N. R., Misra, R., & Verma, P. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-31998-2_10
From Script to Shot: A Benchmark for Grounding Screenplays in Movies
Cho, J., Park, Y.-J., Ha, S. J., Kim, S., Park, S., Shin, J., Lee, J., Hwang, C., Jung, H., Lee, S., et al. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37013-6_29
CTEPM: Continuous-Time Event Process Memory for Long-Video Language Models
Liu, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37490-5_25
Deng, C., Liu, J., Xu, C., & Chen, S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37517-9_11
CodeVisionary: An Automated Visual Explanation System for Coding Problems
Vanmathi, A., Kalaivani, B., Mohan, R., Naveen Sakthi, S., & Kanishk, R. (2026) · International Conference on Trends in Quantum Computing and Emerging Business Technologies (TQCEBT) · doi:10.1109/tqcebt67648.2026.11681136
ViTAL-X: Video-Text Alignment with Cross-Modal Temporal Edits
Sethuraman, T. V., Khosla, S., Susladkar, O., Tiwari, A., Oh, S. W., Kafle, K., Lee, J.-Y., Hoiem, D., & Jenni, S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37174-4_8
Watch Less and Uncover More: Could Navigation Tools Help Users Search and Explore Videos?
Pérez‐Ortiz, M., Bulathwela, S., Dormann, C., Verma, M., Kreitmayer, S., Noss, R., Shawe-Taylor, J. S., Rogers, Y., & Yılmaz, E. (2022) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3498366.3505814
N-of-1 multi-modal human activity forecasting framework for assistive living
Wahla, S. Q., & Khan, M. U. G. (2026) · Neural Computing and Applications · doi:10.1007/s00521-026-12079-y
LEGO Co-builder: Exploring Fine-Grained Vision-Language Modeling for Multimodal Assembly Assistants
Huang, H., Su, Y., Sun, X., Ahsan, M., Aliannejadi, M., Viola, I., Ren, Z., Yu, C., Lisowska, A., Belopolsky, A. V., et al. (2026) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3776574.3831119 · Cited by 7
NewsSegCap: Efficient Dense Video Captioning for TV News
Brimont, A., Zaharia, T. B., & Țapu, R. (2026) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3776574.3831140
Zhang, H., Lu, Y., Wang, L., Li, Y., Chen, D., Xu, Y., & Fu, Y. (2026) · doi:10.1109/cvprf71909.2026.00683
TalkVerse: Democratizing Minute-Long Audio-Driven Video Generation
Wang, Z., Wang, J., Ma, K., Lin, D., & Zhou, B. (2026) · doi:10.1109/cvprf71909.2026.00435
One Identity, Many Roles: Multimodal Entity Coreference for Enhanced Video Situation Recognition
Darur, B., Garg, A., & Tapaswi, M. (2026) · doi:10.1109/cvprf71909.2026.00794
Self-citationUnifying Scientific Communication: Fine-Grained Correspondence Across Scientific Media
Mariam, K. M. M., Balasubramanian, V. N., & Jawahar, C. V. (2026) · 2026 IEEE/CVF Conference on Computer Vision and Pattern Recognition- FINDINGS Track (CVPRF) · doi:10.1109/cvprf71909.2026.00204
Taming Hallucinations: Boosting MLLMs' Video Understanding via Counterfactual Video Generation
Huang, Z., Wen, H., Hao, A., Song, B., Wu, M., Wu, J., Chu, X., Lu, S., & Wang, H. (2026) · doi:10.1109/cvprf71909.2026.00783
Xu, Z., Wu, Z., Zhang, C., Wang, Z., Xiao, C., & Liang, C. (2026) · doi:10.1109/cvprf71909.2026.00792
Automated Video Classification and Annotation Using Deep Learning
Yadav, P., Kumari, J., & Bhargava, C. P. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-2600-1393-9.ch005
VIMPAC: Video Pre-Training via Masked Token Prediction and Contrastive Learning
Tan, H., Lei, J., Wolf, T., & Bansal, M. (2021) · arXiv · doi:10.48550/arxiv.2106.11250 · Cited by 35
Metadata
- Authors
- Miech, A., Zhukov, D., Alayrac, J.-B., Tapaswi, M., Laptev, I., & Sivic, J.
- Affiliations
- Centre National de la Recherche Scientifique (FR)
- Institut national de recherche en sciences et technologies du numérique (FR)
- Venue
- 2019 IEEE/CVF International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2019-10
- Pages
- 2630-2640
- OpenAlex
- W2948859046
- Cited by
- 986
- References
- 69
- Citations by year
- 2026: 77 · 2025: 138 · 2024: 170 · 2023: 213 · 2022: 161 · 2021: 155 · 2020: 65 · 2019: 7
- FWCI
- 31.62
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE/CVF International Conference on Computer Vision (ICCV) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- HAL (submittedVersion)
- arXiv (Cornell University)
- Funders
- Canadian Institute for Advanced Research
- European Regional Development Fund (02.1.01/0.0/0.0, CZ.02, CZ.02.1.01, CZ.02.1.01/0.0, CZ.02.1.01/0.0/0.0)
- FP7 Ideas: European Research Council (336845)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Analysis and Summarization
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Keywords
- video-text retrieval, action localization, domain transfer, large-scale video datasets
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
