HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clips

Miech, Antoine, Zhukov, Dimitri, Alayrac, Jean-Baptiste, Tapaswi, Makarand, Laptev, Ivan, Sivic, Josef·2019·2019 IEEE/CVF International Conference on Computer Vision (ICCV)
DOI 10.1109/iccv.2019.00272

Cited by (989)

Items 101–200 of 989

  1. VIOLET : End-to-End Video-Language Transformers with Masked Visual-token Modeling
    Tsu-Jui Fu, Linjie Li, Zhe Gan, Kevin Lin, William Yang Wang, Lijuan Wang, Zicheng Liu · 2021 · arXiv (Cornell University)
  2. Text with Knowledge Graph Augmented Transformer for Video Captioning
    Xin Gu, Guang Chen, Yufei Wang, Libo Zhang, Tiejian Luo, Longyin Wen · 2023 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  3. Temporal Query Networks for Fine-grained Video Understanding
    Chuhan Zhang, Ankush Gupta, Andrew Zisserman · 2021 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  4. VLM: Task-agnostic Video-Language Model Pre-training for Video Understanding
    Hu Xu, Gargi Ghosh, Po-Yao Huang, Prahal Arora, Masoumeh Aminzadeh, Christoph Feichtenhofer, Florian Metze, Luke Zettlemoyer · 2021 · Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
  5. Broaden Your Views for Self-Supervised Video Learning
    Adrià Recasens, Pauline Luc, Jean-Baptiste Alayrac, Luyu Wang, Florian Strub, Corentin Tallec, Mateusz Malinowski, Viorica Pătrăucean, Florent Altché, Michal Valko et al. · 2021 · IEEE/CVF International Conference on Computer Vision (ICCV)
  6. Region Generation and Assessment Network for Occluded Person Re-Identification
    Shuting He, Weihua Chen, Kai Wang, Hao Luo, Fan Wang, Wei Jiang, Henghui Ding · 2023 · IEEE Transactions on Information Forensics and Security
  7. Spatial-Temporal Graphs for Cross-Modal Text2Video Retrieval
    Xue Song, Jingjing Chen, Zuxuan Wu, Yu–Gang Jiang · 2021 · IEEE Transactions on Multimedia
  8. Align and Tell: Boosting Text-Video Retrieval With Local Alignment and Fine-Grained Supervision
    Xiaohan Wang, Linchao Zhu, Zhedong Zheng, Mingliang Xu, Yi Yang · 2022 · IEEE Transactions on Multimedia
  9. GODIVA: Generating Open-DomaIn Videos from nAtural Descriptions
    Wu, Chenfei, Huang, Lun, Zhang, Qianxi, Li, Binyang, Ji, Lei, Yang, Fan, Sapiro, Guillermo, Duan, Nan · 2021 · arXiv
  10. Reading-Strategy Inspired Visual Representation Learning for Text-to-Video Retrieval
    Jianfeng Dong, Yabing Wang, Xianke Chen, Xiaoye Qu, Xirong Li, Yuan He, Xun Wang · 2022 · IEEE Transactions on Circuits and Systems for Video Technology
  11. EgoVLPv2: Egocentric Video-Language Pre-training with Fusion in the Backbone
    Shraman Pramanick, Yale Song, Sayan Nag, Kevin Qinghong Lin, Hardik Shah, Mike Zheng Shou, Rama Chellappa, Pengchuan Zhang · 2023 · IEEE/CVF International Conference on Computer Vision (ICCV)
  12. Vision-Language-Action Models for Robotics: A Review Towards Real-World Applications
    Kento Kawaharazuka, Jihoon Oh, Jun Yamada, Ingmar Posner, Yuke Zhu · 2025 · IEEE Access
  13. UniViLM: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation.
    Huaishao Luo, Lei Ji, Botian Shi, Haoyang Huang, Nan Duan, Tianrui Li, Xilin Chen, Ming Zhou · 2020 · arXiv (Cornell University)
  14. Bridge-Prompt: Towards Ordinal Action Understanding in Instructional Videos
    Muheng Li, Lei Chen, Yueqi Duarr, Zhilan Hu, Jianjiang Feng, Jie Zhou, Jiwen Lu · 2022 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  15. X2-VLM: All-in-One Pre-Trained Model for Vision-Language Tasks
    Yan Zeng, Xinsong Zhang, Hang Li, Jiawei Wang, Jipeng Zhang, Wangchunshu Zhou · 2023 · IEEE Transactions on Pattern Analysis and Machine Intelligence
  16. VideoLLM-online: Online Video Large Language Model for Streaming Video
    Joya Chen, Zhaoyang Lv, Shiwei Wu, Kevin Qinghong Lin, Chenan Song, Difei Gao, Jia-Wei Liu, Ziteng Gao, Dongxing Mao, Mike Zheng Shou · 2024 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  17. Multimodal Clustering Networks for Self-supervised Learning from Unlabeled Videos
    Brian Chen, Andrew Rouditchenko, Kevin Duarte, Hilde Kuehne, Samuel Thomas, Angie Boggust, Rameswar Panda, Brian E. D. Kingsbury, Rogério Feris, David F. Harwath et al. · 2021 · IEEE/CVF International Conference on Computer Vision (ICCV)
  18. Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrieval
    Bain, Max, Nagrani, Arsha, Varol, Gul, Zisserman, Andrew · 2021 · 2021 IEEE/CVF International Conference on Computer Vision (ICCV)
  19. Revisiting Temporal Modeling for CLIP-Based Image-to-Video Knowledge Transferring
    Liu, Ruyang, Huang, Jingjia, Li, Ge, Feng, Jiashi, Wu, Xinglong, Li, Thomas H. · 2023 · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
  20. UATVR: Uncertainty-Adaptive Text-Video Retrieval
    Bo Fang, Wenhao Wu, Chang Liu, Yu Zhou, Yuxin Song, Weiping Wang, Xiangbo Shu, Xiangyang Ji, Jingdong Wang · 2023 · IEEE/CVF International Conference on Computer Vision (ICCV)
  21. COTS: Collaborative Two-Stream Vision-Language Pre-Training Model for Cross-Modal Retrieval
    Haoyu Lu, Nanyi Fei, Yuqi Huo, Yizhao Gao, Zhiwu Lu, Ji-Rong Wen · 2022 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  22. Revealing Single Frame Bias for Video-and-Language Learning
    Jie Lei, Tamara L. Berg, Mohit Bansal · 2023 · Proceedings of the conference - Association for Computational Linguistics. Meeting
  23. Human action recognition approaches with video datasets—A survey
    Tansel Özyer, Ak Duygu Selin, Reda Alhajj · 2021 · Knowledge-Based Systems
  24. VoP: Text-Video Co-Operative Prompt Tuning for Cross-Modal Retrieval
    Siteng Huang, Biao Gong, Yulin Pan, Jianwen Jiang, Yiliang Lv, Yuyuan Li, Donglin Wang · 2023 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  25. VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset
    Jing Liu, Sihan Chen, Xingjian He, Longteng Guo, Xinxin Zhu, Weining Wang, Jinhui Tang · 2024 · IEEE Transactions on Pattern Analysis and Machine Intelligence
  26. Temporal Alignment Networks for Long-term Video
    Tengda Han, Weidi Xie, Andrew Zisserman · 2022 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  27. LAVENDER: Unifying Video-Language Understanding as Masked Language Modeling
    Linjie Li, Zhe Gan, Kevin Lin, Chung-Ching Lin, Zicheng Liu, Ce Liu, Lijuan Wang · 2023 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  28. Intra- and Inter-Action Understanding via Temporal Action Parsing
    Dian Shao, Yue Zhao, Bo Dai, Dahua Lin · 2020 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  29. Procedure Planning in Instructional Videos
    Chien-Yi Chang, De-An Huang, Danfei Xu, Ehsan Adeli, Li Fei-Fei, Juan Carlos Niebles · 2020 · Lecture notes in computer science
  30. Object-aware Video-language Pre-training for Retrieval
    Alex Jinpeng Wang, Yixiao Ge, Guanyu Cai, Rui Yan, Xudong Lin, Ying Shan, Xiaohu Qie, Mike Zheng Shou · 2022 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  31. Partially Relevant Video Retrieval
    Jianfeng Dong, Xianke Chen, Minsong Zhang, Xun Yang, Shujie Chen, Xirong Li, Xun Wang · 2022 · ACM International Conference on Multimedia (ACM MM)
  32. Learning Audio-Video Modalities from Image Captions
    Arsha Nagrani, Paul Hongsuck Seo, Bryan Seybold, Anja Hauth, Santiago Manén, Chen Sun, Cordelia Schmid · 2022 · Lecture notes in computer science
  33. Vision-Language Models Can Identify Distracted Driver Behavior From Naturalistic Videos
    Md Zahid Hasan, Jiajing Chen, Jiyang Wang, Mohammed Shaiqur Rahman, Ameya Joshi, Senem Velipasalar, Chinmay Hegde, Anuj Sharma, Soumik Sarkar · 2024 · IEEE Transactions on Intelligent Transportation Systems
  34. Geometric Matching for Cross-Modal Retrieval
    Zheng Wang, Zhenwei Gao, Yang Yang, Guoqing Wang, Chengbo Jiao, Heng Tao Shen · 2024 · IEEE Transactions on Neural Networks and Learning Systems
  35. Home Action Genome: Cooperative Compositional Action Understanding
    Nishant Rai, Haofeng Chen, Jingwei Ji, Rishi Desai, Kazuki Kozuka, Shun Ishizaka, Ehsan Adeli, Juan Carlos Niebles · 2021 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  36. VindLU: A Recipe for Effective Video-and-Language Pretraining
    Feng Cheng, Xizi Wang, Jie Lei, David Crandall, Mohit Bansal, Gedas Bertasius · 2023 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  37. Visual Semantic Role Labeling for Video Understanding
    Arka Sadhu, Tanmay Gupta, Mark Yatskar, Ram Nevatia, Aniruddha Kembhavi · 2021 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  38. Progressive Spatio-Temporal Prototype Matching for Text-Video Retrieval
    Pandeng Li, Chen-Wei Xie, Liming Zhao, Hongtao Xie, Jiannan Ge, Yun Zheng, Deli Zhao, Yongdong Zhang · 2023 · IEEE/CVF International Conference on Computer Vision (ICCV)
  39. SEA: Sentence Encoder Assembly for Video Retrieval by Textual Queries
    Xirong Li, Fangming Zhou, Chaoxi Xu, Jiaqi Ji, Gang Yang · 2020 · IEEE Transactions on Multimedia
  40. Learning To Recognize Procedural Activities with Distant Supervision
    Xudong Lin, Fabio Petroni, Gedas Bertasius, Marcus Rohrbach, Shih‐Fu Chang, Lorenzo Torresani · 2022 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  41. Accurate and Fast Compressed Video Captioning
    Yaojie Shen, Xin Gu, Kai Xu, Heng Fan, Longyin Wen, Libo Zhang · 2023 · IEEE/CVF International Conference on Computer Vision (ICCV)
  42. CAPformer: Pedestrian Crossing Action Prediction Using Transformer
    Javier Lorenzo, I. Parra, Rubén Izquierdo, Augusto Luis Ballardini, Álvaro Hernández, David Fernández Llorca, Miguel Ángel Sotelo · 2021 · Sensors
  43. SoccerNet-Caption: Dense Video Captioning for Soccer Broadcasts Commentaries
    Hassan Mkhallati, Anthony Cioppa, Silvio Giancola, Bernard Ghanem, Marc Van Droogenbroeck · 2023 · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
  44. Toward Video Anomaly Retrieval From Video Anomaly Detection: New Benchmarks and Model
    Peng Wu, Jing Liu, Xiangteng He, Yuxin Peng, Peng Wang, Yanning Zhang · 2024 · IEEE Transactions on Image Processing
  45. VideoAgent: A Memory-Augmented Multimodal Agent for Video Understanding
    Yue Fan, Xiaojian Ma, Rujie Wu, Yuntao Du, Jiaqi Li, Zhi Feng Gao, Qing Li · 2024 · Lecture notes in computer science
  46. Contrastive Video Question Answering via Video Graph Transformer
    Junbin Xiao, Pan Zhou, Angela Yao, Yicong Li, Richang Hong, Shuicheng Yan, Tat‐Seng Chua · 2023 · IEEE Transactions on Pattern Analysis and Machine Intelligence
  47. Verbs in Action: Improving verb understanding in video-language models
    Liliane Momeni, Mathilde Caron, Arsha Nagrani, Andrew Zisserman, Cordelia Schmid · 2023 · IEEE/CVF International Conference on Computer Vision (ICCV)
  48. Spoken Moments: Learning Joint Audio-Visual Representations from Video Descriptions
    Mathew Monfort, SouYoung Jin, Alexander H. Liu, David F. Harwath, Rogério Feris, James Robert Glass, Aude Oliva · 2021 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  49. Look Before you Speak: Visually Contextualized Utterances
    Paul Hongsuck Seo, Arsha Nagrani, Cordelia Schmid · 2021 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  50. Perspectives and Prospects on Transformer Architecture for Cross-Modal Tasks with Language and Vision
    Andrew Shin, Masato Ishii, Takuya Narihira · 2022 · International Journal of Computer Vision
  51. Multilingual Multimodal Pre-training for Zero-Shot Cross-Lingual Transfer of Vision-Language Models
    Po-Yao Huang, Mandela Patrick, Junjie Hu, Graham Neubig, Florian Metze, Alexander G. Hauptmann · 2021 · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
  52. An Empirical Study of End-to-End Video-Language Transformers with Masked Visual Modeling
    Tsu-Jui Fu, Linjie Li, Zhe Gan, Kevin Lin, William Yang Wang, Lijuan Wang, Zicheng Liu · 2023 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  53. Toyota Smarthome Untrimmed: Real-World Untrimmed Videos for Activity Detection
    Rui Dai, Srijan Das, Saurav Sharma, Luca Minciullo, Lorenzo Garattoni, François Brémond, Gianpiero Francesca · 2022 · IEEE Transactions on Pattern Analysis and Machine Intelligence
  54. Boundary-sensitive Pre-training for Temporal Localization in Videos
    Mengmeng Xu, Juan-Manuel Pérez-Rúa, Victor A Escorcia, Brais Martínez, Xiatian Zhu, Li Zhang, Bernard Ghanem, Tao Xiang · 2021 · IEEE/CVF International Conference on Computer Vision (ICCV)
  55. Support-Set Based Cross-Supervision for Video Grounding
    Xinpeng Ding, Nannan Wang, Shiwei Zhang, De Cheng, Xiaomeng Li, Ziyuan Huang, Mingqian Tang, Xinbo Gao · 2021 · IEEE/CVF International Conference on Computer Vision (ICCV)
  56. On Compositions of Transformations in Contrastive Self-Supervised Learning
    Mandela Patrick, Yuki M. Asano, Polina Kuznetsova, Ruth Fong, João F. Henriques, Geoffrey Zweig, Andrea Vedaldi · 2021 · IEEE/CVF International Conference on Computer Vision (ICCV)
  57. VALUE: A Multi-Task Benchmark for Video-and-Language Understanding Evaluation
    Linjie Li, Jie Lei, Zhe Gan, Licheng Yu, Yen-Chun Chen, Pillai, Rohit, Yu Cheng, Luowei Zhou, Xin Eric Wang, William Yang Wang et al. · 2021 · arXiv (Cornell University)
  58. A dataset for medical instructional video classification and question answering
    Deepak Gupta, Kush Attal, Dina Demner‐Fushman · 2023 · Scientific Data
  59. CelebV-Text: A Large-Scale Facial Text-Video Dataset
    Jianhui Yu, Hao Zhu, Liming Jiang, Chen Change Loy, Weidong Cai, Wayne Wu · 2023 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  60. CoVR: Learning Composed Video Retrieval from Web Video Captions
    Lucas Ventura, Antoine Yang, Cordelia Schmid, Gül Varol · 2024 · Proceedings of the AAAI Conference on Artificial Intelligence
  61. Multimodal Pretraining for Dense Video Captioning
    Gabriel Huang, Bo Pang, Zhenhai Zhu, Clara E. Rivera, Radu Soricut · 2020 · Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the International Joint Conference on Natural Language Processing (AACL-IJCNLP)
  62. CONQUER: Contextual Query-aware Ranking for Video Corpus Moment Retrieval
    Zhijian Hou, Chong‐Wah Ngo, W. K. Chan · 2021 · ACM International Conference on Multimedia (ACM MM)
  63. Fine-grained Cross-modal Alignment Network for Text-Video Retrieval
    Ning Han, Jingjing Chen, Guangyi Xiao, Hao Zhang, Zeng YaWen, Hao Chen · 2021 · ACM International Conference on Multimedia (ACM MM)
  64. Linguistic Structures as Weak Supervision for Visual Scene Graph Generation
    Keren Ye, Adriana Kovashka · 2021 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  65. Survey: Transformer based video-language pre-training
    Ludan Ruan, Qin Jin · 2022 · AI Open
  66. Object Discovery and Representation Networks
    Olivier J. Hénaff, Skanda Koppula, Evan Shelhamer, Daniel Zoran, Andrew Jaegle, Andrew Zisserman, João Carreira, Relja Arandjelović · 2022 · Lecture notes in computer science
  67. Modeling short visual events through the BOLD moments video fMRI dataset and metadata
    Benjamin Lahner, Kshitij Dwivedi, Polina Iamshchinina, Monika Graumann, Alex Lascelles, Gemma Roig, Alessandro T. Gifford, Bowen Pan, SouYoung Jin, N. Apurva Ratan Murty et al. · 2024 · Nature Communications
  68. MoReVQA: Exploring Modular Reasoning Models for Video Question Answering
    Juhong Min, Shyamal Buch, Arsha Nagrani, Minsu Cho, Cordelia Schmid · 2024 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  69. Clover: Towards A Unified Video-Language Alignment and Fusion Model
    Jingjia Huang, Yinan Li, Jiashi Feng, Xinglong Wu, Xiaoshuai Sun, Rongrong Ji · 2023 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  70. Towards Visual-Prompt Temporal Answer Grounding in Instructional Video
    Shutao Li A, Bin Li, Bin Sun, Yixuan Weng · 2024 · IEEE Transactions on Pattern Analysis and Machine Intelligence
  71. RoboVQA: Multimodal Long-Horizon Reasoning for Robotics
    Pierre Sermanet, Tianli Ding, Jeffrey W. Zhao, Fei Xia, Debidatta Dwibedi, Keerthana Gopalakrishnan, Christine Chan, Gabriel Dulac-Arnold, Sharath Maddineni, Nikhil J Joshi et al. · 2024 · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings
  72. Trends in Integration of Vision and Language Research: A Survey of Tasks, Datasets, and Methods
    Aditya Mogadala, Marimuthu Kalimuthu, Dietrich Klakow · 2021 · Journal of Artificial Intelligence Research
  73. Searching for Actions on the Hyperbole
    Teng Long, Pascal Mettes, Heng Tao Shen, Cees G. M. Snoek · 2020 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  74. DeCEMBERT: Learning from Noisy Instructional Videos via Dense Captions and Entropy Minimization
    Zineng Tang, Jie Lei, Mohit Bansal · 2021 · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
  75. LocVTP: Video-Text Pre-training for Temporal Localization
    Meng Cao, Tianyu Yang, Junwu Weng, Can Zhang, Jue Wang, Yuexian Zou · 2022 · Lecture notes in computer science
  76. Prompt Switch: Efficient CLIP Adaptation for Text-Video Retrieval
    Chaorui Deng, Qi Chen, Pengda Qin, Da Chen, Qi Wu · 2023 · IEEE/CVF International Conference on Computer Vision (ICCV)
  77. What is More Likely to Happen Next? Video-and-Language Future Event Prediction
    Jie Lei, Licheng Yu, Tamara L. Berg, Mohit Bansal · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  78. AutoAD: Movie Description in Context
    Han, Tengda, Bain, Max, Nagrani, Arsha, Varol, Gül, Xie, Weidi, Zisserman, Andrew · 2023 · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
  79. UnLoc: A Unified Framework for Video Localization Tasks
    Yan Shen, Xuehan Xiong, Arsha Nagrani, Anurag Arnab, Zhonghao Wang, Weina Ge, David A. Ross, Cordelia Schmid · 2023 · IEEE/CVF International Conference on Computer Vision (ICCV)
  80. Learning multi-modal representations by watching hundreds of surgical video lectures
    Kun Yuan, Vinkle Srivastav, Tong Yu, Joël L. Lavanchy, Jacques Marescaux, Pietro Mascagni, Nassir Navab, Nicolas Padoy · 2025 · Medical Image Analysis
  81. Panoptic Video Scene Graph Generation
    Jingkang Yang, Wenxuan Peng, Xiangtai Li, Zujin Guo, Liangyu Chen, Bo Li, Zheng Ma, Kaiyang Zhou, Wayne Zhang, Chen Change Loy et al. · 2023 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  82. Cross-Modal Discrete Representation Learning
    Alexander H. Liu, SouYoung Jin, Cheng-I Lai, Andrew Rouditchenko, Aude Oliva, James Robert Glass · 2022 · Proceedings of the conference - Association for Computational Linguistics. Meeting
  83. My View is the Best View: Procedure Learning from Egocentric Videos
    Siddhant Bansal, Chetan Arora, C. V. Jawahar · 2022 · Lecture notes in computer science
  84. Hierarchical Video-Moment Retrieval and Step-Captioning
    Abhay Zala, Jaemin Cho, Satwik Kottur, Xilun Chen, Barlas Oğuz, Yashar Mehdad, Mohit Bansal · 2023 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  85. Neural ranking models for document retrieval
    Mohamed Trabelsi, Zhiyu Chen, Brian D. Davison, Jeff Heflin · 2021 · Information Retrieval
  86. MLVU: Benchmarking Multi-task Long Video Understanding
    Zhou, Junjie, Shu, Yan, Zhao, Bo, Wu, Boya, Liang, Zhengyang, Xiao, Shitao, Qin, Minghao, Yang, Xi, Xiong, Yongping, Zhang, Bo et al. · 2025 · 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
  87. EgoExoLearn: A Dataset for Bridging Asynchronous Ego- and Exo-centric View of Procedural Activities in Real World
    Yifei Huang, Chen Guo, Jilan Xu, Mingfang Zhang, Lijin Yang, Baoqi Pei, Hongjie Zhang, Dong Lu, Yali Wang, Limin Wang et al. · 2024 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  88. Video Big Data Analytics in the Cloud: A Reference Architecture, Survey, Opportunities, and Open Research Issues
    Aftab Alam, Irfan Ullah, Young-Koo Lee · 2020 · IEEE Access
  89. Comprehensive Instructional Video Analysis: The COIN Dataset and Performance Evaluation
    Yansong Tang, Jiwen Lu, Jie Zhou · 2020 · IEEE Transactions on Pattern Analysis and Machine Intelligence
  90. Swap Attention in Spatiotemporal Diffusions for Text-to-Video Generation
    Wenjing Wang, Huan Yang, Zixi Tuo, Huiguo He, Junchen Zhu, Jianlong Fu, Jiaying Liu · 2025 · International Journal of Computer Vision
  91. A Case Study on Combining ASR and Visual Features for Generating Instructional Video Captions
    Jack Hessel, Bo Pang, Zhenhai Zhu, Radu Soricut · 2019 · Conference on Computational Natural Language Learning
  92. Adaptive Spatio-Temporal Graph Enhanced Vision-Language Representation for Video QA
    Weike Jin, Zhou Zhao, Xiaochun Cao, Jieming Zhu, Xiuqiang He, Yueting Zhuang · 2021 · IEEE Transactions on Image Processing
  93. Tagging before Alignment: Integrating Multi-Modal Tags for Video-Text Retrieval
    Yizhen Chen, Jie Wang, Lijian Lin, Zhongang Qi, Jin Ma, Ying Shan · 2023 · Proceedings of the AAAI Conference on Artificial Intelligence
  94. Data Roaming and Quality Assessment for Composed Image Retrieval
    Matan Levy, Rami Ben‐Ari, Nir Darshan, Dani Lischinski · 2024 · Proceedings of the AAAI Conference on Artificial Intelligence
  95. WorldGPT: Empowering LLM as Multimodal World Model
    Zhiqi Ge, Hongzhe Huang, Mingze Zhou, Juncheng Li, Guoming Wang, Siliang Tang, Yueting Zhuang · 2024 · ACM International Conference on Multimedia (ACM MM)
  96. EclipSE: Efficient Long-Range Video Retrieval Using Sight and Sound
    Yan-Bo Lin, Jie Lei, Mohit Bansal, Gedas Bertasius · 2022 · Lecture notes in computer science
  97. The Challenges of Continuous Self-Supervised Learning
    Senthil Purushwalkam, Pedro M. Morgado, Abhinav Gupta · 2022 · Lecture notes in computer science
  98. Towards Generalisable Video Moment Retrieval: Visual-Dynamic Injection to Image-Text Pre-Training
    Dezhao Luo, Jiabo Huang, Shaogang Gong, Hailin Jin, Yang Liu · 2023 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  99. Disentangling Spatial and Temporal Learning for Efficient Image-to-Video Transfer Learning
    Zhiwu Qing, Shiwei Zhang, Ziyuan Huang, Yingya Zhang, Changxin Gao, Deli Zhao, Nong Sang · 2023 · IEEE/CVF International Conference on Computer Vision (ICCV)
  100. Deep learning for video-text retrieval: a review
    Cunjuan Zhu, Qi Fen Jia, Wei Ren Chen, Yanming Guo, Yu Liu · 2023 · International Journal of Multimedia Information Retrieval