ActivityNet: A large-scale video benchmark for human activity understanding
The DOI matches its Crossref record; 40 of the 43 references it cites were found in a registry or an index.
Abstract
In spite of many dataset efforts for human action recognition, current computer vision algorithms are still severely limited in terms of the variability and complexity of the actions that they can recognize. This is in part due to the simplicity of current benchmarks, which mostly focus on simple actions and movements occurring on manually trimmed videos. In this paper we introduce ActivityNet, a new large-scale video benchmark for human activity understanding. Our benchmark aims at covering a wide range of complex human activities that are of interest to people in their daily living. In its current version, ActivityNet provides samples from 203 activity classes with an average of 137 untrimmed videos per class and 1.41 activity instances per video, for a total of 849 video hours. We illustrate three scenarios in which ActivityNet can be used to compare algorithms for human activity understanding: untrimmed video classification, trimmed activity classification and activity detection.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Applications like activity recognition 30 and live scene understanding 31 are useful in detecting and responding to important or adverse clinical events 32 .”
From Deep learning-enabled medical computer vision (2021) · cites this paper as [30]
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
WordNet: a lexical database for English
Miller, G. A. (1995) · Communications of the ACM · doi:10.1145/219717.219748 · Cited by 14,015 · cited 2×
“Aloimonos et al. [10, 26] propose a twolevel organization of activities into 6 groups: ground, general object, general person, specific object, specific person, group; which connects to verbs in WordNet.”
MethodCaffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Large-Scale Video Classification with Convolutional Neural Networks
Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., & Fei-Fei, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.223 · Cited by 6,354
2011 Compendium of Physical Activities: A Second Update of Codes and MET Values
AINSWORTH, B. E., HASKELL, W. L., HERRMANN, S. D., MECKES, N., BASSETT, D. R., TUDOR-LOCKE, C., GREER, J. L., VEZINA, J., WHITT-GLOVER, M. C., & LEON, A. S. (2011) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0b013e31821ece12 · Cited by 6,317 · cited 1×
“[1] organizes a small number of physical human activities into a two level taxonomy.”
BackgroundUcf101: A dataset of 101 human actions classes from videos in the wild
Soomro, K., Zamir, A. R., & Shah, M. (2012) · arXiv · doi:10.48550/arxiv.1212.0402 · Cited by 4,575
Hmdb: a large video database for human motion recognition
Kuehne, H., Jhuang, H., Garrote, E., Poggio, T., & Serre, T. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126543 · Cited by 3,965
Learning realistic human actions from movies
Laptev, I., Marszalek, M., Schmid, C., & Rozenfeld, B. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587756 · Cited by 3,444
Research works printed but not linked: 1
- wang, 2013, Lear-inria submission for the thu-mos workshop, THUMOS ICCV Workshop on Action Recognition with A Large Number of Classes
Cited by
Items 201–300 of 1,010
Progressive Boundary Refinement Network for Temporal Action Detection
Liu, Q., & Wang, Z. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6829 · Cited by 133
Negative Sample Matters: A Renaissance of Metric Learning for Temporal Grounding
Wang, Z., Wang, L., Wu, T., Li, T., & Wu, G. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i3.20163 · Cited by 204
TCGL: Temporal Contrastive Graph for Self-Supervised Video Representation Learning
Liu, Y., Wang, K., Liu, L., Lan, H., & Lin, L. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3147032 · Cited by 154
Multi-Agent Reinforcement Learning Based Frame Sampling for Effective Untrimmed Video Recognition
Wu, W., He, D., Tan, X., Chen, S., & Wen, S. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00632 · Cited by 173
Making the Invisible Visible: Action Recognition Through Walls and Occlusions
Li, T., Fan, L., Zhao, M., Liu, Y., & Katabi, D. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00096 · Cited by 160
Weakly-Supervised Action Localization with Expectation-Maximization Multi-Instance Learning
Luo, Z., Guillory, D., Shi, B., Ke, W., Wan, F., Darrell, T., & Xu, H. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58526-6_43 · Cited by 159
Enriching Local and Global Contexts for Temporal Action Localization
Zhu, Z., Tang, W., Wang, L., Zheng, N., & Hua, G. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01326 · Cited by 167
On Scaling Up a Multilingual Vision and Language Model
Chen, X., Djolonga, J., Padlewski, P., Mustafa, B., Changpinyo, S., Wu, J., Riquelme, C., Goodman, S., Wang, X., Tay, Y., et al. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01368 · Cited by 379
A review of machine learning-based human activity recognition for diverse applications
Kulsoom, F., Narejo, S., Mehmood, Z., Chaudhry, H. N., Butt, A., & Bashir, A. K. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-07665-9 · Cited by 168
Deep learning for video classification and captioning
Wu, Z., Yao, T., Fu, Y., & Jiang, Y.-G. (2017) · doi:10.1145/3122865.3122867 · Cited by 174
Attend and Interact: Higher-Order Object Interactions for Video Understanding
Ma, C.-Y., Kadav, A., Melvin, I., Kira, Z., AlRegib, G., & Graf, H. P. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00710 · Cited by 134
stagNet: An Attentive Semantic RNN for Group Activity and Individual Action Recognition
Qi, M., Wang, Y., Qin, J., Li, A., Luo, J., & Gool, L. V. (2019) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2019.2894161 · Cited by 148
Rodríguez-Opazo, C., Marrese-Taylor, E., Saleh, F. S., Li, H., & Gould, S. J. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093328 · Cited by 186
Detection of Real-world Fights in Surveillance Videos
Pérez, M., Kot, A. C., & Rocha, A. D. R. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8683676 · Cited by 168
TSP: Temporally-Sensitive Pretraining of Video Encoders for Localization Tasks
Alwassel, H., Giancola, S., & Ghanem, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw54120.2021.00356 · Cited by 123
Self-citationHuang, D.-A., Ramanathan, V., Mahajan, D. K., Torresani, L., Paluri, M., Fei-Fei, L., & Niebles, J. C. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00769 · Cited by 179
Self-citationA Pursuit of Temporal Accuracy in General Activity Detection
Xiong, Y., Zhao, Y., Wang, L., Lin, D., & Tang, X. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.02716 · Cited by 108
Wu, W., Wang, X., Luo, H., Wang, J., Yang, Y., & Ouyang, W. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00640 · Cited by 185
Weakly Supervised Dense Event Captioning in VideosPreprint
Duan, X., Huang, W., Gan, C., Wang, J., Zhu, W., & Huang, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.03849 · Cited by 171
TITAN: Future Forecast Using Action Priors
Malla, S., Dariush, B., & Choi, C. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01120 · Cited by 159
Su, H., Gan, W., Wu, W., Qiao, Y., & Yan, J. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i3.16363 · Cited by 115
An End-to-End Visual-Audio Attention Network for Emotion Recognition in User-Generated Videos
Zhao, S., Ma, Y., Gu, Y., Yang, J., Xing, T., Xu, P., Hu, R., Chai, H., & Keutzer, K. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i01.5364 · Cited by 149
Rethinking Zero-Shot Video Classification: End-to-End Training for Realistic Applications
Brattoli, B., Tighe, J., Zhdanov, F., Perona, P., & Chalupka, K. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00467 · Cited by 174
FERV39k: A Large-Scale Multi-Scene Dataset for Facial Expression Recognition in Videos
Wang, Y., Sun, Y., Huang, Y., Liu, Z., Gao, S., Zhang, W., Ge, W., & Zhang, W. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.02025 · Cited by 203
Modality-Adaptive Mixup and Invariant Decomposition for RGB-Infrared Person Re-identification
Huang, Z., Liu, J., Li, L., Zheng, K., & Zha, Z.-J. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19987 · Cited by 39
Sequential Modeling Enables Scalable Learning for Large Vision Models
Bai, Y., Geng, X., Mangalam, K., Bar, A., Yuille, A., Darrell, T., Malik, J., & Efros, A. A. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02157 · Cited by 313
Multimodal Keyless Attention Fusion for Video Classification
Long, X., Gan, C., Melo, G., Liu, X., Li, Y., Li, F., & Wen, S. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12319 · Cited by 122
A Local-to-Global Approach to Multi-Modal Movie Scene Segmentation
Rao, A., Xu, L., Xiong, Y., Xu, G., Huang, Q., Zhou, B., & Lin, D. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01016 · Cited by 125
CUHK & ETHZ & SIAT Submission to ActivityNet Challenge 2016
Xiong, Y., Wang, L., Wang, Z., Zhang, B., Song, H., Li, W., Lin, D., Qiao, Y., Gool, L. V., & Tang, X. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1608.00797 · Cited by 110
Detailed 2D-3D Joint Representation for Human-Object Interaction
Li, Y., Liu, X., Han, L., Wang, S., Liu, J., Li, J., & Lu, C. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01018 · Cited by 181
TallFormer: Temporal Action Localization with a Long-Memory Transformer
Cheng, F., & Bertasius, G. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19830-4_29 · Cited by 198
Weakly Supervised Temporal Sentence Grounding with Gaussian-based Contrastive Proposal Learning
Zheng, M., Huang, Y., Chen, Q., Peng, Y., & Liu, Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01511 · Cited by 127
Weakly Supervised Temporal Action Localization Through Contrast Based Evaluation Networks
Liu, Z., Wang, L., Zhang, Q., Gao, Z., Niu, Z., Zheng, N., & Hua, G. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00400 · Cited by 129
MultiSports: A Multi-Person Video Dataset of Spatio-Temporally Localized Sports Actions
Li, Y., Chen, L., He, R., Wang, Z., Wu, G., & Wang, L. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01328 · Cited by 194
Asynchronous Interaction Aggregation for Action Detection
Tang, J., Xia, J., Mu, X., Pang, B., & Lu, C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58555-6_5 · Cited by 151
Ahuja, K., Jiang, Y., Goel, M., & Harrison, C. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445138 · Cited by 147
ASM-Loc: Action-aware Segment Modeling for Weakly-Supervised Temporal Action Localization
He, B., Yang, X., Kang, L., Cheng, Z., Zhou, X., & Shrivastava, A. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01355 · Cited by 151
Learning Video Moment Retrieval Without a Single Annotated Video
Gao, J., & Xu, C. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3075470 · Cited by 128
Jointly Cross- and Self-Modal Graph Attention Network for Query-Based Moment Localization
Liu, D., Qu, X., Liu, X.-Y., Dong, J., Zhou, P., & Xu, Z. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3414026 · Cited by 154
TACo: Token-aware Cascade Contrastive Learning for Video-Text Alignment
Yang, J., Bisk, Y., & Gao, J. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01136 · Cited by 115
From Lifestyle Vlogs to Everyday Interactions
Fouhey, D. F., Kuo, W.-C., Efros, A. A., & Malik, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00524 · Cited by 111
Adversarial Background-Aware Loss for Weakly-Supervised Temporal Activity Localization
Min, K., & Corso, J. J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58568-6_17 · Cited by 126
Semantics for Robotic Mapping, Perception and Interaction: A Survey
Garg, S., Sünderhauf, N., Dayoub, F., Morrison, D., Cosgun, A., Carneiro, G., Wu, Q., Chin, T.-J., Reid, I., Gould, S., et al. (2020) · Foundations and Trends® in Robotics · doi:10.1561/2300000059 · Cited by 105
MS-TCT: Multi-Scale Temporal ConvTransformer for Action Detection
Dai, R., Das, S., Kahatapitiya, K., Ryoo, M. S., & Brémond, F. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01941 · Cited by 151
What Actions are Needed for Understanding Human Actions in Videos?
Sigurdsson, G. A., Russakovsky, O., & Gupta, A. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.235 · Cited by 131
Luo, X., Li, H., Yang, X., Yu, Y., & Cao, D. (2019) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12419 · Cited by 111
Towards Universal Representation for Unseen Action Recognition
Zhu, Y., Long, Y., Guan, Y., Newsam, S. D., & Shao, L. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00983 · Cited by 131
Adaptive Focus for Efficient Video Recognition
Wang, Y., Chen, Z., Jiang, H., Song, S., Han, Y., & Huang, G. M. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01594 · Cited by 148
Revisiting Classifier: Transferring Vision-Language Models for Video Recognition
Wu, W., Sun, Z., & Ouyang, W. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i3.25386 · Cited by 174
MVImgNet: A Large-scale Dataset of Multi-view Images
Yu, X., Xu, M., Zhang, Y., Liu, H., Ye, C., Wu, Y., Yan, Z., Zhu, C., Xiong, Z., Liang, T., et al. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00883 · Cited by 324
Damen, D., Doughty, H., Farinella, G. M., Furnari, A., Kazakos, E., Ma, J., Moltisanti, D., Munro, J., Perrett, T., Price, W., et al. (2020) · arXiv (Cornell University) · doi:10.5523/bris.2g1n6qdydwa9u22shpxqzp0t8m · Cited by 97
Lin, R., Xiao, J., & Fan, J. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-11018-5_19 · Cited by 113
Learning to Model Relationships for Zero-Shot Video Classification
Gao, J., Zhang, T., & Xu, C. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2985708 · Cited by 127
Uncertainty Guided Collaborative Training for Weakly Supervised Temporal Action Detection
Yang, W., Zhang, T., Yu, X., Tian, Q. C., Zhang, Y., & FengWu, F. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00012 · Cited by 125
Improving Video-Text Retrieval by Multi-Stream Corpus Alignment and Dual Softmax LossPreprint
Cheng, X., Lin, H., Wu, X., Yang, F., & Shen, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.04290 · Cited by 214
ML-MG: Multi-label Learning with Missing Labels Using a Mixed Graph
Wu, B., Lyu, S., & Ghanem, B. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.473 · Cited by 111
Self-citationAutomatic Concept Discovery from Parallel Text and Visual Corpora
Sun, C., Gan, C., & Nevatia, R. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.298 · Cited by 111
You Lead, We Exceed: Labor-Free Video Concept Learning by Jointly Exploiting Web Videos and Images
Gan, C., Yao, T., Yang, K., Yang, Y., & Mei, T. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.106 · Cited by 105
A survey on human-aware robot navigation
Möller, R., Furnari, A., Battiato, S., Härmä, A., & Farinella, G. M. (2021) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2021.103837 · Cited by 140
Principles and Guidelines for Evaluating Social Robot Navigation Algorithms
Francis, A., Pérez-D’Arpino, C., Li, C., Xia, F., Alahi, A., Alami, R., Bera, A., Biswas, A., Biswas, J., Chandra, R., et al. (2025) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3700599 · Cited by 107
“…behavioral styles or social activities specified by higher-level modules or using techniques such as behavior trees [128]. l) Simulation Interoperability: Some simulators are stan-dalone; others support the OpenAI Gym API [156] or have interfaces to integrate with environments such as ROS [116].”
Neural Graph Matching Networks for Fewshot 3D Action Recognition
Guo, M., Chou, E., Huang, D.-A., Song, S., Yeung, S. Y., & Fei-Fei, L. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01246-5_40 · Cited by 118
Video Corpus Moment Retrieval with Contrastive Learning
Zhang, H., Sun, A., Jing, W., Nan, G., Zhen, L., Zhou, J. T., & Goh, R. S. M. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462874 · Cited by 142
Cross-modal Consensus Network for Weakly Supervised Temporal Action Localization
Hong, F.-T., Feng, J.-C., Xu, D., Shan, Y., & Zheng, W. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475298 · Cited by 130
Weakly Supervised Video Moment Localization with Contrastive Negative Sample Mining
Zheng, M., Huang, Y., Chen, Q., & Liu, Y. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i3.20263 · Cited by 107
Large Scale Holistic Video Understanding
Diba, A., Fayyaz, M., Sharma, V., Paluri, M., Gall, J., Stiefelhagen, R., & Gool, L. V. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58558-7_35 · Cited by 157
SeCo: Exploring Sequence Supervision for Unsupervised Representation Learning
Yao, T., Zhang, Y., Qiu, Z., Pan, Y., & Mei, T. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17274 · Cited by 104
Ragusa, F., Furnari, A., Livatino, S., & Farinella, G. M. (2021) · 2021 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv48630.2021.00161 · Cited by 105
TN-ZSTAD: Transferable Network for Zero-Shot Temporal Activity Detection
Zhang, L., Chang, X., Liu, J., Luo, M., Li, Z., Yao, L., & Hauptmann, A. G. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3183586 · Cited by 131
A Comprehensive Survey on Deep Learning Methods in Human Activity Recognition
Kaseris, M., Kostavelis, I., & Malassiotis, S. (2024) · Machine Learning and Knowledge Extraction · doi:10.3390/make6020040 · Cited by 128
A Context-Aware Loss Function for Action Spotting in Soccer Videos
Cioppa, A., Deliège, A., Giancola, S., Ghanem, B., Droogenbroeck, M. V., Gade, R., & Moeslund, T. B. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01314 · Cited by 147
Self-citationCross-media Structured Common Space for Multimedia Event Extraction
Li, M., Zareian, A., Zeng, Q., Whitehead, S., Lu, D., Ji, H., & Chang, S.-F. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.230 · Cited by 91
Prudviraj, J., Reddy, M. I., Vishnu, C., & Mohan, C. K. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3195643 · Cited by 108
Step-by-step Erasion, One-by-one Collection: A Weakly Supervised Temporal Action Detector
Zhong, J.-X., Li, N., Kong, W., Zhang, T., Li, T. H., & Li, G. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240511 · Cited by 114
Grounded Situation Recognition
Pratt, S. M., Yatskar, M., Weihs, L., Farhadi, A., & Kembhavi, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58548-8_19 · Cited by 148
Transfer Learning Enhanced Vision-based Human Activity Recognition: A Decade-long Analysis
Ray, A., Kolekar, M. H., Balasubramanian, R., & Hafiane, A. (2022) · International Journal of Information Management Data Insights · doi:10.1016/j.jjimei.2022.100142 · Cited by 136
Progressive Instance-Aware Feature Learning for Compositional Action Recognition
Yan, R., Xie, L., Shu, X., Zhang, L., & Tang, J. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3261659 · Cited by 131
Fan, Q., Chen, C.-F., Kuehne, H., Pistoia, M., & Cox, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.00869 · Cited by 85
ARBEE: Towards Automated Recognition of Bodily Expression of Emotion in the Wild
Luo, Y., Ye, J., Adams, R. B., Li, J., Newman, M. G., & Wang, J. Z. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-019-01215-y · Cited by 129
Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teachers
Chen, T.-S., Siarohin, A., Menapace, W., Deyneka, E., Chao, H.-W., Jeon, B. E., Fang, Y., Lee, H.-Y., Ren, J. F., Yang, M.-H., et al. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01265 · Cited by 517
Cai, Z., Stefanov, K., Dhall, A., & Hayat, M. (2022) · 2022 International Conference on Digital Image Computing: Techniques and Applications (DICTA) · doi:10.1109/dicta56598.2022.10034605 · Cited by 99
ROAD: The Road Event Awareness Dataset for Autonomous Driving
Singh, G., Akrigg, S., Maio, M. D., Fontana, V., Alitappeh, R. J., Khan, S., Saha, S., Jeddisaravi, K., Yousefi, F., Culley, J., et al. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3150906 · Cited by 143
Structured Multi-Level Interaction Network for Video Moment Localization via Language Query
Wang, H., Zha, Z.-J., Li, L., Liu, D., & Luo, J. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00695 · Cited by 119
Action Unit Memory Network for Weakly Supervised Temporal Action Localization
Luo, W., Zhang, T., Yang, W., Liu, J., Mei, T., Wu, F., & Zhang, Y. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00984 · Cited by 119
Human Action Recognition from Various Data Modalities: A ReviewPreprint
Rahmani, H., Bennamoun, M., & Ke, Q. (2021) · doi:10.36227/techrxiv.13708270 · Cited by 105
Diagnosing Error in Temporal Action Detectors
Alwassel, H., Heilbron, F. C., Escorcia, V. A., & Ghanem, B. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01219-9_16 · Cited by 114
Self-citationLearning Modality Interaction for Temporal Sentence Localization and Event Captioning in Videos
Chen, S., Jiang, W., Liu, W., & Jiang, Y. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58548-8_20 · Cited by 126
Neighbourhood Representative Sampling for Efficient End-to-End Video Quality Assessment
Wu, H., Chen, C., Liao, L., Hou, J., Sun, W., Yan, Q., Gu, J., & Lin, W. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3319332 · Cited by 145
Valley: Video Assistant with Large Language Model Enhanced Ability
Luo, R., Zhao, Z., Min, Y., Yang, Z., Qiu, M., Wei, Z., Wang, Y., & Chen, C. (2026) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3796716 · Cited by 280
Ghosh, I., Ramamurthy, S. R., Chakma, A., & Roy, N. (2023) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1496 · Cited by 132
SCC: Semantic Context Cascade for Efficient Action Detection
Heilbron, F. C., Barrios, W., Escorcia, V. A., & Ghanem, B. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.338 · Cited by 112
Self-citationZeng, R., Gan, C., Chen, P., Huang, W., Wu, Q., & Tan, M. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2922108 · Cited by 97
RGB-D Data-Based Action Recognition: A Review
Shaikh, M. B., & Chai, D. (2021) · Sensors · doi:10.3390/s21124246 · Cited by 109
A Review of Deep Learning-based Human Activity Recognition on Benchmark Video Datasets
Sharma, V., Gupta, M., Pandey, A. K., Mishra, D., & Kumar, A. (2022) · Applied Artificial Intelligence · doi:10.1080/08839514.2022.2093705 · Cited by 113
HuMMan: Multi-modal 4D Human Dataset for Versatile Sensing and Modeling
Cai, Z., Ren, D., Zeng, A., Lin, Z., Yu, T., Wang, W., Fan, X., Gao, Y., Yu, Y., Pan, L., et al. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20071-7_33 · Cited by 176
CNNs, RNNs and Transformers in human action recognition: a survey and a hybrid model
Alomar, K., Aysel, H. I., & Cai, X. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11388-3 · Cited by 133
Fine-grained Temporal Contrastive Learning for Weakly-supervised Temporal Action Localization
Gao, J., Chen, M., & Xu, C. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01937 · Cited by 122
Adversarial Inference for Multi-Sentence Video Description
Park, J. S., Rohrbach, M., Darrell, T., & Rohrbach, A. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00676 · Cited by 90
A Benchmark Dataset and Comparison Study for Multi-modal Human Action Analytics
Liu, J., Song, S., Liu, C., Li, Y., & Hu, Y. (2020) · ACM Transactions on Multimedia Computing, Communications, and Applications · doi:10.1145/3365212 · Cited by 95
Learning to Discriminate Information for Online Action Detection
Eun, H., Moon, J., Park, J., Jung, C., & Kim, C. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00089 · Cited by 112
Joint Learning of Social Groups, Individuals Action and Sub-group Activities in Videos
Ehsanpour, M., Abedin, A., Saleh, F. S., Shi, Q., Reid, I. D., & Rezatofighi, H. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58545-7_11 · Cited by 118
Metadata
- Authors
- Heilbron, F. C., Escorcia, V., Ghanem, B., & Niebles, J. C.
- Affiliations
- Universidad del Norte (CO)
- King Abdullah University of Science and Technology (SA)
- Venue
- 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2015-06
- Pages
- 961-970
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W1927052826
- Cited by
- 2,578
- References
- 43
- Citations by year
- 2026: 161 · 2025: 273 · 2024: 349 · 2023: 333 · 2022: 305 · 2021: 374 · 2020: 258 · 2019: 215 · 2018: 162 · 2017: 99 · 2016: 42 · 2015: 7
- FWCI
- 42.38
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- King Abdullah University of Science and Technology Repository (King Abdullah University of Science and Technology) (submittedVersion)
- Funders
- Microsoft Research
- King Abdullah University of Science and Technology
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Computer Science › Human-Computer Interaction › Hand Gesture Recognition Systems
- Keywords
- ActivityNet, human activity understanding, human action recognition, video benchmark, activity detection, activity classification, activities of daily living, large-scale video datasets
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.