Long-Term Recurrent Convolutional Networks for Visual Recognition and Description
The DOI matches its Crossref record; 76 of the 78 references it cites were found in a registry or an index.
Abstract
Models based on deep convolutional networks have dominated recent image interpretation tasks; we investigate whether models which are also recurrent are effective for tasks involving sequences, visual and otherwise. We describe a class of recurrent convolutional architectures which is end-to-end trainable and suitable for large-scale visual understanding tasks, and demonstrate the value of these models for activity recognition, image captioning, and video description. In contrast to previous models which assume a fixed visual representation or perform simple temporal averaging for sequential processing, recurrent convolutional models are "doubly deep" in that they learn compositional representations in space and time. Learning long-term dependencies is possible when nonlinearities are incorporated into the network state updates. Differentiable recurrent models are appealing in that they can directly map variable-length inputs (e.g., videos) to variable-length outputs (e.g., natural language text) and can model complex temporal dynamics; yet they can be optimized with backpropagation. Our recurrent sequence models are directly connected to modern visual convolutional network models and can be jointly trained to learn temporal dynamics and convolutional perceptual representations. Our results show that such models have distinct advantages over state-of-the-art models for recognition or generation which are separately defined or optimized.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Cited by
Items 501–600 of 1,001
Zhang, X., Li, R., Dai, H., Liu, Y., Zhou, B., & Wang, Z. (2019) · IEEE Access · doi:10.1109/access.2019.2946932 · Cited by 42
BiST: Bi-directional Spatio-Temporal Reasoning for Video-Grounded Dialogues
Le, H., Sahoo, D., Chen, N. F., & Hoi, S. C. H. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.145 · Cited by 42
Chi, J., Bae, J., & Kwon, Y.-J. (2021) · Remote Sensing · doi:10.3390/rs13173413 · Cited by 42
UAV surveillance for violence detection and individual identification
Srivastava, A., Badal, T., Saxena, P., Vidyarthi, A., & Singh, R. (2022) · Automated Software Engineering · doi:10.1007/s10515-022-00323-3 · Cited by 42
Learning to Recognize Actions From Limited Training Examples Using a Recurrent Spiking Neural Model
Panda, P., & Srinivasa, N. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00126 · Cited by 42
Motorcycle detection and classification in urban Scenarios using a model based on Faster R-CNN
Espinosa, J. E., Velastín, S. A., & Branch, J. W. (2018) · International Conference on Pattern Recognition Systems (ICPRS) · doi:10.1049/cp.2018.1292 · Cited by 42
Convolutional LSTM Neural Networks for Modeling Wildland Fire DynamicsPreprint
Burge, J., Bonanni, M., Ihme, M., & Hu, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.06679 · Cited by 42
Unified CNN-LSTM for keyhole status prediction in PAW based on spatial-temporal features
Zhou, F., Liu, X., Jia, C., Li, S., Tian, J., Zhou, W., & Wu, C. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121425 · Cited by 41
Higher-Order Pooling of CNN Features via Kernel Linearization for Action Recognition
Cherian, A., Koniusz, P., & Gould, S. J. (2017) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2017.22 · Cited by 41
Driving Behavior Prediction Considering Cognitive Prior and Driving Context
Zhou, D. H., Liu, H., Ma, H., Wang, X., Zhang, X., & Dong, Y. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.2973751 · Cited by 42
Learning Connectivity with Graph Convolutional Networks
Sahbi, H. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412009 · Cited by 41
Hybrid kinematic–visual sensing approach for activity recognition of construction equipment
Kim, J., Chi, S., & Ahn, C. R. (2021) · Journal of Building Engineering · doi:10.1016/j.jobe.2021.102709 · Cited by 41
Vision-Based Activity Classification of Excavators by Bidirectional LSTM
Kim, I.-S., Latif, K., Kim, J., Sharafat, A., Lee, D., & Seo, J. (2022) · Applied Sciences · doi:10.3390/app13010272 · Cited by 41
Deep recurrent neural network reveals a hierarchy of process memory during dynamic natural vision
Shi, J., Wen, H., Zhang, Y., Han, K., & Liu, Z. (2018) · Human Brain Mapping · doi:10.1002/hbm.24006 · Cited by 41
Yurtsever, E., Liu, Y., Lambert, J., Miyajima, C., Takeuchi, E., Takeda, K., & Hansen, J. H. L. (2019) · 2019 IEEE Intelligent Transportation Systems Conference (ITSC) · doi:10.1109/itsc.2019.8917362 · Cited by 40
LSTM-based multi-label video event detection
Liu, A.-A., Shao, Z., Wong, Y., Li, J., Su, Y., & Kankanhalli, M. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-017-5532-x · Cited by 40
Human-robot Interaction Method Combining Human Pose Estimation and Motion Intention Recognition
Cheng, Y., Yi, P., Rui, L., Dong, J., Zhou, D., & Zhang, Q. (2021) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd49262.2021.9437772 · Cited by 40
GRADE: Deep learning and garlic routing-based secure data sharing framework for IIoT beyond 5G
Jadav, N. K., Kakkar, R., Mankodiya, H., Gupta, R., Tanwar, S., Agrawal, S. S., & Sharma, R. (2022) · Digital Communications and Networks · doi:10.1016/j.dcan.2022.11.004 · Cited by 40
Semi-Supervised Action Recognition From Temporal Augmentation Using Curriculum Learning
Tong, A., Tang, C., & Wang, W. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3210271 · Cited by 40
Anderson, S., & Radić, V. (2022) · Frontiers in Water · doi:10.3389/frwa.2022.934709 · Cited by 39
Video action recognition collaborative learning with dynamics via PSO-ConvNet Transformer
Phong, N. H., & Ribeiro, B. (2023) · Scientific Reports · doi:10.1038/s41598-023-39744-9 · Cited by 39
SHEF-Multimodal: Grounding Machine Translation on Images
Shah, K., Wang, J., & Specia, L. (2016) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w16-2363 · Cited by 39
A Hybrid Network for Large-Scale Action Recognition from RGB and Depth Modalities
Wang, H., Song, Z., Li, W., & Wang, P. (2020) · Sensors · doi:10.3390/s20113305 · Cited by 39
Identifying mental health status using deep neural network trained by visual metrics
Shafiei, S. B., Lone, Z. M., Elsayed, A. S., Hussein, A. A., & Guru, K. A. (2020) · Translational Psychiatry · doi:10.1038/s41398-020-01117-5 · Cited by 39
Lin, C., Jin, Z., MULLA, D. J., Ghosh, R., Guan, K., Kumar, V., & Cai, Y. (2021) · Remote Sensing · doi:10.3390/rs13091740 · Cited by 39
A prediction model of student performance based on self-attention mechanism
Chen, Y., Wei, G., Liu, J., Chen, Y., Zheng, Q., Tian, F., Zhu, H., Wang, Q., & Wu, Y. (2022) · Knowledge and Information Systems · doi:10.1007/s10115-022-01774-6 · Cited by 39
Cross-Domain Image Captioning with Discriminative Finetuning
Dessì, R., Bevilacqua, M., Gualdoni, E., Rakotonirina, N. C., Franzon, F., & Baroni, M. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00670 · Cited by 40
Artificial Intelligence for Aortic Pressure Waveform Analysis During Coronary Angiography
Howard, J. P., Cook, C., van de Hoef, T. P., Meuwissen, M., de Waard, G. A., van Lavieren, M. A., Pinto, M. E., Danad, I., Piek, J. J., Götberg, M., et al. (2019) · JACC: Cardiovascular Interventions · doi:10.1016/j.jcin.2019.06.036 · Cited by 39
Initialization Strategies of Spatio-Temporal Convolutional Neural NetworksPreprint
Mansimov, E., Srivastava, N., & Salakhutdinov, R. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1503.07274 · Cited by 39
Chae, H. J., Kim, J.-B., Park, G., O'Sullivan, D. M., Seo, J., & Park, J.-J. (2023) · Interactive Journal of Medical Research · doi:10.2196/37604 · Cited by 38
Jongjaraunsuk, R., Taparhudee, W., & Suwannasing, P. (2024) · Water · doi:10.3390/w16060907 · Cited by 38
Unveiling the frontiers of deep learning: Innovations shaping diverse domains
Ahmed, S. F., Alam, M. S. B., Kabir, M., Afrin, S., Rafa, S. J., Mehjabin, A., & Gandomi, A. H. (2025) · Applied Intelligence · doi:10.1007/s10489-025-06259-x · Cited by 39
Using Unsupervised Deep Learning for Automatic Summarization of Arabic Documents
Alami, N., En-Nahnahi, N., Alaoui, S. O. E., & Meknassi, M. (2018) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-018-3198-y · Cited by 38
Action Recognition by an Attention-Aware Temporal Weighted Convolutional Neural Network
Wang, L., Zang, J., Zhang, Q., Niu, Z., Hua, G., & Zheng, N. (2018) · Sensors · doi:10.3390/s18071979 · Cited by 38
High and Low Prices Prediction of Soybean Futures with LSTM Neural Network
Wang, C., & Gao, Q. (2018) · IEEE International Conference on Software Engineering and Service Science (ICSESS) · doi:10.1109/icsess.2018.8663896 · Cited by 38
Sim2vec: Node similarity preserving network embedding
Xie, Y., Gong, M., Wang, S., Liu, W., & Yu, B. (2019) · Information Sciences · doi:10.1016/j.ins.2019.05.001 · Cited by 38
Hide-and-Tell: Learning to Bridge Photo Streams for Visual Storytelling
Jung, Y., Kim, D., Woo, S., Kim, K., Kim, S.-J., & Kweon, I. S. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6780 · Cited by 38
Long Short-Term Memory With Gate and State Level Fusion for Light Field-Based Face Recognition
Sepas‐Moghaddam, A., Etemad, A., Pereira, F. M. B., & Correia, P. L. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2020.3036242 · Cited by 38
Autonomous Driving: Framework for Pedestrian Intention Estimation in a Real World Scenario
Alvarez, W. M., Moreno, F. M., Sipele, Ó., Smirnov, N., & Olaverri-Monreal, C. (2020) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv47402.2020.9304624 · Cited by 38
Attend to Where and When: Cascaded Attention Network for Facial Expression Recognition
Qu, X., Zou, Z., Su, X., Zhou, P., Wei, W., Wen, S., & Wu, D. O. (2021) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2021.3070713 · Cited by 38
Context-driven Multi-stream LSTM (M-LSTM) for Recognizing Fine-Grained Activity of Drivers
Behera, A., Keidel, A., & Debnath, B. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-12939-2_21 · Cited by 38
Approximate FPGA-Based LSTMs Under Computation Time Constraints
Rizakis, M., Venieris, S. I., Kouris, A., & Bouganis, C.-S. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-78890-6_1 · Cited by 37
3G structure for image caption generation
Yuan, A., Li, X., & Lu, X. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.10.059 · Cited by 37
Wang, X., Wang, H., Liu, D., & Wang, W. (2020) · Water · doi:10.3390/w12092521 · Cited by 37
Xie, H., Zhang, M., Ge, J., Dong, X., & Chen, H. (2021) · Complexity · doi:10.1155/2021/6457246 · Cited by 37
iDHS-Deep: an integrated tool for predicting DNase I hypersensitive sites by deep neural network
Dao, F., Lv, H., Su, W., Sun, Z., Huang, Q.-L., & Lin, H. (2021) · Briefings in Bioinformatics · doi:10.1093/bib/bbab047 · Cited by 37
RETRACTED ARTICLE: Human action recognition using a hybrid deep learning heuristic
Dash, S. C. B., Mishra, S. R., Raju, K. S., & Prasad, L. V. N. (2021) · Soft Computing · doi:10.1007/s00500-021-06149-7 · Cited by 37
RetractedGullapalli, B. T., Carreiro, S., Chapman, B. P., Ganesan, D., Sjoquist, J., & Rahman, T. (2021) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3478107 · Cited by 37
Goay, C. H., Ahmad, N. S., & Goh, P. (2021) · IEEE Access · doi:10.1109/access.2021.3112134 · Cited by 37
ET-YOLOv5s: Toward Deep Identification of Students’ in-Class Behaviors
Li, L., Liu, M., Sun, L., Li, Y., & Li, N. (2022) · IEEE Access · doi:10.1109/access.2022.3169586 · Cited by 37
DDLSTM: Dual-Domain LSTM for Cross-Dataset Action Recognition
Perrett, T., & Damen, D. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00804 · Cited by 36
Research on the Air Traffic Flow Prediction Using a Deep Learning Approach
Liu, H., Lin, Y., Chen, Z., Guo, D., Zhang, J., & Jing, H. (2019) · IEEE Access · doi:10.1109/access.2019.2945821 · Cited by 36
Multimodal Interaction-Aware Trajectory Prediction in Crowded Space
Shi, X., Shao, X., Fan, Z., Jiang, R., Zhang, H., Guo, Z., Wu, G., Yuan, W., & Shibasaki, R. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6874 · Cited by 36
Associative memory optimized method on deep neural networks for image classification
Yang, G., & Ding, F. (2020) · Information Sciences · doi:10.1016/j.ins.2020.05.038 · Cited by 36
Two-stage prediction of machinery fault trend based on deep learning for time series analysis
Xu, H., Ma, R., Li, Y., & Ma, Z. (2021) · Digital Signal Processing · doi:10.1016/j.dsp.2021.103150 · Cited by 36
Progress of Human Action Recognition Research in the Last Ten Years: A Comprehensive Survey
Singh, P. K., Kundu, S., Adhikary, T., Sarkar, R., & Bhattacharjee, D. (2021) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-021-09681-9 · Cited by 36
Yu, S., Chai, H., Xiong, Y., Kang, M., Geng, C., Liu, Y., Chen, Y., Zhang, Y., Zhang, Q., Li, C., et al. (2022) · Advanced Materials · doi:10.1002/adma.202200908 · Cited by 36
Deep Dual Relation Modeling for Egocentric Interaction Recognition
Li, H., Cai, Y., & Zheng, W. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00812 · Cited by 36
A novel YOLO LSTM approach for enhanced human action recognition in video sequences
Elnady, M., & Munim, H. E. A. E. (2025) · Scientific Reports · doi:10.1038/s41598-025-01898-z · Cited by 35
Mårtensson, G., Ferreira, D., Cavallin, L., Muehlboeck, J.-S., Wahlund, L., Wang, C., & Westman, E. (2019) · NeuroImage Clinical · doi:10.1016/j.nicl.2019.101872 · Cited by 35
Pandey, P., Prathosh, A. P., Kohli, M., & Pritchard, J. (2020) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v34i01.5383 · Cited by 35
Prediction of Short-Time Cloud Motion Using a Deep-Learning Model
Su, X., Li, T., An, C., & Wang, G. (2020) · Atmosphere · doi:10.3390/atmos11111151 · Cited by 35
Udriștoiu, Ș., Stefanescu, D., Gruionu, G., Gruionu, L. G., Iacob, A. V., Karstensen, J. G., Vilman, P., & Săftoiu, A. (2021) · Journal of Gastrointestinal and Liver Diseases · doi:10.15403/jgld-3212 · Cited by 35
Wu, X., Tan, G., Luo, H., Chen, Z., Pu, B., Li, S., & Li, K. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.103039 · Cited by 35
Automatic Radiology Report Generator Using Transformer With Contrast-Based Image Enhancement
Tsaniya, H., Fatichah, C., & Suciati, N. (2024) · IEEE Access · doi:10.1109/access.2024.3364373 · Cited by 34
Second-order Temporal Pooling for Action Recognition
Cherian, A., & Gould, S. J. (2018) · International Journal of Computer Vision · doi:10.1007/s11263-018-1111-5 · Cited by 34
Combo-Attention Network for Baidu Video Advertising
Yu, T., Yang, Y., Li, Y., Chen, X., Sun, M., & Li, P. (2020) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3394486.3403297 · Cited by 34
A Heterogeneous Spiking Neural Network for Unsupervised Learning of Spatiotemporal Patterns
She, X., Dash, S., Kim, D., & Mukhopadhyay, S. (2021) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.615756 · Cited by 34
Wang, N. (2021) · Alexandria Engineering Journal · doi:10.1016/j.aej.2021.04.080 · Cited by 34
Deep Learning for Multimedia Forensics
Amerini, I., Anagnostopoulos, A., Maiano, L., & Celsi, L. R. (2021) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000096 · Cited by 34
Wang, G., Liu, H., Chen, M., Yang, Y., Liu, Z., & Wang, H. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3106101 · Cited by 34
Balouji, E., Salor, Ö., & McKelvey, T. (2022) · IEEE Transactions on Industry Applications · doi:10.1109/tia.2022.3160135 · Cited by 34
Deepdiary: Lifelogging image captioning and summarization
Fan, C., Zhang, Z., & Crandall, D. (2018) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2018.05.008 · Cited by 34
Writing by Memorizing: Hierarchical Retrieval-based Medical Report Generation
Yang, X., Ye, M., You, Q., & Ma, F. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.387 · Cited by 33
An Improved Attention and Hybrid Optimization Technique for Visual Question Answering
Sharma, H., & Jalal, A. S. (2021) · Neural Processing Letters · doi:10.1007/s11063-021-10655-y · Cited by 33
HARNet in deep learning approach—a systematic survey
Kumar, N. S., Deepika, G., Goutham, V., Buvaneswari, B., Reddy, R. V. K., Angadi, S., Dhanamjayulu, C., Chinthaginjala, R., Mohammad, F., & Khan, B. (2024) · Scientific Reports · doi:10.1038/s41598-024-58074-y · Cited by 33
Look Deeper See Richer: Depth-aware Image Paragraph Captioning
Wang, Z., Luo, Y., Li, Y., Huang, Z. H., & Yin, H. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240583 · Cited by 33
Ding, Z., & An, X. (2018) · Advances in Materials Science and Engineering · doi:10.1155/2018/6387930 · Cited by 33
Deep Multi-Kernel Convolutional LSTM Networks and an Attention-Based Mechanism for Videos
Agethen, S., & Hsu, W. H. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2932564 · Cited by 33
Cross-Lingual Image Caption Generation Based on Visual Attention Model
Wang, B., Wang, C., Zhang, Q., Su, Y. M., Wang, Y., & Xu, Y. (2020) · IEEE Access · doi:10.1109/access.2020.2999568 · Cited by 33
Deep fusion of gray level co-occurrence matrices for lung nodule classification
Saihood, A., Karshenas, H., & Nilchi, A. R. N. (2022) · PLoS ONE · doi:10.1371/journal.pone.0274516 · Cited by 33
DroneAttention: Sparse weighted temporal attention for drone-camera based activity recognition
Yadav, S. K., Luthra, A., Pahwa, E., Tiwari, K., Rathore, H., Pandey, H. M., & Corcoran, P. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.12.005 · Cited by 33
Temporal Context Matters: Enhancing Single Image Prediction with Disease Progression Representations
Konwer, A., Xu, X., Bae, J., Chen, C., & Prasanna, P. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01826 · Cited by 33
A deep local-temporal architecture with attention for lightweight human activity recognition
Ige, A. O., & Noor, M. H. M. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.110954 · Cited by 33
Moitra, D., & Mandal, R. K. (2020) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-020-00337-x · Cited by 33
Ren, Z., Zhang, Q., Cheng, J. S., Hao, F., & Gao, X. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.12.020 · Cited by 33
Word Embeddings for Natural Language Processing
Lebret, R. (2016) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · doi:10.5075/epfl-thesis-7148 · Cited by 33
A Transfer Learning-Based Multimodal Feature Fusion Model for Bearing Fault Diagnosis
Han, H., Meng, Y., Wu, X., Li, X., & Qiao, J. (2025) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2025.3558745 · Cited by 32
Li, Y., Charalampaki, P., Liu, Y., Yang, G., & Giannarou, S. (2018) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-018-1806-7 · Cited by 32
Shortcut Gestures for Mobile Text Editing on Fully Touch Sensitive Smartphones
Le, H. V., Mayer, S., Weiß, M., Vogelsang, J., Weingärtner, H., & Henze, N. (2020) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3396233 · Cited by 32
Action Recognition From Thermal Videos Using Joint and Skeleton Information
Batchuluun, G., Kang, J. K., Nguyen, D. T., Pham, T. D., Arsalan, M., & Park, K. R. (2021) · IEEE Access · doi:10.1109/access.2021.3051375 · Cited by 32
An interpretable deep neural network for colorectal polyp diagnosis under colonoscopy
Wang, S., Yin, Y., Wang, D., Lv, Z., Wang, Y., & Jin, Y. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107568 · Cited by 32
Aswiga, R. V., & Shanthi, A. P. (2022) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-021-00567-7 · Cited by 32
Hwang, C., Deng, Y., & Pu, S. (2022) · IEEE Access · doi:10.1109/access.2022.3228825 · Cited by 32
Deep learning based human action recognition: A survey
Zhang, Z., Ma, X., Song, R., Rong, X., Tian, X., Tian, G., & Li, Y. (2017) · Chinese Automation Congress · doi:10.1109/cac.2017.8243438 · Cited by 32
Long-Short-Term Features for Dynamic Scene Classification
Huang, Y., Cao, X., Wang, Q., Zhang, B., Zhen, X., & Li, X. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2823360 · Cited by 32
Deep Progressive Hashing for Image Retrieval
Bai, J., Ni, B., Wang, M., Li, Z., Cheng, S., Yang, X., Hu, C., & Gao, W. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2920601 · Cited by 32
Spatio-Temporal Partitioning And Description Of Full-Length Routine Fetal Anomaly Ultrasound Scans
Sharma, H., Droste, R., Chatelain, P., Drukker, L., Papageorghiou, A. T., & Noble, J. A. (2019) · 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019) · doi:10.1109/isbi.2019.8759149 · Cited by 26
BERT-hLSTMs: BERT and hierarchical LSTMs for visual storytelling
Su, J., Dai, Q., Guérin, F., & Zhou, M. (2020) · Computer Speech & Language · doi:10.1016/j.csl.2020.101169 · Cited by 32
Lu, S., Song, Z. G., Chen, W., Qian, T., Zhang, Y., Chen, M., & Guo, L. (2021) · Agriculture · doi:10.3390/agriculture11101003 · Cited by 33
Metadata
- Authors
- Donahue, J., Hendricks, L. A., Rohrbach, M., Venugopalan, S., Guadarrama, S., Saenko, K., & Darrell, T.
- Affiliations
- University of California, Berkeley (US)
- International Computer Science Institute (US)
- The University of Texas at Austin (US)
- University of Massachusetts Lowell (US)
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2017-04-01
- Volume
- 39
- Issue
- 4
- Pages
- 677-691
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2508429489
- Cited by
- 1,547
- References
- 78
- Citations by year
- 2026: 46 · 2025: 79 · 2024: 111 · 2023: 164 · 2022: 202 · 2021: 250 · 2020: 227 · 2019: 225 · 2018: 149 · 2017: 70
- FWCI
- 102.49
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
- PubMed (publishedVersion)
- Funders
- DARPA's
- MSEE
- SMISC
- NSF (IIS-1427425, IIS-1212798)
- Berkeley Vision and Learning Center
- NVIDIA
- FITweltweit-Program
- German Academic Exchange Service (DAAD)
- NDSEG
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Keywords
- long-term recurrent convolutional network, activity recognition, image captioning, audio description, long-range dependencies, temporal dynamics, compositional representations, end-to-end learning, visual description generation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.