Long-Term Recurrent Convolutional Networks for Visual Recognition and Description
The DOI matches its Crossref record; 76 of the 78 references it cites were found in a registry or an index.
Abstract
Models based on deep convolutional networks have dominated recent image interpretation tasks; we investigate whether models which are also recurrent are effective for tasks involving sequences, visual and otherwise. We describe a class of recurrent convolutional architectures which is end-to-end trainable and suitable for large-scale visual understanding tasks, and demonstrate the value of these models for activity recognition, image captioning, and video description. In contrast to previous models which assume a fixed visual representation or perform simple temporal averaging for sequential processing, recurrent convolutional models are "doubly deep" in that they learn compositional representations in space and time. Learning long-term dependencies is possible when nonlinearities are incorporated into the network state updates. Differentiable recurrent models are appealing in that they can directly map variable-length inputs (e.g., videos) to variable-length outputs (e.g., natural language text) and can model complex temporal dynamics; yet they can be optimized with backpropagation. Our recurrent sequence models are directly connected to modern visual convolutional network models and can be jointly trained to learn temporal dynamics and convolutional perceptual representations. Our results show that such models have distinct advantages over state-of-the-art models for recognition or generation which are separately defined or optimized.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Cited by
Items 801–900 of 1,001
Identifying and Resisting Adversarial Videos Using Temporal ConsistencyPreprint
Jia, X., Wei, X., & Cao, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.04837 · Cited by 19
Integrating multimodal data and machine learning for entrepreneurship research
Shrestha, Y. R., & He, V. F. (2025) · Strategic Entrepreneurship Journal · doi:10.1002/sej.1546 · Cited by 18
A Deep Intelligent Attack Detection Framework for Fog-Based IoT Systems
Gudla, S. P. K., Bhoi, S. K., Nayak, S. R., Singh, K. K., Verma, A., & Izonin, I. (2022) · Computational Intelligence and Neuroscience · doi:10.1155/2022/6967938 · Cited by 18
He, Q., Yu, H., & Fang, Y. (2023) · Gyroscopy and Navigation · doi:10.1134/s2075108723030070 · Cited by 18
YOWOv3: A Lightweight Spatio-Temporal Joint Network for Video Action Detection
Zhu, A., Wang, Y., Yang, J., Yan, T., Ma, H., & Li, W. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3387933 · Cited by 18
KSL-POSE: A Real-Time 2D Human Pose Estimation Method Based on Modified YOLOv8-Pose Framework
Lu, T., Cheng, K., Hua, X., & Qin, S. (2024) · Sensors · doi:10.3390/s24196249 · Cited by 21
谷口, 嘉., Peng, J., Lv, W., Wu, C., Chen, Z.-H., Zhou, G., Wang, Y., Lin, L. C., Lu, L., & Sun, Y. H. (2025) · Radiology Artificial Intelligence · doi:10.1148/ryai.230544 · Cited by 18
Energy-efficient hybrid CMOS-NEMS LIF neuron circuit in 28 nm CMOS process
Moradi, S., Bhave, S. A., & Manohar, R. (2017) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci.2017.8285437 · Cited by 18
Image Captioning using Facial Expression and Attention
Nezami, O. M., Dras, M., Wan, S., & Paris, C. L. (2020) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12025 · Cited by 18
An End to End Framework With Adaptive Spatio-Temporal Attention Module for Human Action Recognition
Liu, S., Ma, X., Wu, H., & Li, Y. (2020) · IEEE Access · doi:10.1109/access.2020.2979549 · Cited by 18
Micro-Doppler-Based Space Target Recognition with a One-Dimensional Parallel Network
Han, L., & Feng, C. (2020) · International Journal of Antennas and Propagation · doi:10.1155/2020/8013802 · Cited by 18
Recognition and Segmentation of Surgical Gestures
Krishnan, P. (2019) · elib (German Aerospace Center) · doi:10.1007/s11548-020-02171-6
A Review of Machine Learning Network in Human Motion Biomechanics
Low, W. S., Chan, C. K., Chuah, J. H., Tee, Y. K., Hum, Y. C., Salim, M. I. M., & Lai, K. W. (2021) · Journal of Grid Computing · doi:10.1007/s10723-021-09595-7 · Cited by 18
Research on Image Recognition Based on Deep Learning Technology
Zhai, H. (2016) · International Conference on Advanced Materials and Information Technology Processing (AMITP) · doi:10.2991/amitp-16.2016.53 · Cited by 18
A sea clutter detection method based on LSTM error frequency domain conversion
Yan, Y., & Xing, H. (2021) · Alexandria Engineering Journal · doi:10.1016/j.aej.2021.04.084 · Cited by 18
Weesakul, U., Kaewprapha, P., Boonyuen, K., & Mark, O. (2018) · Engineering and Applied Science Research · doi:10.14456/easr.2018.24 · Cited by 18
Generating Multi-Sentence Lingual Descriptions of Indoor ScenesPreprint
Lin, D., Kong, C., Fidler, S., & Urtasun, R. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1503.00064 · Cited by 18
Explainable Action Form Assessment by Exploiting Multimodal Chain-of-Thoughts Reasoning
Qi, M., Wu, Y., Yun, W., Zhang, X., & Ma, H. (2026) · IEEE Transactions on Image Processing · doi:10.1109/tip.2026.3700882 · Cited by 17
COMPLEX SYSTEM DESIGN WITH DESIGN LANGUAGES: METHOD, APPLICATIONS AND DESIGN PRINCIPLES
Vogel, S., & Rudolph, S. (2018) · Ontology of Designing · doi:10.18287/2223-9537-2018-8-3-323-346 · Cited by 17
Lightweight mobile network for real-time violence recognition
Zhang, Y., Li, Y., & Guo, S. (2022) · PLoS ONE · doi:10.1371/journal.pone.0276939 · Cited by 17
Luo, W., Zhao, Y., Shao, Q., Li, X., Wang, D., Zhang, T., Liu, F., Duan, L., He, Y., Wang, Y., et al. (2023) · Sensors · doi:10.3390/s23083948 · Cited by 17
AP-TransNet: a polarized transformer based aerial human action recognition framework
Dhiman, C., Varshney, A., & Vyapak, V. (2024) · Machine Vision and Applications · doi:10.1007/s00138-024-01535-1 · Cited by 17
Enhancing image caption generation through context-aware attention mechanism
Bhuiyan, A., Hossain, E., Hoque, M. M., & Dewan, M. A. A. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e36272 · Cited by 17
Sensor-Driven Real-Time Recognition of Basketball Goal States Using IMU and Deep Learning
Zhang, J., Guo, R., Zhu, Y., Che, Y., Zeng, Y., Yu, L., Yang, Z., & Yang, J. (2025) · Sensors · doi:10.3390/s25123709 · Cited by 17
Luo, G., Granskog, J., Holynski, A., & Darrell, T. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01670 · Cited by 17
Self-citationUnMA-CapSumT: Unified and Multi-Head attention-driven caption summarization transformer
Sharma, D., Dhiman, C., & Kumar, D. (2025) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2025.104600 · Cited by 17
A Refined Non-Driving Activity Classification Using a Two-Stream Convolutional Neural Network
Yang, L., Yang, T., Liu, H., Shan, X., Brighton, J., Skrypchuk, L., Mouzakitis, A., & Zhao, Y. (2020) · IEEE Sensors Journal · doi:10.1109/jsen.2020.3005810 · Cited by 17
Vertical power flow forecast with LSTMs using regular training update strategies
Brauns, K., Scholz, C., Schultz, A., Baier, A., & Jost, D. (2022) · Energy and AI · doi:10.1016/j.egyai.2022.100143 · Cited by 17
A convolutional neural network with sparse representation
Yang, Y., Yang, J., Lu, Z., & Liu, D. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106419 · Cited by 17
Hand Gesture Recognition Using IR-UWB Radar with ShuffleNet V2
Li, Y., Wang, X., Shi, B., & Zhu, M. (2021) · International Conference on Control Engineering and Artificial Intelligence (CCEAI) · doi:10.1145/3448218.3448233 · Cited by 17
Movement Tube Detection Network Integrating 3D CNN and Object Detection Framework to Detect Fall
Zou, S., Min, W., Liu, L., Wang, Q., & Zhou, X. (2021) · Electronics · doi:10.3390/electronics10080898 · Cited by 17
Mohammadreza, E., & Safabakhsh, R. (2021) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2021.100022 · Cited by 17
Evaluating deep transfer learning for whole-brain cognitive decoding
Thomas, A. W., Lindenberger, U., Samek, W., & Müller, K. (2023) · Journal of the Franklin Institute · doi:10.1016/j.jfranklin.2023.07.015 · Cited by 17
Towards Building a Visual Behaviour Analysis Pipeline for Suicide Detection and Prevention
Li, X., Onie, S., Liang, M., Larsen, M. E., & Sowmya, A. (2022) · Sensors · doi:10.3390/s22124488 · Cited by 17
Deep Learning—A New Era in Bridging the Semantic Gap
Markowska–Kaczmar, U., & Kwaśnicka, H. (2018) · Intelligent systems reference library · doi:10.1007/978-3-319-73891-8_7 · Cited by 17
Semantic Adversarial Network with Multi-Scale Pyramid Attention for Video Classification
Xie, D., Deng, C. D., Wang, H., Li, C., & Tao, D. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33019030 · Cited by 17
Loopy Residual Hashing: Filling the Quantization Gap for Image Retrieval
Bai, J., Li, Z., Ni, B., Wang, M., Yang, X., Hu, C., & Gao, W. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2922130 · Cited by 17
Two-Stream Action Recognition in Ice Hockey using Player Pose Sequences and Optical Flows
Vats, K., Neher, H., Clausi, D. A., & Zelek, J. (2019) · Canadian Conference on Computer and Robot Vision · doi:10.1109/crv.2019.00032 · Cited by 17
Khowaja, S. A., & Lee, S. (2019) · Neural Computing and Applications · doi:10.1007/s00521-019-04578-y · Cited by 17
Representation Learning for Motor Imagery Recognition with Deep Neural Network
Xu, F., Rong, F., Miao, Y., Sun, Y., Dong, G., Li, H., Li, J., Wang, Y., & Leng, J. (2021) · Electronics · doi:10.3390/electronics10020112 · Cited by 17
Multi-Scale Spatial-Temporal Integration Convolutional Tube for Human Action Recognition
Wu, H., Liu, J., Zhu, X., Wang, M., & Zha, Z.-J. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/105 · Cited by 16
Forecasting Surface Velocity Fields Associated With Laboratory Seismic Cycles Using Deep Learning
Mastella, G., Corbi, F., Bedford, J., Funiciello, F., & Rosenau, M. (2022) · Geophysical Research Letters · doi:10.1029/2022gl099632 · Cited by 16
Enhancing robustness in video recognition models: Sparse adversarial attacks and beyond
Mu, R., Marcolino, L. S., Ni, Q., & Ruan, W. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.11.056 · Cited by 16
Hierarchical medical image report adversarial generation with hybrid discriminator
Zhang, J., Cheng, M., Cheng, Q., Shen, X., Wan, Y., Zhu, J., & Liu, M. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102846 · Cited by 16
Multi-stream deep networks for human action classification with sequential tensor decomposition
Guo, H., Wu, X., & Feng, W. (2017) · Signal Processing · doi:10.1016/j.sigpro.2017.05.022 · Cited by 16
Domain learning joint with semantic adaptation for human action recognition
Zhang, J., & Hu, H. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.01.027 · Cited by 16
UCF-STAR: A Large Scale Still Image Dataset for Understanding Human Actions
Safaei, M., Balouchian, P., & Foroosh, H. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i03.5653 · Cited by 16
Deception Detection in Videos Using Robust Facial Features
Stathopoulos, A., Han, L., Dunbar, N. E., Burgoon, J. K., & Metaxas, D. (2020) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-63092-8_45 · Cited by 16
Indoor Video Flame Detection Based on Lightweight Convolutional Neural Network
Yang, Z., Bu, L., Wang, T., Yuan, P., & Ouyang, J. (2020) · Pattern Recognition and Image Analysis · doi:10.1134/s1054661820030293 · Cited by 16
Unsupervised monocular visual odometry with decoupled camera pose estimation
Lin, L., Wang, W., Luo, W., Song, L., & Zhou, W. (2021) · Digital Signal Processing · doi:10.1016/j.dsp.2021.103052 · Cited by 16
Service humanoid robotics: a novel interactive system based on bionic-companionship framework
Yang, J., Chew, E., & Liu, P. (2021) · PeerJ Computer Science · doi:10.7717/peerj-cs.674 · Cited by 16
Zhong, C., Reibman, A. R., Mina, H. A., & Deering, A. J. (2021) · Journal of Imaging · doi:10.3390/jimaging7090170 · Cited by 16
ABN: Agent-Aware Boundary Networks for Temporal Action Proposal Generation
Vo-Ho, V.-K., Yamazaki, K., Truong, S., Tran, M., Sugimoto, A., & Le, N. (2021) · IEEE Access · doi:10.1109/access.2021.3110973 · Cited by 16
Su, Y., & Yu, L. (2021) · Measurement Science and Technology · doi:10.1088/1361-6501/ac38f1 · Cited by 16
Detecting Anomalous Kicks in Taekwondo With Spatial and Temporal Features
Cho, D., Lee, H., Lee, W., & Kang, S.-S. (2021) · IEEE Access · doi:10.1109/access.2021.3134967 · Cited by 16
Satellite Video Scene Classification Using Low-Rank Sparse Representation Two-Stream Networks
Wang, T., Gu, Y., & Gao, G. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3168602 · Cited by 16
Driver Drowsiness Detection Using Gray Wolf Optimizer Based on Face and Eye Tracking
Jasim, S. S., Hassan, A. K. A., & Turner, S. (2022) · ARO-The Scientific Journal of Koya University · doi:10.14500/aro.10928 · Cited by 16
Action Recognition Using Action Sequences Optimization and Two-Stream 3D Dilated Neural Network
Xiong, X., Min, W., Han, Q., Wang, Q., & Zha, C. (2022) · Computational Intelligence and Neuroscience · doi:10.1155/2022/6608448 · Cited by 16
SHARP: An Adaptable, Energy-Efficient Accelerator for Recurrent Neural Networks
Aminabadi, R. Y., Ruwase, O., Zhang, M., He, Y., Arnau, J.-M., & González, A. M. (2022) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3552513 · Cited by 16
Chang, J.-W., Javaheripi, M., Hidano, S., & Koushanfar, F. (2023) · Network and Distributed System Security Symposium · doi:10.14722/ndss.2023.23165 · Cited by 16
Chen, L., Li, M., Wu, M., Pedrycz, W., & Hirota, K. (2023) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2023.3301001 · Cited by 16
HDA-pose: a real-time 2D human pose estimation method based on modified YOLOv8
Dong, C., Tang, Y., & Zhang, L. (2024) · Signal Image and Video Processing · doi:10.1007/s11760-024-03274-2 · Cited by 16
Segment-Tube: Spatio-Temporal Action Localization in Untrimmed Videos with Per-Frame Segmentation
Wang, L., Duan, X., Zhang, Q., Niu, Z., Hua, G., & Zheng, N. (2018) · Sensors · doi:10.3390/s18051657 · Cited by 16
Saif, S., Tehsin, S., & Kausar, S. (2018) · Sensors · doi:10.3390/s18113979 · Cited by 16
Using Variational Multi-View Learning for Classification of Grocery Items
Klasson, M., Zhang, C., & Kjellström, H. (2020) · Patterns · doi:10.1016/j.patter.2020.100143 · Cited by 16
Liu, H., Liu, Y., Zhang, R., & Wu, X. (2021) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2021.675827 · Cited by 16
SEMANTIC CORE OF DIGITAL PLATFORM
Maksimov, N., Golitsina, O. L., Ganchenkova, M., Васильевич, С. Д., & Razumov, A. (2018) · Ontology of Designing · doi:10.18287/2223-9537-2018-8-3-412-426 · Cited by 15
Intelligent Health Management of Fixed-Wing UAVs: A Deep-Learning-based Approach
Cui, A., Zhang, Y., Zhang, P., Dong, W., & Wang, C. (2020) · International Conference on Control, Automation, Robotics and Vision (ICARCV) · doi:10.1109/icarcv50220.2020.9305491 · Cited by 15
Modeling multi-scale sub-group context for group activity recognition
Mao, K., Jin, P., Ping, Y., & Tang, B. (2022) · Applied Intelligence · doi:10.1007/s10489-022-03470-y · Cited by 15
A 3DCNN-Based Knowledge Distillation Framework for Human Activity Recognition
Ullah, H., & Munir, A. (2023) · Journal of Imaging · doi:10.3390/jimaging9040082 · Cited by 15
Keyframe-guided Video Swin Transformer with Multi-path Excitation for Violence Detection
Li, C., Yang, X., & Liang, G. (2023) · The Computer Journal · doi:10.1093/comjnl/bxad103 · Cited by 15
CNN and RNN using Deepfake detection
Priya, A. S., & Manisha, T. V. L. (2024) · International Journal of Science and Research Archive · doi:10.30574/ijsra.2024.11.2.0460 · Cited by 15
GELT: A graph embeddings based lite-transformer for knowledge tracing
Liang, Z., Wu, R., Liang, Z., Yang, J., Wang, L., & Su, J. (2024) · PLoS ONE · doi:10.1371/journal.pone.0301714 · Cited by 15
Amir, A., & Butt, M. (2025) · Smart Agricultural Technology · doi:10.1016/j.atech.2025.101105 · Cited by 14
Stamoulakatos, A., Cardona, J., Michie, C., Andonović, I., Lazaridis, P. I., Bellekens, X., Atkinson, R. C., Hossain, M. M., & Tachtatzis, C. (2021) · MTS/IEEE OCEANS Conference (OCEANS) · doi:10.23919/oceans44145.2021.9706125 · Cited by 15
Ultrafast simulation of large-scale neocortical microcircuitry with biophysically realistic neurons
Oláh, V. J., Pedersen, N. P., & Rowan, M. J. (2022) · eLife · doi:10.7554/elife.79535 · Cited by 15
Babar, Z., van Laarhoven, T., & Marchiori, E. (2021) · PLoS ONE · doi:10.1371/journal.pone.0259639 · Cited by 15
Deep learning‐based body part recognition algorithm for three‐dimensional medical images
Ouyang, Z., Zhang, P., Pan, W., & Li, Q. (2022) · Medical Physics · doi:10.1002/mp.15536 · Cited by 15
Thermal fault diagnosis of marine diesel engine based on LSTM neural network algorithm
Zhao, Y., Wang, S., & Chen, N. (2022) · Vibroengineering PROCEDIA · doi:10.21595/vp.2022.22515 · Cited by 15
Khowaja, S. A., & Lee, S. (2022) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-022-03848-3 · Cited by 15
Deep Learning Methods for Speed Estimation of Bipedal Motion from Wearable IMU Sensors
Justa, J., Šmídl, V., & Hamáček, A. (2022) · Sensors · doi:10.3390/s22103865 · Cited by 15
Visual Space System Design in Digital Media Art Design
Wang, M., Wang, J., & Zhang, C. (2022) · Scientific Programming · doi:10.1155/2022/3678090 · Cited by 15
Prediction Model of Rotor Yarn Quality Based on CNN-LSTM
Hu, Z. (2022) · Journal of Sensors · doi:10.1155/2022/3955047 · Cited by 15
RetractedLin, F., Wang, Z., Zhao, H., Qiu, S., Liu, R., Shi, X., Wang, C., & Yin, W. (2023) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2023.3266812 · Cited by 15
Neural sensing and control in a kilometer-scale gravitational-wave observatory
Mukund, N., Lough, J. D., Bisht, A., Wittel, H., Nadji, S. L., Affeldt, C., Bergamin, F., Brinkmann, M., Kringel, V., Lück, H., et al. (2023) · Physical Review Applied · doi:10.1103/physrevapplied.20.064041 · Cited by 15
Convex Hull Prediction for Adaptive Video Streaming by Recurrent Learning
Paul, S., Norkin, A., & Bovik, A. C. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3455989 · Cited by 15
Multimodal Gesture Recognition Using Densely Connected Convolution and BLSTM
Li, D., Chen, Y., Gao, M., Jiang, S., & Huang, C. (2018) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2018.8545502 · Cited by 15
Driving Maneuvers Prediction Based on Cognition-driven and Data-driven Method
Zhou, D. H., Ma, H., & Dong, Y. (2018) · IEEE International Conference on Visual Communications and Image Processing (VCIP) · doi:10.1109/vcip.2018.8698695 · Cited by 15
Liu, W., Huang, X., Cao, G., Zhang, J., Song, G., & Yang, L. (2019) · Multimedia Tools and Applications · doi:10.1007/s11042-019-08147-2 · Cited by 15
A Non-Intrusive Deep Learning Based Fall Detection Scheme Using Video Cameras
Pourazad, M. T., Shojaei-Hashemi, A., Nasiopoulos, P., Azimi, M., Mak, M., Grace, J., Jung, D., & Bains, T. (2020) · International Conference on Information Networking · doi:10.1109/icoin48656.2020.9016455 · Cited by 15
GuessWhich? Visual dialog with attentive memory network
Zhao, L., Lyu, X., Song, J., & Gao, L. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.107823 · Cited by 15
An Efficient Human Instance-Guided Framework for Video Action Recognition
Lee, I., Kim, D., Wee, D., & Lee, S. (2021) · Sensors · doi:10.3390/s21248309 · Cited by 15
Video Is Graph: Structured Graph Module for Video Action RecognitionPreprint
Li, R.-C., Wu, X., & Xu, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.05904 · Cited by 15
Method for detection of unsafe actions in power field based on edge computing architecture
Yin, Y., Lin, J., Sun, N., Zhu, Q., Zhang, S., Zhang, Y., & Liu, M. (2021) · Journal of Cloud Computing · doi:10.1186/s13677-021-00234-w · Cited by 14
ACA-Net: adaptive context-aware network for basketball action recognition
Zhang, Y., Zhang, F., Zhou, Y., & Xu, X. M. (2024) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2024.1471327 · Cited by 14
Jeǵou, H. (2017) · doi:10.1145/3122865.3122871 · Cited by 14
Wang, K., Li, X.-J., Yang, J., Wu, J., & Li, R. (2021) · International Journal of Advanced Robotic Systems · doi:10.1177/17298814211038342 · Cited by 14
Hong, D., Han, W.-H., & Yim, C. (2021) · Metallurgical and Materials Transactions B · doi:10.1007/s11663-021-02299-z · Cited by 14
Bidirectional LSTM with saliency-aware 3D-CNN features for human action recognition
Arif, S., Wang, J., Siddiqui, A. A., Hussain, R., & Hussain, F. (2021) · Journal of Engineering Research · doi:10.36909/jer.v9i3a.8383 · Cited by 14
Position-aware image captioning with spatial relation
Duan, Y., Wang, Z., Wang, J., Wang, Y., & Lin, C. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.05.003 · Cited by 14
Metadata
- Authors
- Donahue, J., Hendricks, L. A., Rohrbach, M., Venugopalan, S., Guadarrama, S., Saenko, K., & Darrell, T.
- Affiliations
- University of California, Berkeley (US)
- International Computer Science Institute (US)
- The University of Texas at Austin (US)
- University of Massachusetts Lowell (US)
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2017-04-01
- Volume
- 39
- Issue
- 4
- Pages
- 677-691
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2508429489
- Cited by
- 1,547
- References
- 78
- Citations by year
- 2026: 46 · 2025: 79 · 2024: 111 · 2023: 164 · 2022: 202 · 2021: 250 · 2020: 227 · 2019: 225 · 2018: 149 · 2017: 70
- FWCI
- 102.49
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
- PubMed (publishedVersion)
- Funders
- DARPA's
- MSEE
- SMISC
- NSF (IIS-1427425, IIS-1212798)
- Berkeley Vision and Learning Center
- NVIDIA
- FITweltweit-Program
- German Academic Exchange Service (DAAD)
- NDSEG
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Keywords
- long-term recurrent convolutional network, activity recognition, image captioning, audio description, long-range dependencies, temporal dynamics, compositional representations, end-to-end learning, visual description generation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.