Long-Term Recurrent Convolutional Networks for Visual Recognition and Description
The DOI matches its Crossref record; 76 of the 78 references it cites were found in a registry or an index.
Abstract
Models based on deep convolutional networks have dominated recent image interpretation tasks; we investigate whether models which are also recurrent are effective for tasks involving sequences, visual and otherwise. We describe a class of recurrent convolutional architectures which is end-to-end trainable and suitable for large-scale visual understanding tasks, and demonstrate the value of these models for activity recognition, image captioning, and video description. In contrast to previous models which assume a fixed visual representation or perform simple temporal averaging for sequential processing, recurrent convolutional models are "doubly deep" in that they learn compositional representations in space and time. Learning long-term dependencies is possible when nonlinearities are incorporated into the network state updates. Differentiable recurrent models are appealing in that they can directly map variable-length inputs (e.g., videos) to variable-length outputs (e.g., natural language text) and can model complex temporal dynamics; yet they can be optimized with backpropagation. Our recurrent sequence models are directly connected to modern visual convolutional network models and can be jointly trained to learn temporal dynamics and convolutional perceptual representations. Our results show that such models have distinct advantages over state-of-the-art models for recognition or generation which are separately defined or optimized.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Cited by
Items 601–700 of 1,001
Domain-Specific Semantics Guided Approach to Video Captioning
Hemalatha, M., & Sekhar, C. C. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093344 · Cited by 31
Context-Aware Human Trajectories Prediction via Latent Variational Model
Berenguer, A. D., Alioscha‐Perez, M., Oveneke, M. C., & Hichem Sahli, B. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.3014869 · Cited by 31
Nawaz, A., Huang, Z., Wang, S., Akbar, A., AlSalman, H., & Gumaei, A. (2020) · Sensors · doi:10.3390/s20185143 · Cited by 31
Attacking Video Recognition Models with Bullet-Screen Comments
Chen, K., Wei, Z., Chen, J., Wu, Z., & Jiang, Y. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19907 · Cited by 31
Parking Lot Occupancy Detection Using Hybrid Deep Learning CNN-LSTM Approach
Hùng, B. T., & Chakrabarti, P. (2022) · Algorithms for intelligent systems · doi:10.1007/978-981-16-6332-1_43 · Cited by 31
Medical Image Captioning Using Optimized Deep Learning Model
Singh, A., Krishna, R. J., Prasad, G., Chauhan, S., Tiwari, P. K., Zaguia, A., & Ullah, M. A. (2022) · Computational Intelligence and Neuroscience · doi:10.1155/2022/9638438 · Cited by 31
RetractedHigher Order Polynomial Transformer for Fine-Grained Freezing of Gait Detection
Sun, R., Hu, K., Martens, K. A. E., Hagenbuchner, M., Tsoi, A. C., Bennamoun, M., Lewis, S. J. G., & Wang, Z. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3264647 · Cited by 31
Sparse Adversarial Video Attacks with Spatial Transformations
Mu, R., Ruan, W., Marcolino, L. S., & Ni, Q. (2021) · British Machine Vision Conference (BMVC) · doi:10.5244/c.35.414 · Cited by 31
Image and Video Captioning with Augmented Neural Architectures
Shetty, R., Tavakoli, H. R., & Laaksonen, J. T. (2018) · IEEE Multimedia · doi:10.1109/mmul.2018.112135923 · Cited by 31
A LSTM Neural Network applied to Mobile Robots Path Planning
Fiorato, N., Fujimoto, Y., & Oboe, R. (2018) · IEEE International Conference on Industrial Informatics (INDIN) · doi:10.1109/indin.2018.8472028 · Cited by 31
Ren, J., Karagoz, K., Gatza, M. L., Singer, E. A., Sadimin, E. T., Foran, D. J., & Qi, X. (2018) · Journal of medical imaging · doi:10.1117/1.jmi.5.4.047501 · Cited by 31
Emotion Recognition via Body Gesture: Deep Learning Model Coupled with Keyframe Selection
Ly, S. T., Lee, G.-S., Kim, S.-H., & Yang, H.-J. (2018) · International Conference on Machine Learning and Machine Intelligence (MLMI) · doi:10.1145/3278312.3278313 · Cited by 31
Enhanced RF Fingerprinting for IoT Devices with Recurrent Neural Networks
Merchant, K., & Nousain, B. (2019) · IEEE Military Communications Conference (MILCOM) · doi:10.1109/milcom47813.2019.9021080 · Cited by 31
Deep learning with 4D spatio-temporal data representations for OCT-based force estimation
Gessert, N., Bengs, M., Schlüter, M., & Schlaefer, A. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101730 · Cited by 31
Deep feature extraction and motion representation for satellite video scene classification
Gu, Y., Liu, H., Wang, T., Li, S., & Gao, G. (2020) · Science China Information Sciences · doi:10.1007/s11432-019-2784-4 · Cited by 30
H3DNN: 3D Deep Learning Based Detection of COVID-19 Virus using Lungs Computed Tomography
Khan, A. A., Shafiq, S., Kumar, R., Kumar, J., & Haq, A. U. (2020) · International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP) · doi:10.1109/iccwamtip51612.2020.9317357 · Cited by 30
Violence behavior recognition of two-cascade temporal shift module with attention mechanism
Liang, Q., Li, Y., Chen, B., & Kaikai, Y. (2021) · Journal of Electronic Imaging · doi:10.1117/1.jei.30.4.043009 · Cited by 30
CL-ACP: a parallel combination of CNN and LSTM anticancer peptide recognition model
Wang, H., Zhao, J., Zhao, H. S., Li, H., & Wang, J. (2021) · BMC Bioinformatics · doi:10.1186/s12859-021-04433-9 · Cited by 30
Guo, P., Du, J. H., Bao, Y., & Meng, W. (2022) · Measurement · doi:10.1016/j.measurement.2022.110809 · Cited by 30
Ma, X., Zhang, K., Zhao, H., Zhang, L., Wang, J., Zhang, H., Liu, P., Yan, X., & Yang, Y. (2022) · Journal of Petroleum Science and Engineering · doi:10.1016/j.petrol.2022.110548 · Cited by 30
Literature review of vision‐based dynamic gesture recognition using deep learning techniques
Jain, R., Karsh, R. K., & Barbhuiya, A. A. (2022) · Concurrency and Computation Practice and Experience · doi:10.1002/cpe.7159 · Cited by 30
The Potential of a Visual Dialogue Agent In a Tandem Automated Audio Description System for Videos
Stangl, A. J., Ihorn, S. M., Siu, Y.-T., Bodi, A., Castanon, M., Narins, L. D., & Yoon, I. (2023) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3597638.3608402 · Cited by 31
An optoacoustic field-programmable perceptron for recurrent neural networks
Becker, S., Englund, D. R., & Stiller, B. (2024) · Nature Communications · doi:10.1038/s41467-024-47053-6 · Cited by 30
Revolutionizing Pathology with Artificial Intelligence: Innovations in Immunohistochemistry
Poalelungi, D. G., Neagu, A., Fulga, A., Neagu, M., Tutunaru, D., Nechita, A., & Fulga, I. (2024) · Journal of Personalized Medicine · doi:10.3390/jpm14070693 · Cited by 30
Recurrent Neural Networks for Online Video Popularity Prediction
Trzcinski, T. P., Andruszkiewicz, P., Bocheński, T., & Rokita, P. S. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-60438-1_15 · Cited by 30
Recurrent attention network using spatial-temporal relations for action recognition
Zhang, M., Yang, Y., Ji, Y., Xie, N., & Shen, F. (2017) · Signal Processing · doi:10.1016/j.sigpro.2017.12.008 · Cited by 30
Automatic Detection of Flood Severity Level from Flood Videos using Deep Learning Models
Lohumi, K., & Roy, S. K. (2018) · International Conference on Information and Communication Technologies for Disaster Management (ICT-DM) · doi:10.1109/ict-dm.2018.8636373 · Cited by 30
Embedding human heuristics in machine-learning-enabled probe microscopy
Gordon, O., Junqueira, F. L. Q., & Moriarty, P. (2020) · Machine Learning Science and Technology · doi:10.1088/2632-2153/ab42ec · Cited by 30
Bozkurt, A., Köse, K., Coll‐Font, J., Alessi‐Fox, C., Brooks, D. H., Dy, J., & Rajadhyaksha, M. M. (2021) · Scientific Reports · doi:10.1038/s41598-021-90328-x · Cited by 30
Sign Language Recognition: A Large-scale Multi-view Dataset and Comprehensive Evaluation
Dinh, N. S., Nguyen, T. D., Tran, D. T., Pham, N. D. H., Tran, T. H., Tong, N. A., Hoang, Q. H., & Nguyen, P. L. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00766 · Cited by 29
Zhu, Z., Guglielmo, G. D., Cheng, Q., Glick, M. S., Kwon, J., Guan, H., Carloni, L. P., & Bergman, K. (2020) · Journal of Lightwave Technology · doi:10.1109/jlt.2020.2975976 · Cited by 29
Recurrent convolutional networks for session-based recommendations
Bach, N. X., Dang, L. H., & Phuong, T. M. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.06.077 · Cited by 29
Hong, W.-C., Huang, D.-R., Chen, C.-L., & Lee, J.-S. (2020) · IEEE Access · doi:10.1109/access.2020.3007609 · Cited by 29
Investigating LSTM for Micro-Expression Recognition
Bai, M., & Goecke, R. (2020) · Companion Publication of the International Conference on Multimodal Interaction (ICMI Companion) · doi:10.1145/3395035.3425248 · Cited by 29
FARNN: FPGA-GPU Hybrid Acceleration Platform for Recurrent Neural Networks
Cho, H., Lee, J., & Lee, J. (2021) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2021.3124125 · Cited by 29
DeepGPD: A Deep Learning Approach for Modeling Geospatio-Temporal Extreme Events
Wilson, T., Tan, P., & Luo, L. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i4.20344 · Cited by 29
Chapman, B. P., Gullapalli, B. T., Rahman, T., Smelson, D. A., Boyer, E. W., & Carreiro, S. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00664-z · Cited by 29
Neural network surrogate for flow prediction and robust optimization in fractured reservoir systems
Kim, Y. D., & Durlofsky, L. J. (2023) · Fuel · doi:10.1016/j.fuel.2023.128756 · Cited by 29
Sim, S., Kim, D., & Bae, H. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3319557 · Cited by 29
Joint spatial-temporal attention for action recognition
Yu, T., Guo, C., Wang, L., Gu, H., Xiang, S., & Pan, C. (2018) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.07.034 · Cited by 29
Learning multi-temporal-scale deep information for action recognition
Yao, G., Leí, T., Zhong, J., & Jiang, P. (2018) · Applied Intelligence · doi:10.1007/s10489-018-1347-3 · Cited by 29
Kosmala, M., Hufkens, K., & Richardson, A. D. (2018) · PLoS ONE · doi:10.1371/journal.pone.0209649 · Cited by 29
Facial Expression Recognition with CNN-LSTM
Hùng, B. T., & Tien, L. M. (2021) · Advances in intelligent systems and computing · doi:10.1007/978-981-15-7527-3_52 · Cited by 29
Analysis of the concept of informal economy through 102 definitions: legality or necessity
González, A. L. (2021) · Open Research Europe · doi:10.12688/openreseurope.13990.1 · Cited by 29
Kim, D., Cho, H., Shin, H., Lim, S., & Hwang, W. (2019) · Sensors · doi:10.3390/s19163579 · Cited by 29
Seidel, R., Jahn, N., Seo, S., Goerttler, T., & Obermayer, K. (2022) · IEEE Open Journal of Intelligent Transportation Systems · doi:10.1109/ojits.2021.3139393 · Cited by 28
Utilizing Mobile-based Deep Learning Model for Managing Video in Knowledge Management System
Prabowo, H., Cenggoro, T. W., Budiarto, A., Perbangsa, A. S., Muljo, H. H., & Pardamean, B. (2018) · International Journal of Interactive Mobile Technologies (iJIM) · doi:10.3991/ijim.v12i6.8563 · Cited by 28
HitM: high-throughput ReRAM-based PIM for multi-modal neural networks
Li, B., Wang, Y., & Chen, Y. (2020) · doi:10.1145/3400302.3415663 · Cited by 28
A multi-mode traffic flow prediction method with clustering based attention convolution LSTM
Huang, X., Ye, Y., Wang, C., Yang, X., & Xiong, L. (2021) · Applied Intelligence · doi:10.1007/s10489-021-02770-z · Cited by 28
An artificial neural network system to identify alleles in reference electropherograms
Taylor, D., Harrison, A., & Powers, D. M. W. (2017) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2017.07.002 · Cited by 28
Evaluating Brush Movements for Chinese Calligraphy: A Computer Vision Based Approach
Xu, P., Wang, L., Guan, Z., Zheng, X., Chen, X., Tang, Z., Fang, D., Gong, X., & Wang, Z. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/146 · Cited by 28
Aberrant epileptic seizure identification: A computer vision perspective
Ahmedt‐Aristizabal, D., Fookes, C., Denman, S., Nguyen, K., Sridharan, S., & Dionisio, S. A. (2018) · Seizure · doi:10.1016/j.seizure.2018.12.017 · Cited by 28
Ahmadizadeh, C., Pousett, B. M., & Menon, C. (2019) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2019.00331 · Cited by 28
Movie Tags Prediction and Segmentation Using Deep Learning
Khan, U. A., del Amor, M. Á. M., Altowaijri, S. M., Ahmed, A., Rahman, A. U., Sama, N. U., Haseeb, K., & Islam, N. (2020) · IEEE Access · doi:10.1109/access.2019.2963535 · Cited by 28
Video event classification based on two-stage neural network
Zhang, L., & Xiang, X. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-019-08457-5 · Cited by 28
Player Identification in Hockey Broadcast Videos
Chan, A., Levine, M. D., & Javan, M. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113891 · Cited by 28
Class-specific early exit design methodology for convolutional neural networks
Bonato, V., & Bouganis, C.-S. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2021.107316 · Cited by 28
Su, Y.-C., Chiu, T.-H., Yeh, C.-Y., Huang, H., & Hsu, W. H. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1409.4127 · Cited by 28
METHOD OF UNIVERSAL COEFFICIENTS FOR THE MULTI-CRITERIAL DECISION MAKING
Piyavsky, S. A. (2018) · Ontology of Designing · doi:10.18287/2223-9537-2018-8-3-449-468 · Cited by 27
Temporal Accumulative Features for Sign Language Recognition
Kındıroğlu, A. A., Özdemir, O., & Akarun, L. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00164 · Cited by 27
Attentive Visual Semantic Specialized Network for Video Captioning
Perez-Martin, J., Bustos, B., & Pérez, J. E. P. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412898 · Cited by 27
Attention-guided image captioning with adaptive global and local feature fusion
Zhong, X., Nie, G., Huang, W., Liu, W., Ma, B., & Lin, C. (2021) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2021.103138 · Cited by 27
Learning to Calibrate - Estimating the Hand-eye Transformation Without Calibration Objects
Pachtrachai, K., Vasconcelos, F., Edwards, P., & Stoyanov, D. V. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3098942 · Cited by 27
Emotion recognition from facial expressions for 3D videos using siamese network
Lawrance, D., & Palaniswamy, S. (2021) · International Conference on Communication, Control and Information Sciences (ICCISc) · doi:10.1109/iccisc52257.2021.9484949 · Cited by 27
Kim, H. M., Ko, T., Choi, I. Y., & Myong, J. (2021) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2021.104667 · Cited by 27
Disturbance Robust Abnormality Diagnosis of Fused Magnesium Furnaces Using Deep Neural Networks
Liu, Q., Zhang, Y., Wu, G., & Fan, Z. (2022) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2022.3168251 · Cited by 27
Operational solar flare forecasting via video-based deep learning
Guastavino, S., Marchetti, F., Benvenuto, F., Campi, C., & Piana, M. (2023) · Frontiers in Astronomy and Space Sciences · doi:10.3389/fspas.2022.1039805 · Cited by 27
Empowering deaf communication: a novel LSTM model for recognizing Indonesian sign language
Caraka, R. E., Supardi, K., Kurniawan, R., Kim, Y., Gio, P. U., Yuniarto, B., Mubarok, F. Z., & Pardamean, B. (2024) · Universal Access in the Information Society · doi:10.1007/s10209-024-01095-1 · Cited by 27
Frontiers of Multimedia Research
Chang, S.-F. (2017) · doi:10.1145/3122865 · Cited by 27
3-D Deconvolutional Networks for the Unsupervised Representation Learning of Human Motions
Zhang, C.-Y., Xiao, Y.-Y., Lin, J., Chen, C. L. P., Liu, W., & Tong, Y. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.2973300 · Cited by 27
REDN: A Recursive Encoder-Decoder Network for Edge Detection
Le, T., & Duan, Y. (2020) · IEEE Access · doi:10.1109/access.2020.2994160 · Cited by 27
Nabati, M., & Behrad, A. (2020) · Information Processing & Management · doi:10.1016/j.ipm.2020.102302 · Cited by 27
Temporal Head Pose Estimation From Point Cloud in Naturalistic Driving Conditions
Hu, T., Jha, S., & Busso, C. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3075350 · Cited by 27
Convolutional Residual Memory NetworksPreprint
Moniz, J. R. A., & Pal, C. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.05262 · Cited by 27
Hu, N., Ding, L., Men, L., Zhou, W., Zhang, W., & Yin, R. (2024) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-024-02417-z · Cited by 26
Zhang, Y., & Wang, Y. (2025) · EURASIP Journal on Image and Video Processing · doi:10.1186/s13640-025-00677-0 · Cited by 26
Muthukumar, K., Bouazizi, M., & Ohtsuki, T. O. (2021) · IEEE Access · doi:10.1109/access.2021.3084926 · Cited by 26
A parsimonious setup for streamflow forecasting using CNN-LSTM
Pokharel, S., & Roy, T. (2024) · Journal of Hydroinformatics · doi:10.2166/hydro.2024.114 · Cited by 26
Video Imprint Segmentation for Temporal Action Detection in Untrimmed Videos
Gao, Z., Wang, L., Zhang, Q., Niu, Z., Zheng, N., & Hua, G. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33018328 · Cited by 26
Spatio-temporal deep learning models for tip force estimation during needle insertion
Gessert, N., Priegnitz, T., Saathoff, T., Antoni, S.-T., Meyer, D., Hamann, M., Jünemann, K., Otte, C., & Schlaefer, A. (2019) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-019-02006-z · Cited by 26
Structured Label Inference for Visual Understanding
Nauata, N., Hu, H., Zhou, G.-T., Deng, Z., Liao, Z., & Mori, G. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2893215 · Cited by 26
Real-time multimodal ADL recognition using convolution neural networks
Madhuranga, D., Madushan, R., Siriwardane, C., & Gunasekera, K. (2020) · The Visual Computer · doi:10.1007/s00371-020-01864-y · Cited by 26
A Deep Learning Framework for Recognizing Both Static and Dynamic Gestures
Mazhar, O., Ramdani, S., & Cherubini, A. (2021) · Sensors · doi:10.3390/s21062227 · Cited by 26
Adaptive Spatial Location With Balanced Loss for Video Captioning
Li, L., Zhang, Y., Tang, S., Xie, L., Li, X., & Tian, Q. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.3045735 · Cited by 26
Encoded motion image-based dynamic hand gesture recognition
Jain, R., Karsh, R. K., & Barbhuiya, A. A. (2021) · The Visual Computer · doi:10.1007/s00371-021-02259-3 · Cited by 26
AI-Powered Social BotsPreprint
Adams, T. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.05143 · Cited by 26
Dense Optical Flow Prediction from a Static ImagePreprint
Walker, J., Gupta, A., & Hebert, M. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.00295 · Cited by 26
A Time Series Characterization of IGBT Junction Temperature Method Based on LSTM Network
Du, Z.-W., Zhang, Y., Wang, Y., Chen, Z., Wang, Y.-D., Wu, R., Zhao, D., Zhang, X., & Yin, W. (2024) · IEEE Transactions on Power Electronics · doi:10.1109/tpel.2024.3459470 · Cited by 25
Mention Recommendation for Multimodal Microblog with Cross-attention Memory Network
Ma, R., Zhang, Q., Wang, J., Cui, L., & Huang, X. (2018) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3209978.3210026 · Cited by 25
Integrating Vision and Language for First-Impression Personality Analysis
Gorbova, J., Avots, E., Lüsi, I., Fishel, M., Escalera, S., & Anbarjafari, G. (2018) · IEEE Multimedia · doi:10.1109/mmul.2018.023121162 · Cited by 25
Zhou, K., Wu, T., Wang, C., Wang, J., & Li, C. (2020) · Procedia Computer Science · doi:10.1016/j.procs.2020.06.110 · Cited by 25
Sensor-based Human Activity Recognition Using Graph LSTM and Multi-task Classification Model
Cao, J., Wang, Y., Tao, H., & Guo, X. (2022) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3561387 · Cited by 25
Hong, K. (2023) · Scientific Reports · doi:10.1038/s41598-023-29903-3 · Cited by 25
Artificial Intelligence in Urology
Abid, R., Hussein, A. A., & Guru, K. A. (2023) · Urologic Clinics of North America · doi:10.1016/j.ucl.2023.06.005 · Cited by 25
TwinFormer: Fine-to-Coarse Temporal Modeling for Long-Term Action Recognition
Zhou, J., Lin, K.-Y., Qiu, Y.-K., & Zheng, W. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3302471 · Cited by 25
Parres, D., Albiol, A., & Paredes, R. (2024) · Bioengineering · doi:10.3390/bioengineering11040351 · Cited by 25
New advances of high-level synthesis for efficient and reliable hardware design
Campbell, K. A., Zuo, W., & Chen, D. (2016) · Integration · doi:10.1016/j.vlsi.2016.11.006 · Cited by 25
The use of deep learning to automate the segmentation of the skeleton from CT volumes of pigs1
Kvam, J., Gangsei, L. E., Kongsro, J., & Solberg, A. H. S. (2018) · Translational Animal Science · doi:10.1093/tas/txy060 · Cited by 25
Skeleton Feature Fusion Based on Multi-Stream LSTM for Action Recognition
Lei, W., Zhao, X., & Liu, Y. (2018) · IEEE Access · doi:10.1109/access.2018.2869751 · Cited by 25
Sequential Image-Based Attention Network for Inferring Force Estimation Without Haptic Sensor
Shin, H., Cho, H., Kim, D., Ko, D.-K., Lim, S., & Hwang, W. (2019) · IEEE Access · doi:10.1109/access.2019.2947090 · Cited by 25
Metadata
- Authors
- Donahue, J., Hendricks, L. A., Rohrbach, M., Venugopalan, S., Guadarrama, S., Saenko, K., & Darrell, T.
- Affiliations
- University of California, Berkeley (US)
- International Computer Science Institute (US)
- The University of Texas at Austin (US)
- University of Massachusetts Lowell (US)
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2017-04-01
- Volume
- 39
- Issue
- 4
- Pages
- 677-691
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2508429489
- Cited by
- 1,547
- References
- 78
- Citations by year
- 2026: 46 · 2025: 79 · 2024: 111 · 2023: 164 · 2022: 202 · 2021: 250 · 2020: 227 · 2019: 225 · 2018: 149 · 2017: 70
- FWCI
- 102.49
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
- PubMed (publishedVersion)
- Funders
- DARPA's
- MSEE
- SMISC
- NSF (IIS-1427425, IIS-1212798)
- Berkeley Vision and Learning Center
- NVIDIA
- FITweltweit-Program
- German Academic Exchange Service (DAAD)
- NDSEG
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Keywords
- long-term recurrent convolutional network, activity recognition, image captioning, audio description, long-range dependencies, temporal dynamics, compositional representations, end-to-end learning, visual description generation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.