Long-Term Recurrent Convolutional Networks for Visual Recognition and Description
The DOI matches its Crossref record; 76 of the 78 references it cites were found in a registry or an index.
Abstract
Models based on deep convolutional networks have dominated recent image interpretation tasks; we investigate whether models which are also recurrent are effective for tasks involving sequences, visual and otherwise. We describe a class of recurrent convolutional architectures which is end-to-end trainable and suitable for large-scale visual understanding tasks, and demonstrate the value of these models for activity recognition, image captioning, and video description. In contrast to previous models which assume a fixed visual representation or perform simple temporal averaging for sequential processing, recurrent convolutional models are "doubly deep" in that they learn compositional representations in space and time. Learning long-term dependencies is possible when nonlinearities are incorporated into the network state updates. Differentiable recurrent models are appealing in that they can directly map variable-length inputs (e.g., videos) to variable-length outputs (e.g., natural language text) and can model complex temporal dynamics; yet they can be optimized with backpropagation. Our recurrent sequence models are directly connected to modern visual convolutional network models and can be jointly trained to learn temporal dynamics and convolutional perceptual representations. Our results show that such models have distinct advantages over state-of-the-art models for recognition or generation which are separately defined or optimized.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Cited by
Items 201–300 of 1,001
Symbiotic Attention for Egocentric Action Recognition With Object-Centric Alignment
Wang, X., Zhu, L., Wu, Y., & Yang, Y. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3015894 · Cited by 122
Götz, F. M., Maertens, R., Loomba, S., & van der Linden, S. (2024) · Psychological Methods · doi:10.1037/met0000540 · Cited by 77
Patel, C. I., Labana, D. L., Pandya, S., Modi, K. J., Ghayvat, H., & Awais, M. A. (2020) · Sensors · doi:10.3390/s20247299 · Cited by 121
Alami, N., Meknassi, M., & En-Nahnahi, N. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.01.037 · Cited by 120
Miao, R., Shan, Z., Zhou, Q., Wu, Y., Ge, L., Zhang, J., & Hu, H. (2021) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2021.01.012 · Cited by 120
Yang, K., Cao, Y., Zhang, Y., Fan, S., Tang, M., Åberg, D., Sadigh, B., & Zhou, F. (2021) · Patterns · doi:10.1016/j.patter.2021.100243 · Cited by 121
Shad, H. S., Rizvee, M. M., Roza, N. T., Hoq, S. M. A., Monirujjaman Khan, M., Singh, A., Zaguia, A., & Bourouis, S. (2021) · Computational Intelligence and Neuroscience · doi:10.1155/2021/3111676 · Cited by 93
RetractedMaharaj, T., Ballas, N., Rohrbach, A., Courville, A., & Pal, C. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.778 · Cited by 85
Reasoning about Pragmatics with Neural Listeners and Speakers
Andreas, J., & Klein, D. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1125 · Cited by 115
Lake Level Prediction using Feed Forward and Recurrent Neural Networks
Hrnjica, B., & Bonacci, O. (2019) · Water Resources Management · doi:10.1007/s11269-019-02255-2 · Cited by 114
Hierarchically Structured Reinforcement Learning for Topically Coherent Visual Story Generation
Huang, Q., Gan, Z., Celikyilmaz, A., Wu, D., Wang, J., & He, X. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33018465 · Cited by 98
A Survey of Vision-Based Human Action Evaluation Methods
Lei, Q., Du, J., Zhang, H., Ye, S., & Chen, D. (2019) · Sensors · doi:10.3390/s19194129 · Cited by 114
Step-by-step Erasion, One-by-one Collection: A Weakly Supervised Temporal Action Detector
Zhong, J.-X., Li, N., Kong, W., Zhang, T., Li, T. H., & Li, G. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240511 · Cited by 114
Öksüz, İ., Ruijsink, B., Anton, E. P., Clough, J. R., da Cruz, G. J. L., Bustin, A., Prieto, C., Botnar, R. M., Rueckert, D., Schnabel, J. A., et al. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.04.009 · Cited by 113
Analyzing Neuroimaging Data Through Recurrent Deep Learning Models
Thomas, A. W., Heekeren, H. R., Müller, K.-R., & Samek, W. (2019) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.01321 · Cited by 90
Image segmentation review: Theoretical background and recent advances
Brar, K. K., Goyal, B., Dogra, A., Mustafa, M. A., Majumdar, R., Alkhayyat, A. H., & Kukreja, V. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102608 · Cited by 114
Zhao, B., Cheng, C., Peng, Z., Dong, X., & Meng, G. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.3005113 · Cited by 107
A Review of Deep Learning-based Human Activity Recognition on Benchmark Video Datasets
Sharma, V., Gupta, M., Pandey, A. K., Mishra, D., & Kumar, A. (2022) · Applied Artificial Intelligence · doi:10.1080/08839514.2022.2093705 · Cited by 113
Heuristic Black-Box Adversarial Attacks on Video Recognition Models
Wei, Z., Chen, J., Wei, X., Jiang, L., Chua, T., Zhou, F., & Jiang, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6918 · Cited by 111
Machine learning for sperm selection
You, J. B., McCallum, C., Wang, Y., Riordon, J., Nosrati, R., & Sinton, D. A. (2021) · Nature Reviews Urology · doi:10.1038/s41585-021-00465-1 · Cited by 111
Lebret, R., Pinheiro, P. O., & Collobert, R. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1502.03671 · Cited by 45
Decoding subjective emotional arousal from EEG during an immersive virtual reality experience
Hofmann, S., Klotzsche, F., Mariola, A., Nikulin, V. V., Villringer, A., & Gaebler, M. (2021) · eLife · doi:10.7554/elife.64812 · Cited by 110
Event Cameras in Automotive Sensing: A Review
Shariff, W., Dilmaghani, M. S., Kielty, P., Moustafa, M., Lemley, J., & Corcoran, P. (2024) · IEEE Access · doi:10.1109/access.2024.3386032 · Cited by 112
Anderson, S., & Radić, V. (2022) · Hydrology and earth system sciences · doi:10.5194/hess-26-795-2022 · Cited by 109
CoDraw: Collaborative Drawing as a Testbed for Grounded Goal-driven Communication
Kim, J.-H., Kitaev, N., Chen, X., Rohrbach, M., Zhang, B.-T., Tian, Y., Batra, D., & Parikh, D. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1651 · Cited by 53
Self-citationA multi-view recurrent neural network for 3D mesh segmentation
Le, T., Bui, G. T. T., & Duan, Y. (2017) · Computers & Graphics · doi:10.1016/j.cag.2017.05.011 · Cited by 108
A recurrent convolutional neural network approach for sensorless force estimation in robotic surgery
Marbán, A., Srinivasan, V., Samek, W., Fernández, J., & Casals, A. (2019) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2019.01.011 · Cited by 108
RGB-D Data-Based Action Recognition: A Review
Shaikh, M. B., & Chai, D. (2021) · Sensors · doi:10.3390/s21124246 · Cited by 109
DirecFormer: A Directed Attention in Transformer Approach to Robust Action Recognition
Truong, T.-D., Bui, Q.-H., Duong, C. N., Seo, H., Phung, S. L., Li, X., & Luu, K. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01940 · Cited by 108
Split, Embed and Merge: An accurate table structure recognizer
Zhang, Z., Zhang, J., Du, J., & Wang, F. (2022) · Pattern Recognition · doi:10.1016/j.patcog.2022.108565 · Cited by 107
Skeleton-Aided Articulated Motion Generation
Yan, Y., Xu, J., Ni, B., Zhang, W., & Yang, X. (2017) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3123266.3123277 · Cited by 107
Fisher Vectors Derived from Hybrid Gaussian-Laplacian Mixture Models for Image Annotation
Klein, B., Lev, G., Sadeh, G., & Wolf, L. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.7399 · Cited by 69
Deep Neural Network Based Inertial Odometry Using Low-Cost Inertial Measurement Units
Chen, C., Lu, C. X., Wahlström, J., Markham, A., & Trigoni, N. (2019) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2019.2960780 · Cited by 106
What is the Role of Recurrent Neural Networks (RNNs) in an Image Caption Generator?
Tanti, M., Gatt, A., & Camilleri, K. P. (2017) · International Conference on Natural Language Generation · doi:10.18653/v1/w17-3506 · Cited by 105
Monitoring tool usage in surgery videos using boosted convolutional and recurrent neural networks
Hajj, H. A., Lamard, M., Conze, P.-H., Cochener, B., & Quellec, G. (2018) · Medical Image Analysis · doi:10.1016/j.media.2018.05.001 · Cited by 105
Adversarial Inference for Multi-Sentence Video Description
Park, J. S., Rohrbach, M., Darrell, T., & Rohrbach, A. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00676 · Cited by 90
Self-citationThird-Eye: A Mobilephone-Enabled Crowdsensing System for Air Quality Monitoring
Liu, L., Liu, W., Zheng, Y., Ma, H., & Zhang, C. (2018) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3191752 · Cited by 104
Spatio-Temporal Manifold Learning for Human Motions via Long-Horizon Modeling
Wang, H., Ho, E. S. L., Shum, H. P. H., & Zhu, Z. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2019.2936810 · Cited by 104
Temporal Localization of Moments in Video Collections with Natural Language.Preprint
Escorcia, V. A., Soldan, M., Šivic, J., Ghanem, B., & Russell, B. C. (2019) · arXiv (Cornell University) · Cited by 104
Video Activity Recognition: State-of-the-Art
Rodríguez-Moreno, I., Martínez‐Otzeta, J. M., Sierra, B., Rodríguez, I., & Jauregi, E. (2019) · Sensors · doi:10.3390/s19143160 · Cited by 103
Audiovisual Transformer with Instance Attention for Audio-Visual Event Localization
Lin, Y.-B., & Wang, Y.-C. F. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-69544-6_17 · Cited by 105
Kang, J., Wang, H., Yuan, F., Wang, Z., Huang, J. Y., & Qiu, T. (2020) · Atmosphere · doi:10.3390/atmos11030246 · Cited by 102
Repetitive assembly action recognition based on object detection and pose estimation
Chen, C., Wang, T., Li, D., & Hong, J. (2020) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2020.04.018 · Cited by 101
SMART Frame Selection for Action Recognition
Gowda, S. N., Rohrbach, M., & Sevilla-Lara, L. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i2.16235 · Cited by 101
Self-citationNandhini, M., Kala, K. U., Thangadarshini, M., & Verma, S. M. (2022) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2022.106915 · Cited by 101
Liang, W., Pei, H., Cai, Q., & Wang, Y. (2020) · Neurocomputing · doi:10.1016/j.neucom.2018.10.108 · Cited by 100
Miao, R., Gao, Y., Ge, L., Jiang, Z., & Zhang, J. (2019) · Computers in Industry · doi:10.1016/j.compind.2019.07.005 · Cited by 100
Manifesting construction activity scenes via image captioning
Huan, L., Wang, G., Huang, T., He, P., Skitmore, M., & Luo, X. (2020) · Automation in Construction · doi:10.1016/j.autcon.2020.103334 · Cited by 100
Zhang, C., Zhao, Y., Yan, T., Bai, X., Xiao, Q., Gao, P., Li, M., Huang, W., Bao, Y., He, Y., et al. (2020) · Infrared Physics & Technology · doi:10.1016/j.infrared.2020.103550 · Cited by 100
Activity Recognition for Ambient Assisted Living with Videos, Inertial Units and Ambient Sensors
Ranieri, C. M., MacLeod, S., Dragone, M., Vargas, P. A., & Romero, R. A. F. (2021) · Sensors · doi:10.3390/s21030768 · Cited by 101
Multilingual Image Description with Neural Sequence ModelsPreprint
Elliott, D., Frank, S., & Hasler, E. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1510.04709 · Cited by 100
I3D-LSTM: A New Model for Human Action Recognition
Wang, X., Miao, Z., Zhang, R., & Hao, S. (2019) · IOP Conference Series Materials Science and Engineering · doi:10.1088/1757-899x/569/3/032035 · Cited by 98
PET/CT based cross-modal deep learning signature to predict occult nodal metastasis in lung cancer
Zhong, Y., Cai, C., Chen, T., Gui, H., Deng, J., Yang, M., Yu, B., Song, Y., Wang, T., Sun, X., et al. (2023) · Nature Communications · doi:10.1038/s41467-023-42811-4 · Cited by 99
Mehta, N. K., Prasad, S. S., Saurav, S., Saini, R., & Singh, S. (2022) · Applied Intelligence · doi:10.1007/s10489-022-03200-4 · Cited by 97
Generalized Rank Pooling for Activity Recognition
Cherian, A., Fernando, B., Harandi, M. T., & Gould, S. J. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.172 · Cited by 99
Yengera, G., Mutter, D., Marescaux, J., & Padoy, N. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.08569 · Cited by 97
Data augmentation for self-paced motor imagery classification with C-LSTM.
Freer, D., & Yang, G.-Z. (2020) · Journal of Neural Engineering · doi:10.1088/1741-2552/ab57c0 · Cited by 96
Performance of statistical and machine learning ensembles for daily temperature downscaling
Li, X., Li, Z., Huang, W., & Zhou, P. (2020) · Theoretical and Applied Climatology · doi:10.1007/s00704-020-03098-3 · Cited by 97
Kong, Y., Huang, Q., Wang, C., Chen, J., Chen, J., & He, D. (2018) · Remote Sensing · doi:10.3390/rs10030452 · Cited by 95
A survey on deep neural network-based image captioning
Liu, X., Xu, Q., & Wang, N. (2018) · The Visual Computer · doi:10.1007/s00371-018-1566-y · Cited by 95
Predicting performances in business processes using deep neural networks
Park, G., & Song, M. (2019) · Decision Support Systems · doi:10.1016/j.dss.2019.113191 · Cited by 95
Predicting Aircraft Trajectories: A Deep Generative Convolutional Recurrent Neural Networks ApproachPreprint
Liu, Y., & Hansen, M. M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.11670 · Cited by 95
Attentive Explanations: Justifying Decisions and Pointing to the Evidence
Park, D. H., Hendricks, L. A., Akata, Z., Schiele, B., Darrell, T. J., & Rohrbach, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.04757 · Cited by 51
Self-citationReconstruct and Represent Video Contents for Captioning via Reinforcement Learning
Zhang, W., Wang, B., Ma, L., & Liu, W. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2920899 · Cited by 93
STA-CNN: Convolutional Spatial-Temporal Attention Learning for Action Recognition
Yang, H., Yuan, C., Zhang, L., Sun, Y., Hu, W., & Maybank, S. J. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2984904 · Cited by 93
Lee, D., & Kim, K. (2020) · Renewable Energy · doi:10.1016/j.renene.2020.12.021 · Cited by 93
Miladinovic, D., Muheim, C., Bauer, S., Spinnler, A., Noaín, D., Bandarabadi, M., Gallusser, B., Krummenacher, G., Baumann, C. R., Adamantidis, A., et al. (2019) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006968 · Cited by 92
Zhao, J., Bao, W., Zhang, F., Zhu, S., Liu, Y., Lu, H., Shen, M., & Ye, Z. (2018) · Aquaculture · doi:10.1016/j.aquaculture.2018.04.064 · Cited by 91
Driver Fatigue Detection Based on Facial Key Points and LSTM
Chen, L., Xin, G., Liu, Y., & Huang, J. (2021) · Security and Communication Networks · doi:10.1155/2021/5383573 · Cited by 93
Data-Driven single image deraining: A Comprehensive review and new perspectives
Zhang, Z., Wei, Y., Zhang, H., Yang, Y., Yan, S., & Wang, M. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.109740 · Cited by 92
Lai, S., Jin, L., & Yang, W. (2017) · IAPR International Conference on Document Analysis and Recognition (ICDAR) · doi:10.1109/icdar.2017.73 · Cited by 91
Facial expression recognition based on a multi-task global-local network
Yu, M., Zheng, H., Peng, Z., Dong, J., & Du, H. (2020) · Pattern Recognition Letters · doi:10.1016/j.patrec.2020.01.016 · Cited by 90
Efficient and compact face descriptor for driver drowsiness detection
Moujahid, A., Dornaika, F., Arganda‐Carreras, I., & Reta, J. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.114334 · Cited by 91
Detecting motorcycle helmet use with deep learning
Siebert, F. W., & Lin, H. (2019) · Accident Analysis & Prevention · doi:10.1016/j.aap.2019.105319 · Cited by 92
Learnability and semantic universals
Steinert‐Threlkeld, S., & Szymanik, J. (2019) · Semantics and Pragmatics · doi:10.3765/sp.12.4 · Cited by 90
Bilgera, C., Yamamoto, A., Sawano, M., Matsukura, H., & Ishida, H. (2018) · Sensors · doi:10.3390/s18124484 · Cited by 88
Temporal Reasoning Graph for Activity Recognition
Zhang, J., Shen, F., Xu, X., & Shen, H. T. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2985219 · Cited by 88
Gong, J., Ma, H., Teng, Z., Teng, Q., Zhang, H., Du, L., Chen, S., Bhuiyan, M. Z. A., Li, J., & Liu, M. (2020) · IEEE Access · doi:10.1109/access.2020.2972751 · Cited by 87
Interactive Prototype Learning for Egocentric Action Recognition
Wang, X., Zhu, L., Wang, H., & Yang, Y. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00806 · Cited by 87
From Images to Sentences through Scene Description Graphs using Commonsense Reasoning and Knowledge
Aditya, S., Yang, Y., Baral, C. R., Fermüller, C., & Aloimonos, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.03292 · Cited by 48
Facial Expression Recognition of Instructor Using Deep Features and Extreme Learning Machine
Bhatti, Y. K., Jamil, A., Nida, N., Yousaf, M. H., Viriri, S., & Velastín, S. A. (2021) · Computational Intelligence and Neuroscience · doi:10.1155/2021/5570870 · Cited by 86
Omnidirectional Motion Classification With Monostatic Radar System Using Micro-Doppler Signatures
Yang, Y., Hou, C., Lang, Y., Sakamoto, T., He, Y., & Xiang, W. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2958178 · Cited by 83
Transferable Representation Learning in Vision-and-Language Navigation
Huang, H., Jain, V., Mehta, H., Ku, A., Magalhaes, G., Baldridge, J., & Ie, E. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00750 · Cited by 82
Classification of Multiple Sclerosis Clinical Profiles via Graph Convolutional Neural Networks
Marzullo, A., Kocevar, G., Stamile, C., Durand‐Dubief, F., Terracina, G., Calimeri, F., & Sappey‐Marinier, D. (2019) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.00594 · Cited by 82
Deep learning model for forecasting COVID-19 outbreak in Egypt
Marzouk, M. M., Elshaboury, N., Abdel-Latif, A., & Azab, S. (2021) · Process Safety and Environmental Protection · doi:10.1016/j.psep.2021.07.034 · Cited by 82
Deep Learning in Diverse Intelligent Sensor Based Systems
Zhu, Y., Wang, M., Yin, X., Zhang, J., Meijering, E. H. W., & Hu, J. (2022) · Sensors · doi:10.3390/s23010062 · Cited by 84
Two-stream spatio-temporal GCN-transformer networks for skeleton-based action recognition
Chen, D., Chen, M., Wu, P., Wu, M., Zhang, T., & Li, C. (2025) · Scientific Reports · doi:10.1038/s41598-025-87752-8 · Cited by 83
Deep motifs and motion signatures
Aristidou, A., Cohen‐Or, D., Hodgins, J. K., Chrysanthou, Y., & Shamir, A. (2018) · ACM Transactions on Graphics · doi:10.1145/3272127.3275038 · Cited by 82
Video-based Human Action Recognition using Deep Learning: A ReviewPreprint
Pham, H., Khoudour, L., Crouzil, A., Zegers, P., & Velastín, S. A. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2208.03775 · Cited by 83
Colar: Effective and Efficient Online Action Detection by Consulting Exemplars
Yang, L., Han, J., & Zhang, D. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00316 · Cited by 81
“Deep-Onto” network for surgical workflow and context recognition
Nakawala, H., Bianchi, R., Pescatori, L. E., COBELLI, O. D., Ferrigno, G., & Momi, E. D. (2018) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-018-1882-8 · Cited by 81
LiveBot: Generating Live Video Comments Based on Visual and Textual Contexts
Ma, S., Cui, L., Dai, D., Wei, F., & Sun, X. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33016810 · Cited by 81
Hierarchically-Attentive RNN for Album Summarization and Storytelling
Yu, L., Bansal, M., & Berg, T. L. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1101 · Cited by 81
Walking Gait Phase Detection Based on Acceleration Signals Using LSTM-DNN Algorithm
Zhen, T., Yan, L., & Yuan, P. (2019) · Algorithms · doi:10.3390/a12120253 · Cited by 64
Alami, N., Meknassi, M., En-Nahnahi, N., Adlouni, Y. E., & Ammor, O. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.114652 · Cited by 81
Multi-Stream Deep Neural Networks for RGB-D Egocentric Action Recognition
Tang, Y., Wang, Z., Lu, J., Feng, J., & Zhou, J. (2019) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2875441 · Cited by 71
Park, S.-Y., & Ahn, J. (2020) · Acta Astronautica · doi:10.1016/j.actaastro.2020.08.019 · Cited by 80
Automatic Arabic Image Captioning using RNN-LSTM-Based Language Model and CNN
Almuzaini, H. A., Tasniem, N., & Benhidour, H. (2018) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2018.090610 · Cited by 80
CIFAR10 to Compare Visual Recognition Performance between Deep Neural Networks and HumansPreprint
Ho-Phuoc, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.07270 · Cited by 81
Mathematical Introduction to Deep Learning: Methods, Implementations, and TheoryPreprint
Jentzen, A., Kuckuck, B., & von Wurstemberger, P. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.20360 · Cited by 81
Metadata
- Authors
- Donahue, J., Hendricks, L. A., Rohrbach, M., Venugopalan, S., Guadarrama, S., Saenko, K., & Darrell, T.
- Affiliations
- University of California, Berkeley (US)
- International Computer Science Institute (US)
- The University of Texas at Austin (US)
- University of Massachusetts Lowell (US)
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2017-04-01
- Volume
- 39
- Issue
- 4
- Pages
- 677-691
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2508429489
- Cited by
- 1,547
- References
- 78
- Citations by year
- 2026: 46 · 2025: 79 · 2024: 111 · 2023: 164 · 2022: 202 · 2021: 250 · 2020: 227 · 2019: 225 · 2018: 149 · 2017: 70
- FWCI
- 102.49
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
- PubMed (publishedVersion)
- Funders
- DARPA's
- MSEE
- SMISC
- NSF (IIS-1427425, IIS-1212798)
- Berkeley Vision and Learning Center
- NVIDIA
- FITweltweit-Program
- German Academic Exchange Service (DAAD)
- NDSEG
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Keywords
- long-term recurrent convolutional network, activity recognition, image captioning, audio description, long-range dependencies, temporal dynamics, compositional representations, end-to-end learning, visual description generation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.