Long-Term Recurrent Convolutional Networks for Visual Recognition and Description
The DOI matches its Crossref record; 76 of the 78 references it cites were found in a registry or an index.
Abstract
Models based on deep convolutional networks have dominated recent image interpretation tasks; we investigate whether models which are also recurrent are effective for tasks involving sequences, visual and otherwise. We describe a class of recurrent convolutional architectures which is end-to-end trainable and suitable for large-scale visual understanding tasks, and demonstrate the value of these models for activity recognition, image captioning, and video description. In contrast to previous models which assume a fixed visual representation or perform simple temporal averaging for sequential processing, recurrent convolutional models are "doubly deep" in that they learn compositional representations in space and time. Learning long-term dependencies is possible when nonlinearities are incorporated into the network state updates. Differentiable recurrent models are appealing in that they can directly map variable-length inputs (e.g., videos) to variable-length outputs (e.g., natural language text) and can model complex temporal dynamics; yet they can be optimized with backpropagation. Our recurrent sequence models are directly connected to modern visual convolutional network models and can be jointly trained to learn temporal dynamics and convolutional perceptual representations. Our results show that such models have distinct advantages over state-of-the-art models for recognition or generation which are separately defined or optimized.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Cited by
Items 101–200 of 1,001
Recurrent inception convolution neural network for multi short-term load forecasting
Kim, J., Moon, J., Hwang, E., & Kang, P. (2019) · Energy and Buildings · doi:10.1016/j.enbuild.2019.04.034 · Cited by 210
Understanding Hidden Memories of Recurrent Neural Networks
Ming, Y., Cao, S., Zhang, R., Li, Z., Chen, Y., Song, Y., & Qu, H. (2017) · 2017 IEEE Conference on Visual Analytics Science and Technology (VAST) · doi:10.1109/vast.2017.8585721 · Cited by 207
FOIL it! Find One mismatch between Image and Language caption
Shekhar, R., Pezzelle, S., Klimovich, Y., Herbelot, A., Nabi, M., Sangineto, E., & Bernardi, R. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1024 · Cited by 58
FERV39k: A Large-Scale Multi-Scene Dataset for Facial Expression Recognition in Videos
Wang, Y., Sun, Y., Huang, Y., Liu, Z., Gao, S., Zhang, W., Ge, W., & Zhang, W. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.02025 · Cited by 203
Language Models for Image Captioning: The Quirks and What Works
Devlin, J., Cheng, H., Fang, H., Gupta, S., Deng, L., He, X., Zweig, G., & Mitchell, M. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 2: Short Papers) · doi:10.3115/v1/p15-2017 · Cited by 201
Incorporating Global Visual Features into Attention-based Neural Machine Translation.
Calixto, I., & Liu, Q. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1105 · Cited by 155
Li, G., Huang, Y., Chen, Z., Chesser, G. D., Purswell, J. L., Linhoss, J., & Zhao, Y. (2021) · Sensors · doi:10.3390/s21041492 · Cited by 197
Yıldırım, D. C., Toroslu, I. H., & Fiore, U. (2021) · Financial Innovation · doi:10.1186/s40854-020-00220-2 · Cited by 196
Deep phenotyping: deep learning for temporal phenotype/genotype classification
Taghavi Namin, S., Esmaeilzadeh, M., Najafi, M., Brown, T. B., & Borevitz, J. O. (2018) · Plant Methods · doi:10.1186/s13007-018-0333-4 · Cited by 195
Valan, M., Makonyi, K., Maki, A., Vondráček, D., & Ronquist, F. (2019) · Systematic Biology · doi:10.1093/sysbio/syz014 · Cited by 194
To Compress or Not to Compress—Self-Supervised Learning and Information Theory: A Review
Shwartz-Ziv, R., & LeCun, Y. (2024) · Entropy · doi:10.3390/e26030252 · Cited by 195
Wu, Y., & Wang, G. (2018) · International Journal of Molecular Sciences · doi:10.3390/ijms19082358 · Cited by 193
Guided Open Vocabulary Image Captioning with Constrained Beam Search
Anderson, P., Fernando, B., Johnson, M., & Gould, S. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1098 · Cited by 193
Papadomanolaki, M., Vakalopoulou, M., & Karantzalos, K. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3055584 · Cited by 193
Early detection of sepsis utilizing deep learning on electronic health record event sequences
Lauritsen, S. M., Kalør, M. E., Kongsgaard, E. L., Lauritsen, K. M., Jørgensen, M. J., Lange, J., & Thiesson, B. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2020.101820 · Cited by 190
Dynamic Sign Language Recognition Based on Video Sequence With BLSTM-3D Residual Networks
Liao, Y., Xiong, P., Min, W., Min, W., & Lu, J. (2019) · IEEE Access · doi:10.1109/access.2019.2904749 · Cited by 189
Reliable Real‐Time Seismic Signal/Noise Discrimination With Machine Learning
Meier, M., Ross, Z. E., Ramachandran, A., Balakrishna, A., Nair, S., Kundzicz, P., Li, Z., Andrews, J. R., Hauksson, E., & Yue, Y. (2018) · Journal of Geophysical Research Solid Earth · doi:10.1029/2018jb016661 · Cited by 187
Deep learning the dynamic appearance and shape of facial action units
Jaiswal, S., & Valstar, M. (2016) · 2016 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2016.7477625 · Cited by 157
Automated radiology report generation using conditioned transformers
Alfarghaly, O., Khaled, R., Elkorany, A., Helal, M., & Fahmy, A. (2021) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2021.100557 · Cited by 183
Localizing Moments in Video with Temporal Language
Hendricks, L. A., Wang, O., Shechtman, E., Šivic, J., Darrell, T., & Russell, B. C. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1168 · Cited by 183
Self-citationTARN: Temporal Attentive Relation Network for Few-Shot and Zero-Shot Action RecognitionPreprint
Bishay, M., Zoumpourlis, G., & Patras, I. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.09021 · Cited by 183
Multi-modal Dense Video Captioning
lashin, V., & Rahtu, E. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00487 · Cited by 182
Listen, Attend, and Walk: Neural Mapping of Navigational Instructions to Action Sequences
Mei, H., Bansal, M., & Walter, M. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10364 · Cited by 180
Widget Captioning: Generating Natural Language Description for Mobile User Interface Elements
Li, Y., Li, G., He, L., Zheng, J., Li, H., & Guan, Z. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.443 · Cited by 180
Recurrent neural networks for classifying relations in clinical notes
Luo, Y. (2017) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.07.006 · Cited by 152
Video Processing Using Deep Learning Techniques: A Systematic Literature Review
Sharma, V., Gupta, M., Kumar, A., & Mishra, D. (2021) · IEEE Access · doi:10.1109/access.2021.3118541 · Cited by 178
Image Caption with Global-Local Attention
Li, L., Tang, S., Deng, L., Zhang, Y., & Tian, Q. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11236 · Cited by 155
Kim, J., & Chi, S. (2019) · Automation in Construction · doi:10.1016/j.autcon.2019.03.025 · Cited by 174
Deep learning for video classification and captioning
Wu, Z., Yao, T., Fu, Y., & Jiang, Y.-G. (2017) · doi:10.1145/3122865.3122867 · Cited by 174
Liu, D., Oczak, M., Maschat, K., Baumgartner, J., Pletzer, B., He, D., & Norton, T. (2020) · Biosystems Engineering · doi:10.1016/j.biosystemseng.2020.04.007 · Cited by 172
Hendricks, L. A., Hu, R., Darrell, T., & Akata, Z. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01216-8_17 · Cited by 171
Self-citationA Taxonomy of Deep Convolutional Neural Nets for Computer Vision
Srinivas, S., Sarvadevabhatla, R. K., Mopuri, K. R., Prabhu, N., Kruthiventi, S. S. S., & Babu, R. V. (2016) · Frontiers in Robotics and AI · doi:10.3389/frobt.2015.00036 · Cited by 171
ASFormer: Transformer for Action Segmentation
Yi, F., Wen, H., & Jiang, T. (2021) · Proceedings of the British Machine Vision Conference 2021 · doi:10.5244/c.35.49 · Cited by 170
Sparse Adversarial Perturbations for Videos
Wei, X., Zhu, J., Yuan, S., & Su, H. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33018973 · Cited by 170
MeMViT: Memory-Augmented Multiscale Vision Transformer for Efficient Long-Term Video Recognition
Wu, C.-Y., Li, Y., Mangalam, K., Fan, H., Xiong, B., Malik, J., & Feichtenhofer, C. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01322 · Cited by 168
Sequence-to-sequence neural net models for grapheme-to-phoneme conversion
Yao, K., & Zweig, G. (2015) · Interspeech (USB) · doi:10.21437/interspeech.2015-134 · Cited by 168
StNet: Local and Global Spatial-Temporal Modeling for Action Recognition
He, D., Zhou, Z., Gan, C., Li, F., Liu, X., Li, Y., Wang, L., & Wen, S. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33018401 · Cited by 143
Recurrent Neural Networks: An Embedded Computing Perspective
Rezk, N. M., Purnaprajna, M., Nordström, T., & Ul-Abdin, Z. (2020) · IEEE Access · doi:10.1109/access.2020.2982416 · Cited by 168
Spatial Memory for Context Reasoning in Object Detection
Chen, X., & Gupta, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.440 · Cited by 167
Learning Like a Child: Fast Novel Visual Concept Learning from Sentence Descriptions of Images
Mao, J., Wei, X., Yang, Y., Wang, J., Huang, Z., & Yuille, A. L. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.291 · Cited by 148
DeeperBind: Enhancing prediction of sequence specificities of DNA binding proteins
Hassanzadeh, H. R., & Wang, M. D. (2016) · 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm.2016.7822515 · Cited by 143
CATARACTS: Challenge on automatic tool annotation for cataRACT surgery
Hajj, H. A., Lamard, M., Conze, P.-H., Roychowdhury, S., Hu, X., Maršalkaitė, G., Zisimopoulos, O., Dedmari, M. A., Zhao, F., Prellberg, J., et al. (2018) · Medical Image Analysis · doi:10.1016/j.media.2018.11.008 · Cited by 169
RSI-CB: A Large-Scale Remote Sensing Image Classification Benchmark Using Crowdsourced Data
Li, H., Dou, X., Tao, C., Wu, Z., Chen, J., Peng, J., Deng, M., & Zhao, L. (2020) · Sensors · doi:10.3390/s20061594 · Cited by 166
Action-Stage Emphasized Spatiotemporal VLAD for Video Action Recognition
Tu, Z., Li, H., Zhang, D., Dauwels, J., Li, B., & Yuan, J. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2890749 · Cited by 166
Stay on the Path: Instruction Fidelity in Vision-and-Language Navigation
Jain, V., Magalhaes, G., Ku, A., Vaswani, A., Ie, E., & Baldridge, J. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1181 · Cited by 165
Learning visual relationship and context-aware attention for image captioning
Wang, J., Wang, W., Wang, L., Wang, Z., Feng, D. D., & Tan, T. N. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.107075 · Cited by 166
Måløy, H., Aamodt, A., & Misimi, E. (2019) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2019.105087 · Cited by 165
Trends in Integration of Vision and Language Research: A Survey of Tasks, Datasets, and Methods
Mogadala, A., Kalimuthu, M., & Klakow, D. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11688 · Cited by 47
Deep learning reservoir porosity prediction based on multilayer long short-term memory network
Chen, W., Yang, L., Zha, B., Zhang, M., & Chen, Y. (2020) · Geophysics · doi:10.1190/geo2019-0261.1 · Cited by 164
A Survey on Multi-View ClusteringPreprint
Chao, G., Sun, S., & Bi, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.06246 · Cited by 162
What Do We Understand About Convolutional Networks?Preprint
Hadji, I., & Wildes, R. P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.08834 · Cited by 165
Late Temporal Modeling in 3D CNN Architectures with BERT for Action Recognition
Kalfaoglu, M. E., Kalkan, S., & Alatan, A. A. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-68238-5_48 · Cited by 161
Xiong, Z., Nash, M. P., Cheng, E., Fedorov, V. V., Stiles, M. K., & Zhao, J. (2018) · Physiological Measurement · doi:10.1088/1361-6579/aad9ed · Cited by 161
Ward, T. M., Mascagni, P., Ban, Y., Rosman, G., Padoy, N., Meireles, O., & Hashimoto, D. A. (2021) · Surgery · doi:10.1016/j.surg.2020.10.039 · Cited by 160
Deep Learning Enables Automatic Classification of Emphysema Pattern at CT
Humphries, S. M., Notary, A. M., Centeno, J. P., Strand, M. J., Crapo, J. D., Silverman, E. K., Lynch, D. A., & For the Genetic Epidemiology of COPD (COPDGene) Investigators (2020) · Radiology · doi:10.1148/radiol.2019191022 · Cited by 160
Qiu, C., Mou, L., Schmitt, M., & Zhu, X. X. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.05.004 · Cited by 159
Smoke Detection on Video Sequences Using 3D Convolutional Neural Networks
Lin, G., Zhang, Y., Gao, X., & Zhang, Q. (2019) · Fire Technology · doi:10.1007/s10694-019-00832-w · Cited by 159
Exploring global diverse attention via pairwise temporal relation for video summarization
Li, P., Ye, Q., Zhang, L., Yuan, L., Xu, X., & Shao, L. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107677 · Cited by 159
Meghanani, A., Anoop, C. S., & Ramakrishnan, A. G. (2021) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt48900.2021.9383491 · Cited by 159
Weakly-Supervised Alignment of Video with Text
Bojanowski, P., Lajugie, R., Grave, E., Bach, F., Laptev, I., Ponce, J., & Schmid, C. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.507 · Cited by 111
CAM-RNN: Co-Attention Model Based RNN for Video Captioning
Zhao, B., Li, X., & Lu, X. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2916757 · Cited by 155
DB-LSTM: Densely-connected Bi-directional LSTM for human action recognition
He, J.-Y., Wu, X. Y., Cheng, Z.-Q., Yuan, Z., & Jiang, Y. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.05.118 · Cited by 153
Deep learning for brain disorder diagnosis based on fMRI images
Yin, W., Li, L., & Wu, F. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.05.113 · Cited by 152
Two-stream RNN/CNN for action recognition in 3D videos
Zhao, R., Ali, H., & van der Smagt, P. (2017) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206288 · Cited by 151
Language Models for Image Captioning: The Quirks and What Works
Devlin, J., Cheng, H., Fang, H., Gupta, S., Deng, L., He, X., Zweig, G., & Mitchell, M. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.01809 · Cited by 97
Deep learning: definition and perspectives for thoracic imaging
Chassagnon, G., Vakalopolou, M., Nikos Paragios, A., & Revel, M. (2019) · European Radiology · doi:10.1007/s00330-019-06564-3 · Cited by 148
Classification of SAR and PolSAR images using deep learning: a review
Parikh, H., Patel, S., & Patel, V. D. (2019) · International Journal of Image and Data Fusion · doi:10.1080/19479832.2019.1655489 · Cited by 144
Genze, N., Bharti, R., Grieb, M., Schultheiß, S. J., & Grimm, D. G. (2020) · Plant Methods · doi:10.1186/s13007-020-00699-x · Cited by 144
Gautam, A., Panwar, M., Biswas, D., & Acharyya, A. (2020) · IEEE Journal of Translational Engineering in Health and Medicine · doi:10.1109/jtehm.2020.2972523 · Cited by 142
A Review on Computer Vision-Based Methods for Human Action Recognition
Al-Faris, M., Chiverton, J. P., Ndzi, D. L., & Ahmed, A. I. (2020) · Journal of Imaging · doi:10.3390/jimaging6060046 · Cited by 142
Deep Hierarchical Encoder–Decoder Network for Image Captioning
Xiao, X., Wang, L., Ding, K., Xiang, S., & Pan, C. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2915033 · Cited by 141
Conditional DQN-Based Motion Planning With Fuzzy Logic for Autonomous Driving
Chen, L. F., Hu, X., Tang, B., & Cheng, Y. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3025671 · Cited by 141
Andreas, J., Klein, D., & Levine, S. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1197 · Cited by 74
A hybrid CNN-LSTM model for pre-miRNA classification
Taşdelen, A., & Şen, B. (2021) · Scientific Reports · doi:10.1038/s41598-021-93656-0 · Cited by 140
Medical image captioning via generative pretrained transformers
Selivanov, A., Rogov, O. Y., Chesakov, D., Shelmanov, A., Fedulova, I., & Dylov, D. V. (2023) · Scientific Reports · doi:10.1038/s41598-023-31223-5 · Cited by 107
Early prediction of epileptic seizures using a long-term recurrent convolutional network
Wei, X., Zhou, L., Zhang, Z., Chen, Z., & Zhou, Y. (2019) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2019.108395 · Cited by 139
Rajpurkar, P., Park, A., Irvin, J., Chute, C., Bereket, M., Mastrodicasa, D., Langlotz, C. P., Lungren, M. P., Ng, A. Y., & Patel, B. N. (2020) · Scientific Reports · doi:10.1038/s41598-020-61055-6 · Cited by 123
Tovar, M., Robles, M., & Rashid, F. (2020) · Energies · doi:10.3390/en13246512 · Cited by 138
MultiNet++: Multi-Stream Feature Aggregation and Geometric Loss Strategy for Multi-Task Learning
Chennupati, S., Sistu, G., Yogamani, S., & Rawashdeh, S. A. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00159 · Cited by 86
Multi-camera vision-based productivity monitoring of earthmoving operations
Kim, J., & Chi, S. (2020) · Automation in Construction · doi:10.1016/j.autcon.2020.103121 · Cited by 137
Automatic Modulation Classification Based on Deep Learning for Unmanned Aerial Vehicles
Zhang, D., Ding, W., Zhang, B., Xie, C., Li, H., Han, J., & Li, H. (2018) · Sensors · doi:10.3390/s18030924 · Cited by 136
Sarma, D., & Bhuyan, M. K. (2021) · SN Computer Science · doi:10.1007/s42979-021-00827-x · Cited by 137
Explaining and Interpreting LSTMs
Arras, L., Arjona-Medina, J., Widrich, M., Montavon, G., Gillhofer, M., Müller, K.-R., Hochreiter, S., & Samek, W. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-28954-6_11 · Cited by 135
EleAtt-RNN: Adding Attentiveness to Neurons in Recurrent Neural Networks
Zhang, P., Xue, J., Lan, C., Zeng, W., Gao, Z., & Zheng, N. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2937724 · Cited by 133
TextRS: Deep Bidirectional Triplet Network for Matching Text to Remote Sensing Images
Abdullah, T., Bazi, Y., Rahhal, M. M. A., Mekhalfi, M. L., Rangarajan, L., & Zuair, M. (2020) · Remote Sensing · doi:10.3390/rs12030405 · Cited by 134
Real-Time System for Driver Fatigue Detection Based on a Recurrent Neuronal Network
Ed-doughmi, Y., Idrissi, N., & Hbali, Y. (2020) · Journal of Imaging · doi:10.3390/jimaging6030008 · Cited by 133
Prediction of Pseudoprogression versus Progression using Machine Learning Algorithm in Glioblastoma
Jang, B., Jeon, S. H., Kim, I. H., & Kim, I. A. (2018) · Scientific Reports · doi:10.1038/s41598-018-31007-2 · Cited by 132
Weakly supervised classification of aortic valve malformations using unlabeled cardiac MRI sequences
Fries, J. A., Varma, P., Chen, V. S., Xiao, K., Tejeda, H., Saha, P., Dunnmon, J., Chubb, H., Maskatia, S., Fiterau, M., et al. (2019) · Nature Communications · doi:10.1038/s41467-019-11012-3 · Cited by 103
A Survey on Biomedical Image Captioning
Pavlopoulos, J., Kougia, V., & Androutsopoulos, I. (2019) · Proceedings of the Second Workshop on Shortcomings in Vision and Language · doi:10.18653/v1/w19-1803 · Cited by 92
CASNet: A Cross-Attention Siamese Network for Video Salient Object Detection
Ji, Y., Zhang, H., Jie, Z., Ma, L., & Wu, Q. M. J. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3007534 · Cited by 133
Learning Contextual Dependence With Convolutional Hierarchical Recurrent Neural Networks
Zuo, Z. C., Shuai, B., Wang, G., Liu, X., Wang, X., Wang, B., & Chen, Y. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2548241 · Cited by 130
Collaborative Spatiotemporal Feature Learning for Video Action Recognition
Li, C., Zhong, Q., Xie, D., & Pu, S. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00806 · Cited by 131
Compressing Recurrent Neural Networks with Tensor Ring for Action Recognition
Pan, Y. R., Xu, J., Wang, M., Ye, J., Wang, F., Bai, K., & Xu, Z. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33014683 · Cited by 130
Human Action Recognition by Learning Spatio-Temporal Features With Deep Neural Networks
Wang, L., Xu, Y., Cheng, J. S., Xia, H., Yin, J., & Wu, J. (2018) · IEEE Access · doi:10.1109/access.2018.2817253 · Cited by 129
Sharma, A., Liu, X., & Yang, X. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.05.019 · Cited by 128
Hawkes processes for events in social media
Rizoiu, M.-A., Lee, Y., Mishra, S., & Xie, L. (2017) · doi:10.1145/3122865.3122874 · Cited by 128
Xing, Y., Caterina, G. D., & Soraghan, J. J. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.590164 · Cited by 127
Smart gas sensor arrays powered by artificial intelligence
Chen, Z., Chen, Z., Song, Z., Ye, W., & Fan, Z. (2019) · Journal of Semiconductors · doi:10.1088/1674-4926/40/11/111601 · Cited by 126
On-the-Fly Finger-Vein-Based Biometric Recognition Using Deep Neural Networks
Kuzu, R. S., Piciucco, E., Maiorana, E., & Campisi, P. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2020.2971144 · Cited by 124
Hu, M. Q., Wang, H., Wang, X., Yang, J., & Wang, R. (2018) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2018.12.039 · Cited by 123
Metadata
- Authors
- Donahue, J., Hendricks, L. A., Rohrbach, M., Venugopalan, S., Guadarrama, S., Saenko, K., & Darrell, T.
- Affiliations
- University of California, Berkeley (US)
- International Computer Science Institute (US)
- The University of Texas at Austin (US)
- University of Massachusetts Lowell (US)
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2017-04-01
- Volume
- 39
- Issue
- 4
- Pages
- 677-691
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2508429489
- Cited by
- 1,547
- References
- 78
- Citations by year
- 2026: 46 · 2025: 79 · 2024: 111 · 2023: 164 · 2022: 202 · 2021: 250 · 2020: 227 · 2019: 225 · 2018: 149 · 2017: 70
- FWCI
- 102.49
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
- PubMed (publishedVersion)
- Funders
- DARPA's
- MSEE
- SMISC
- NSF (IIS-1427425, IIS-1212798)
- Berkeley Vision and Learning Center
- NVIDIA
- FITweltweit-Program
- German Academic Exchange Service (DAAD)
- NDSEG
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Keywords
- long-term recurrent convolutional network, activity recognition, image captioning, audio description, long-range dependencies, temporal dynamics, compositional representations, end-to-end learning, visual description generation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.