Long-Term Recurrent Convolutional Networks for Visual Recognition and Description
The DOI matches its Crossref record; 76 of the 78 references it cites were found in a registry or an index.
Abstract
Models based on deep convolutional networks have dominated recent image interpretation tasks; we investigate whether models which are also recurrent are effective for tasks involving sequences, visual and otherwise. We describe a class of recurrent convolutional architectures which is end-to-end trainable and suitable for large-scale visual understanding tasks, and demonstrate the value of these models for activity recognition, image captioning, and video description. In contrast to previous models which assume a fixed visual representation or perform simple temporal averaging for sequential processing, recurrent convolutional models are "doubly deep" in that they learn compositional representations in space and time. Learning long-term dependencies is possible when nonlinearities are incorporated into the network state updates. Differentiable recurrent models are appealing in that they can directly map variable-length inputs (e.g., videos) to variable-length outputs (e.g., natural language text) and can model complex temporal dynamics; yet they can be optimized with backpropagation. Our recurrent sequence models are directly connected to modern visual convolutional network models and can be jointly trained to learn temporal dynamics and convolutional perceptual representations. Our results show that such models have distinct advantages over state-of-the-art models for recognition or generation which are separately defined or optimized.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Cited by
Items 401–500 of 1,001
Long short‐term memory networks for proton dose calculation in highly heterogeneous tissues
Neishabouri, A., Wahl, N., Mairani, A., Köthe, U., & Bangert, M. (2020) · Medical Physics · doi:10.1002/mp.14658 · Cited by 56
Adversarial Bipartite Graph Learning for Video Domain Adaptation
Luo, Y., Huang, Z. H., Wang, Z., Zhang, Z., & Baktashmotlagh, M. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413897 · Cited by 56
Li, J., Zhang, L., Johnson-Buck, A. E., & Walter, N. G. (2020) · Nature Communications · doi:10.1038/s41467-020-19673-1 · Cited by 56
Alibabaei, K., Gaspar, P. D., & Lima, T. M. (2021) · Applied Sciences · doi:10.3390/app11115029 · Cited by 56
Yao, L., Wang, X., Zhang, J., Yu, X., Zhang, S., & Li, Q. (2023) · Remote Sensing · doi:10.3390/rs15184486 · Cited by 55
ARCH: Adaptive recurrent-convolutional hybrid networks for long-term action recognition
Xin, M., Zhang, H., Wang, H., Sun, M., & Yuan, D. (2015) · Neurocomputing · doi:10.1016/j.neucom.2015.09.112 · Cited by 55
A Joint Framework for Athlete Tracking and Action Recognition in Sports Videos
Kong, L., Huang, D., Qin, J., & Wang, Y. (2019) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2019.2893318 · Cited by 55
RGB-D Fall Detection via Deep Residual Convolutional LSTM Networks
Abobakr, A., Hossny, M., Abdelkader, H., & Nahavandi, S. (2018) · International Conference on Digital Image Computing: Techniques and Applications (DICTA) · doi:10.1109/dicta.2018.8615759 · Cited by 55
Temporal Hockey Action Recognition via Pose and Optical Flows
Cai, Z., Neher, H., Vats, K., Clausi, D. A., & Zelek, J. (2019) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00310 · Cited by 55
Audio–visual representation learning for anomaly events detection in crowds
Gao, J., Yang, H., Gong, M., & Li, X. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127489 · Cited by 54
Neural aesthetic image reviewer
Wang, W., Yang, S., Zhang, W., & Zhang, J. (2019) · IET Computer Vision · doi:10.1049/iet-cvi.2019.0361 · Cited by 54
Mimic The Raw Domain: Accelerating Action Recognition in the Compressed Domain
Battash, B., Barad, H., Tang, H., & Bleiweiss, A. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00350 · Cited by 54
Privacy-preserving Time-series Medical Images Analysis Using a Hybrid Deep Learning Framework
Yue, Z., Ding, S., Zhao, L., Zhang, Y., Cao, Z., Tanveer, M., Jolfaei, A., & Zheng, X. (2021) · ACM Transactions on Internet Technology · doi:10.1145/3383779 · Cited by 49
A novel deep U-Net-LSTM framework for time-sequenced hydrodynamics prediction of the SUBOFF AFF-8
Hou, Y., Li, H., Chen, H., Wei, W., Wang, J., & Huang, Y. (2022) · Engineering Applications of Computational Fluid Mechanics · doi:10.1080/19942060.2022.2030802 · Cited by 53
Action Recognition From Thermal Videos
Batchuluun, G., Nguyen, D. T., Pham, T. D., Park, C., & Park, K. R. (2019) · IEEE Access · doi:10.1109/access.2019.2931804 · Cited by 53
Deep Learning-Based Phenotyping System With Glocal Description of Plant Anomalies and Symptoms
Fuentes, A., Yoon, S., & Park, D. S. (2019) · Frontiers in Plant Science · doi:10.3389/fpls.2019.01321 · Cited by 53
Driving behavior explanation with multi-level fusion
Ben-younes, H., Zablocki, É., Pérez, P., & Cord, M. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.108421 · Cited by 52
Challenges and Prospects in Vision and Language Research
Kafle, K., Shrestha, R., & Kanan, C. (2019) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2019.00028 · Cited by 52
Visual Scene Understanding for Autonomous Driving Using Semantic Segmentation
Hofmarcher, M., Unterthiner, T., Arjona-Medina, J., Klambauer, G., Hochreiter, S., & Nessler, B. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-28954-6_15 · Cited by 51
Estimating workability of concrete with different strength grades based on deep learning
Liu, Y., An, X., & Du, S. (2021) · Measurement · doi:10.1016/j.measurement.2021.110073 · Cited by 51
Bodily Behaviors in Social Interaction: Novel Annotations and State-of-the-Art Evaluation
Balážia, M., Müller, P., Tánczos, Á. L., von Liechtenstein, A., & Brémond, F. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3548363 · Cited by 51
Sharma, D., Dhiman, C., & Kumar, D. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.119773 · Cited by 51
Image Captioning with Bidirectional Semantic Attention-Based Guiding of Long Short-Term Memory
Cao, P., Yang, Z., Sun, L., Liang, Y., Yang, M. Q., & Guan, R. (2019) · Neural Processing Letters · doi:10.1007/s11063-018-09973-5 · Cited by 51
Dense semantic embedding network for image captioning
Xiao, X., Wang, L., Ding, K., Xiang, S., & Pan, C. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.01.028 · Cited by 51
Recurrent Attention Network with Reinforced Generator for Visual Dialog
Fan, H., Zhu, L., Yang, Y., & Wu, F. Q. (2020) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3390891 · Cited by 51
Incorporating external knowledge for image captioning using CNN and LSTM
Sharma, H., & Jalal, A. S. (2020) · Modern Physics Letters B · doi:10.1142/s0217984920503157 · Cited by 51
Monitoring of Assembly Process Using Deep Learning Technology
Chen, C., Zhang, C., Wang, T., Li, D., Guo, Y., Zhao, Z., & Hong, J. (2020) · Sensors · doi:10.3390/s20154208 · Cited by 51
STA-TSN: Spatial-Temporal Attention Temporal Segment Network for action recognition in video
Yang, Y., Yang, Y., Lu, Z., Yang, J., Liu, D., Zhou, C., & Fan, Z.-E. (2022) · PLoS ONE · doi:10.1371/journal.pone.0265115 · Cited by 51
Explainable heat demand forecasting for the novel control strategies of district heating systems
Zdravković, M. M., Ciric, I. S., & Ignjatović, M. (2022) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2022.03.009 · Cited by 51
Spatiotemporal prediction of microstructure evolution with predictive recurrent neural network
Farizhandi, A. A. K., & Mamivand, M. (2023) · Computational Materials Science · doi:10.1016/j.commatsci.2023.112110 · Cited by 50
Batchuluun, G., Yoon, H. S., Kang, J. K., & Park, K. R. (2018) · IEEE Access · doi:10.1109/access.2018.2876890 · Cited by 50
Multitask Learning to Improve Egocentric Action Recognition
Kapidis, G., Poppe, R. W., van Dam, E., Noldus, L. P. J. J., & Veltkamp, R. C. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00540 · Cited by 50
Zou, J., Balter, J. M., & Cao, Y. (2020) · Medical Physics · doi:10.1002/mp.14222 · Cited by 50
Deep Learning-Based Real-Time Multiple-Person Action Recognition System
Tsai, J.-K., Hsu, C.-C. J., Wang, W., & Huang, S.-K. (2020) · Sensors · doi:10.3390/s20174758 · Cited by 50
Abdi, A. H., Luong, C. L., Tsang, T. S. M., Jue, J., Gin, K., Yeung, D. F., Hawley, D., Rohling, R. N., & Abolmaesumi, P. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-66179-7_35 · Cited by 50
Coupled Auto-Associative Neural Networks for Heterogeneous Face Recognition
Riggan, B. S., Reale, C., & Nasrabadi, N. M. (2015) · IEEE Access · doi:10.1109/access.2015.2479620 · Cited by 49
Leveraging Structural Context Models and Ranking Score Fusion for Human Interaction Prediction
Ke, Q., Bennamoun, M., An, S., Sohel, F., & Boussaïd, F. (2017) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2778559 · Cited by 49
Biosignals learning and synthesis using deep neural networks
Belo, D., Rodrigues, J., Vaz, J. R., Pezarat‐Correia, P., & Gamboa, H. F. S. (2017) · BioMedical Engineering OnLine · doi:10.1186/s12938-017-0405-0 · Cited by 49
Multi-Pixel Simultaneous Classification of PolSAR Image Using Convolutional Neural Networks
Wang, L., Xu, X., Dong, H., Gui, R., & Pu, F. (2018) · Sensors · doi:10.3390/s18030769 · Cited by 49
Non-linear Temporal Subspace Representations for Activity Recognition
Cherian, A., Sra, S., Gould, S. J., & Hartley, R. I. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00234 · Cited by 49
A Double-Deep Spatio-Angular Learning Framework for Light Field-Based Face Recognition
Sepas‐Moghaddam, A., Haque, M. A., Correia, P. L., Nasrollahi, K., Moeslund, T. B., & Pereira, F. M. B. (2019) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2019.2916669 · Cited by 49
Comprehensive Instructional Video Analysis: The COIN Dataset and Performance Evaluation
Tang, Y., Lu, J., & Zhou, J. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2980824 · Cited by 42
Chen, S., Wang, Z., & Chen, W. (2020) · Information · doi:10.3390/info12010003 · Cited by 49
Diagnosis of ulcerative colitis from endoscopic images based on deep learning
Luo, X., Zhang, J., Li, Z., & Yang, R. (2021) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2021.103443 · Cited by 49
Automatic prediction of presentation style and student engagement from videos
Thomas, C., Sarma, K. A. V. P., Gajula, S. S., & Jayagopi, D. B. (2022) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2022.100079 · Cited by 47
Deep Learning for Image-Based Plant Growth Monitoring: A Review
Tong, Y.-S., Lee, T.-H., & Yen, K. S. (2022) · International Journal of Engineering and Technology Innovation · doi:10.46604/ijeti.2022.8865 · Cited by 47
CDFi: Cross-Domain Action Recognition Using WiFi Signals
Sheng, B., Han, R., Cai, H., Xiao, F., Gui, L., & Guo, Z. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3348939 · Cited by 48
Jeong, S., Yu, H., Park, S.-H., Woo, D., Lee, S.-J., Chong, G. O., Han, H. S., & Kim, J. (2024) · Scientific Reports · doi:10.1038/s41598-024-51742-z · Cited by 47
Sign Language Detection “in the Wild” with Recurrent Neural Networks
Borg, M., & Camilleri, K. P. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683257 · Cited by 36
Efficient Parallel Inflated 3D Convolution Architecture for Action Recognition
Huang, Y., Guo, Y., & Gao, C. (2020) · IEEE Access · doi:10.1109/access.2020.2978223 · Cited by 47
WiTransformer: A Novel Robust Gesture Recognition Sensing Model with WiFi
Yang, M., Zhu, H., Zhu, R., Wu, F., Yin, L., & Yang, Y. (2023) · Sensors · doi:10.3390/s23052612 · Cited by 46
Academic Emotion Classification Using FER: A Systematic Review
Lek, J. X.-Y., & Teo, J. (2023) · Human Behavior and Emerging Technologies · doi:10.1155/2023/9790005 · Cited by 47
Altimeter Observation-Based Eddy Nowcasting Using an Improved Conv-LSTM Network
Ma, C., Li, S., Wang, A., Yang, J., & Chen, G. (2019) · Remote Sensing · doi:10.3390/rs11070783 · Cited by 46
MERTA: micro-expression recognition with ternary attentions
Yang, B., Cheng, J., Yang, Y., Zhang, B., & Li, J. (2019) · Multimedia Tools and Applications · doi:10.1007/s11042-019-07896-4 · Cited by 46
Learning Deep Representations for Video-Based Intake Gesture Detection
Rouast, P. V., & Adam, M. T. P. (2019) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2019.2942845 · Cited by 46
Hu, X., Tang, B., Chen, L. F., Song, S., & Tong, X. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3004984 · Cited by 46
Wu, L., Yang, Z., Wang, Q., Jian, M., Zhao, B., Yan, J., & Chen, C. W. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.07.003 · Cited by 47
Hyperparameter Optimization for COVID-19 Pneumonia Diagnosis Based on Chest CT
Lacerda, P., Barros, B., Albuquerque, C. V. N., & Conci, A. (2021) · Sensors · doi:10.3390/s21062174 · Cited by 46
Wang, W. Y., & Wen, M. (2015) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/v1/n15-1039 · Cited by 46
Qin, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.08414 · Cited by 46
Multi-modal Dense Video Captioning
Iashin, V., & Rahtu, E. (2020) · Tampere University Institutional Repository (Tampere University) · doi:10.48550/arxiv.2003.07758 · Cited by 46
CNN-LSTM Model for Recognizing Video-Recorded Actions Performed in a Traditional Chinese Exercise
Chen, J., Wang, J., Yuan, Q., & Zhao, Y. (2023) · IEEE Journal of Translational Engineering in Health and Medicine · doi:10.1109/jtehm.2023.3282245 · Cited by 46
Multi-View Gait Recognition Based on a Spatial-Temporal Deep Neural Network
Tong, S., Fu, Y., Yue, X., & Ling, H. (2018) · IEEE Access · doi:10.1109/access.2018.2874073 · Cited by 45
Arbitrary-View Human Action Recognition: A Varying-View RGB-D Action Dataset
Ji, Y., Yang, Y., Shen, F., Shen, H. T., & Zheng, W. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.2975845 · Cited by 45
Diverse Image Captioning with Context-Object Split Latent Spaces
Mahajan, S., & Roth, S. (2020) · TUbilio (Technical University of Darmstadt) · doi:10.48550/arxiv.2011.00966 · Cited by 45
Appending Adversarial Frames for Universal Video Attack
Chen, Z., Xie, L., Pang, S., He, Y., & Tian, Q. C. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00324 · Cited by 45
FEXNet: Foreground Extraction Network for Human Action Recognition
Shen, Z., Wu, X., & Xu, T. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3103677 · Cited by 45
Air quality changes in China 2013–2020: Effectiveness of clean coal technology policies
Zhang, B., Wang, S., Wang, D., Wang, Q., Yang, X., & Tong, R. (2022) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2022.132961 · Cited by 45
A Review of Transformer-Based Approaches for Image Captioning
Ondeng, O., Absaloms, H. O., & Akuon, P. O. (2023) · Applied Sciences · doi:10.3390/app131911103 · Cited by 44
Li, J., Liang, W., Yin, X., Li, J., & Guan, W. (2023) · Sensors · doi:10.3390/s23229101 · Cited by 45
Image Captioning with Affective Guiding and Selective Attention
Wang, A., Hu, H., & Yang, L. (2018) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3226037 · Cited by 44
Semantic Image Networks for Human Action Recognition
Khowaja, S. A., & Lee, S.-L. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-019-01248-3 · Cited by 44
Indoor human activity recognition using high-dimensional sensors and deep neural networks
Vandersmissen, B., Knudde, N., Jalalvand, A., Couckuyt, I., Dhaene, T., & Neve, W. D. (2019) · Neural Computing and Applications · doi:10.1007/s00521-019-04408-1 · Cited by 44
A Deep Machine Learning Method for Concurrent and Interleaved Human Activity Recognition
Thapa, K., Al, Z. M. A., Lamichhane, B., & Yang, S. (2020) · Sensors · doi:10.3390/s20205770 · Cited by 44
Shipman, R., Roberts, R., Waldron, J., Naylor, S., Pinchin, J., Rodrigues, L. T., & Gillott, M. (2021) · Energy · doi:10.1016/j.energy.2021.119813 · Cited by 44
Multibeat echocardiographic phase detection using deep neural networks
Lane, E. S., Azarmehr, N., Jevsikov, J., Howard, J. P., Shun-Shin, M. J., Cole, G. D., Francis, D. P., & Zolgharni, M. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104373 · Cited by 44
Spatial–temporal pooling for action recognition in videos
Wang, J., Shao, Z., Huang, X., Lü, T., Zhang, R., & Lv, X. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.04.071 · Cited by 44
Automated soccer head impact exposure tracking using video and deep learning
Rezaei, A., & Wu, L. C. (2022) · Scientific Reports · doi:10.1038/s41598-022-13220-2 · Cited by 44
Recurrent Convolutional Networks for Pulmonary Nodule Detection in CT ImagingPreprint
Ypsilantis, P.-P., & Montana, G. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.09143 · Cited by 45
Goyal, R., Kumar, P., & Singh, V. P. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-15224-0 · Cited by 43
Lunga, D., Yang, H. L., Reith, A., Weaver, J. E., Yuan, J., & Bhaduri, B. (2018) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2018.2795753 · Cited by 43
Long Activity Video Understanding Using Functional Object-Oriented Network
Jelodar, A. B., Paulius, D., & Sun, Y. M. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2018.2885228 · Cited by 43
Jiang, J., Liu, X., Liu, L., Wang, S., Long, E., Yang, H., Yuan, F., Yu, D., Zhang, K., Wang, L., et al. (2018) · PLoS ONE · doi:10.1371/journal.pone.0201142 · Cited by 43
E2‐capsule neural networks for facial expression recognition using AU‐aware attention
Cao, S., Yao, Y., & An, G. (2020) · IET Image Processing · doi:10.1049/iet-ipr.2020.0063 · Cited by 43
Miao, R., Jiang, Z., Zhou, Q., Wu, Y., Gao, Y., Zhang, J., & Jiang, Z. (2021) · Machine Vision and Applications · doi:10.1007/s00138-020-01158-2 · Cited by 43
Hierarchical Temporal Attention Network for Thyroid Nodule Recognition Using Dynamic CEUS Imaging
Wan, P., Chen, F., Liu, C., Kong, W., & Zhang, D. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2021.3063421 · Cited by 43
A comprehensive review of the video-to-text problem
Perez-Martin, J., Bustos, B., Guimarães, S. J. F., Sipiran, I., Pérez, J. E. P., & Said, G. C. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10104-1 · Cited by 43
Cyclic Gate Recurrent Neural Networks for Time Series Data with Missing Values
Weerakody, P. B., Wong, K. W., & Wang, G. (2022) · Neural Processing Letters · doi:10.1007/s11063-022-10950-2 · Cited by 44
Ice hockey player identification via transformers and weakly supervised learning
Vats, K., McNally, W., Walters, P., Clausi, D. A., & Zelek, J. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00389 · Cited by 43
Sridharan, V., Tuo, M., & Li, X. (2022) · Energies · doi:10.3390/en15207606 · Cited by 43
Speech Emotion Recognition Using CNN-LSTM and Vision Transformer
Kumar, C. S. A., Maharana, A. D., Krishnan, S. M., Hanuma, S. S. S., Lal, G. J., & Ravi, V. (2023) · Lecture notes in networks and systems · doi:10.1007/978-3-031-27499-2_8 · Cited by 43
Hajj, H. A., Lamard, M., Charrière, K., Cochener, B., & Quellec, G. (2017) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2017.8037244 · Cited by 43
Speaking the Same Language: Matching Machine to Human Captions by Adversarial TrainingPreprint
Shetty, R., Rohrbach, M., Hendricks, L. A., Fritz, M., & Schiele, B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.10476 · Cited by 43
Self-citationHuman Motion prediction based on attention mechanism
Sang, H.-F., Chen, Z.-Z., & He, D.-K. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-019-08269-7 · Cited by 42
Qin, C., Cheng, J. S., Liu, Z., Ren, Z., & Liu, J. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.123061 · Cited by 42
Transfer Learning for Handwriting Recognition on Historical Documents
Granet, A., Morin, E., Mouchère, H., Quiniou, S., & Viard-Gaudin, C. (2018) · International Conference on Pattern Recognition Applications and Methods · doi:10.5220/0006598804320439 · Cited by 42
CineAD: a system for automated audio description script generation for the visually impaired
Campos, V. P., de Araújo, T. M. U., Filho, G. L. D. S., & Gonçalves, L. M. G. (2018) · Universal Access in the Information Society · doi:10.1007/s10209-018-0634-4 · Cited by 42
Semantic referee: A neural-symbolic framework for enhancing geospatial semantic segmentation
Alirezaie, M., Längkvist, M., Sioutis, M., & Loutfi, A. (2019) · Semantic Web · doi:10.3233/sw-190362 · Cited by 41
Temporal Bilinear Networks for Video Action Recognition
Li, Y., Song, S., Li, Y., & Liu, J. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33018674 · Cited by 42
Beyan, C., Zunino, A., Shahid, M., & Murino, V. (2019) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2019.2944614 · Cited by 42
Metadata
- Authors
- Donahue, J., Hendricks, L. A., Rohrbach, M., Venugopalan, S., Guadarrama, S., Saenko, K., & Darrell, T.
- Affiliations
- University of California, Berkeley (US)
- International Computer Science Institute (US)
- The University of Texas at Austin (US)
- University of Massachusetts Lowell (US)
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2017-04-01
- Volume
- 39
- Issue
- 4
- Pages
- 677-691
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2508429489
- Cited by
- 1,547
- References
- 78
- Citations by year
- 2026: 46 · 2025: 79 · 2024: 111 · 2023: 164 · 2022: 202 · 2021: 250 · 2020: 227 · 2019: 225 · 2018: 149 · 2017: 70
- FWCI
- 102.49
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
- PubMed (publishedVersion)
- Funders
- DARPA's
- MSEE
- SMISC
- NSF (IIS-1427425, IIS-1212798)
- Berkeley Vision and Learning Center
- NVIDIA
- FITweltweit-Program
- German Academic Exchange Service (DAAD)
- NDSEG
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Keywords
- long-term recurrent convolutional network, activity recognition, image captioning, audio description, long-range dependencies, temporal dynamics, compositional representations, end-to-end learning, visual description generation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.