Long-Term Recurrent Convolutional Networks for Visual Recognition and Description
The DOI matches its Crossref record; 76 of the 78 references it cites were found in a registry or an index.
Abstract
Models based on deep convolutional networks have dominated recent image interpretation tasks; we investigate whether models which are also recurrent are effective for tasks involving sequences, visual and otherwise. We describe a class of recurrent convolutional architectures which is end-to-end trainable and suitable for large-scale visual understanding tasks, and demonstrate the value of these models for activity recognition, image captioning, and video description. In contrast to previous models which assume a fixed visual representation or perform simple temporal averaging for sequential processing, recurrent convolutional models are "doubly deep" in that they learn compositional representations in space and time. Learning long-term dependencies is possible when nonlinearities are incorporated into the network state updates. Differentiable recurrent models are appealing in that they can directly map variable-length inputs (e.g., videos) to variable-length outputs (e.g., natural language text) and can model complex temporal dynamics; yet they can be optimized with backpropagation. Our recurrent sequence models are directly connected to modern visual convolutional network models and can be jointly trained to learn temporal dynamics and convolutional perceptual representations. Our results show that such models have distinct advantages over state-of-the-art models for recognition or generation which are separately defined or optimized.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Cited by
Items 701–800 of 1,001
Cell mitosis event analysis in phase contrast microscopy images using deep learning
Mao, Y., Liang, H., & Yin, Z. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.06.011 · Cited by 25
Fine-Grained Action Recognition in Assembly Work Scenes by Drawing Attention to the Hands
Kobayashi, T., Aoki, Y., Shimizu, S., Kusano, K., & Okumura, S. (2019) · International Conference on Signal-Image Technology & Internet-Based Systems (SITIS) · doi:10.1109/sitis.2019.00077 · Cited by 25
An Automatic System for Atrial Fibrillation by Using a CNN-LSTM Model
Ma, F., Zhang, J., Chen, W., Liang, W. G., & Yang, W. (2020) · Discrete Dynamics in Nature and Society · doi:10.1155/2020/3198783 · Cited by 25
Adaptive Attention-based High-level Semantic Introduction for Image Caption
Liu, X., & Xu, Q. (2020) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3409388 · Cited by 25
Shi, P., Zhao, Z., Liu, K., & Li, F. (2022) · Journal of Computational Design and Engineering · doi:10.1093/jcde/qwac011 · Cited by 25
Exploiting long-term temporal dynamics for video captioning
Guo, Y., Zhang, J., & Gao, L. (2018) · World Wide Web · doi:10.1007/s11280-018-0530-0 · Cited by 25
Long-Term Recurrent Convolutional Network-based Inertia Estimation using Ambient Measurements
Tuo, M., & Li, X. (2022) · IEEE Industry Applications Society Annual Meeting (IAS) · doi:10.1109/ias54023.2022.9940112 · Cited by 25
Neural Self Talk: Image Understanding via Continuous Questioning and AnsweringPreprint
Yang, Y., Li, Y., Fermuller, C. M., & Aloimonos, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.03460 · Cited by 25
Bilkhu, M., Wang, S., & Dobhal, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.02792 · Cited by 25
Learning language through picturesPreprint
Chrupała, G., Kádár, Á., & Alishahi, A. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.03694 · Cited by 25
INTEGRATION OF ARTIFICIAL NEURAL NETWORKS AND KNOWLEDGE BASES
Golovko, V. A., Голенков, В. В., Ivashenko, V. P., Taberko, V., product», J. «., Ivniuk, D., product», J. «., Kroshchanka, A., & Kovalev, M. (2018) · Ontology of Designing · doi:10.18287/2223-9537-2018-8-3-366-386 · Cited by 24
Knowledge Integration Networks for Action Recognition
Zhang, S., Guo, S., Wang, L., Huang, W., & Scott, M. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6983 · Cited by 24
Employing automatic content recognition for teaching methodology analysis in classroom videos
Rafique, M. A., Khaskheli, F., Hassan, M. T., Naseer, S., & Jeon, M. (2022) · PLoS ONE · doi:10.1371/journal.pone.0263448 · Cited by 25
Adaptive Multi-Modal Fusion Framework for Activity Monitoring of People With Mobility Disability
Lin, F., Wang, Z., Zhao, H., Qiu, S., Shi, X., Wu, L., Gravina, R., & Fortino, G. (2022) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2022.3168004 · Cited by 24
A Short Video Classification Framework Based on Cross-Modal Fusion
Pang, N., Guo, S., Yan, M. G., & Chan, C. A. (2023) · Sensors · doi:10.3390/s23208425 · Cited by 24
Modeling coverage with semantic embedding for image caption generation
Jiang, T., Zhang, Z., & Yang, Y. (2018) · The Visual Computer · doi:10.1007/s00371-018-1565-z · Cited by 24
Yu, H., Pan, G., Pan, M., Li, C., Jia, W., Zhang, L., & Sun, M. (2019) · Sensors · doi:10.3390/s19030546 · Cited by 24
Context-aware Cascade Attention-based RNN for Video Emotion Recognition
Sun, M.-C., Hsu, S.-H., Yang, M.-C., & Chien, J.-H. (2018) · Asian Conference on Affective Computing and Intelligent Interaction (ACII Asia) · doi:10.1109/aciiasia.2018.8470372 · Cited by 24
Action and Object Interaction Recognition for Driver Activity Classification
Weyers, P., Schiebener, D., & Kummert, A. (2019) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2019.8917139 · Cited by 24
Evaluating the progress of deep learning for visual relational concepts
Stabinger, S., Peer, D., Piater, J., & Rodríguez-Sánchez, A. J. (2021) · Journal of Vision · doi:10.1167/jov.21.11.8 · Cited by 24
Embedded vision system for monitoring arc welding with thermal imaging and deep learning
Martínez, A. F., Souto-López, Á., González, C. G., & Méndez-Rial, R. (2020) · IEEE International Conference on Omni-layer Intelligent Systems (COINS) · doi:10.1109/coins49042.2020.9191650 · Cited by 24
CAM: A fine-grained vehicle model recognition method based on visual attention model
Yu, Y., Xu, L., Jia, W., Zhu, W., Fu, Y., & Lü, Q. (2020) · Image and Vision Computing · doi:10.1016/j.imavis.2020.104027 · Cited by 24
Video-based driver action recognition via hybrid spatial–temporal deep learning framework
Hu, Y., Lu, M., Xie, C., & Lu, X. (2021) · Multimedia Systems · doi:10.1007/s00530-020-00724-y · Cited by 24
A study on attention-based LSTM for abnormal behavior recognition with variable pooling
Zhou, K., Hui, B., Wang, J., Wang, C., & Wu, T. (2021) · Image and Vision Computing · doi:10.1016/j.imavis.2021.104120 · Cited by 24
Cheng, Y., Shi, Q., Huang, X., Wang, L., He, Y., Li, B., Zhao, W., & Qian, D. (2022) · European Radiology · doi:10.1007/s00330-022-09031-8 · Cited by 24
Learning facial action units with spatiotemporal cues and multi-label sampling
Chu, W.-S., la Torre, F. D., & Cohn, J. F. (2018) · Image and Vision Computing · doi:10.1016/j.imavis.2018.10.002 · Cited by 23
Wang, Y., Gong, N., & Fu, C. (2021) · Journal of Integrative Neuroscience · doi:10.31083/j.jin2004098 · Cited by 23
Hybrid Spatiotemporal Contrastive Representation Learning for Content-Based Surgical Video Retrieval
Kumar, V., Tripathi, V., Pant, B., Alshamrani, S. S., Dumka, A., Gehlot, A., Singh, R., Rashid, M. U., Alshehri, A., & AlGhamdi, A. S. (2022) · Electronics · doi:10.3390/electronics11091353 · Cited by 23
Relation between PM2.5 and O3 over Different Urban Environmental Regimes in India
Yadav, R. K., Gadhavi, H., Arora, A., Mohbey, K. K., Kumar, S., Lal, S., & Mallik, C. (2023) · Urban Science · doi:10.3390/urbansci7010009 · Cited by 23
Visual attention framework for identifying semantic information from construction monitoring video
Zhong, B., Shen, L., Pan, X., & Lei, L. (2023) · Safety Science · doi:10.1016/j.ssci.2023.106122 · Cited by 23
Ihsan, M. A., Eram, A. F., Nahar, L., & Kadir, M. A. (2024) · IEEE Access · doi:10.1109/access.2024.3370684 · Cited by 23
Investigation of Small Group Social Interactions Using Deep Visual Activity-Based Nonverbal Features
Beyan, C., Shahid, M., & Murino, V. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240685 · Cited by 23
Multiview Semantic Representation for Visual Recognition
Zhang, C., Cheng, J., & Tian, Q. (2018) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2875728 · Cited by 23
Research on automatic target detection and recognition based on deep learning
Wang, J., Liu, C., Fu, T. F., & Zheng, L. (2019) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2019.01.017 · Cited by 23
Code2vect: An efficient heterogenous data classifier and nonlinear regression technique
Martín, C. A., Ibáñez, R., Barasinski, A., & Chinesta, F. (2019) · Comptes Rendus Mécanique · doi:10.1016/j.crme.2019.11.002 · Cited by 23
Image Classification and Object Detection Algorithm Based on Convolutional Neural Network
Group of Network Computation, D. O. M. A. C., & Leonard, J. K. (2019) · Science Insights · doi:10.15354/si.19.re117 · Cited by 23
Soundr: Head Position and Orientation Prediction Using a Microphone Array
Yang, J., Banerjee, G., Gupta, V., Lam, M. S., & Landay, J. A. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376427 · Cited by 23
Video sketch: A middle-level representation for action recognition
Zhang, X., Huang, Y., Mi, Y., Pei, Y., Zou, Q., & Wang, S. (2020) · Applied Intelligence · doi:10.1007/s10489-020-01905-y · Cited by 23
Jiang, Z., & Shi, X.-T. (2021) · Complexity · doi:10.1155/2021/6620425 · Cited by 23
Enhancing Descriptive Image Captioning with Natural Language Inference
Shi, Z., Liu, H., & Zhu, X. (2021) · doi:10.18653/v1/2021.acl-short.36 · Cited by 23
de Sá, S. L., Rocha, A. A. D. A., & Paes, A. (2021) · Sensors · doi:10.3390/s21217328 · Cited by 23
Askari, M. R., Rashid, M. M., Sun, X., Sevil, M., Shahidehpour, A., Kawaji, K., & Çınar, A. (2022) · BioMedInformatics · doi:10.3390/biomedinformatics2020019 · Cited by 23
Large-Scale Traffic Congestion Prediction based on Multimodal Fusion and Representation Mapping
Zhou, B., Liu, J., Cui, S., & Zhao, Y. (2022) · IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa54385.2022.10032443 · Cited by 23
Content-based Video Indexing and Retrieval Using Corr-LDAPreprint
Iyer, R. R., Parekh, S., Mohandoss, V., Ramsurat, A., Raj, B., & Singh, R. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.08581 · Cited by 23
Joint Surgical Gesture and Task Classification with Multi-Task and Multimodal LearningPreprint
Sarıkaya, D., Guru, K. A., & Corso, J. J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.00721 · Cited by 23
Machine Learning Approaches for Speech-Based Alzheimer’s Detection: A Comprehensive Survey
Sharafeldeen, A., Keowen, J., & Shaffie, A. (2025) · Computers · doi:10.3390/computers14020036 · Cited by 23
Hu, T., Lei, Y., Su, J., Yang, H., Ni, W., Gao, C., Yu, J., Wang, Y., & Gu, Y. (2021) · International Journal of Neuroscience · doi:10.1080/00207454.2021.1929214 · Cited by 22
Li, M., Liu, Z., Huang, L., & Zhu, P. (2022) · Engineering Computations · doi:10.1108/ec-06-2021-0353 · Cited by 22
Yan, F., Silamu, W., Li, Y., & Chai, Y. (2022) · The Visual Computer · doi:10.1007/s00371-022-02524-z · Cited by 22
Liu, Y. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.968023 · Cited by 22
Using cascade CNN-LSTM-FCNs to identify AI-altered video based on eye state sequence
Saealal, M. S., Ibrahim, M. Z., Mulvaney, D. J., Shapiai, M. I., & Fadilah, N. (2022) · PLoS ONE · doi:10.1371/journal.pone.0278989 · Cited by 22
Human Activity Recognition for AI-Enabled Healthcare Using Low-Resolution Infrared Sensor Data
Karayaneva, Y., Sharifzadeh, S., Jing, Y., & Tan, B. (2023) · Sensors · doi:10.3390/s23010478 · Cited by 22
Intra-person multi-task learning method for chronic-disease prediction
Kim, G., Lim, H., Kim, Y., Kwon, O., & Choi, J. (2023) · Scientific Reports · doi:10.1038/s41598-023-28383-9 · Cited by 22
Prakash, V. G., Kohli, M., Prathosh, A. P., Juneja, M., Gupta, M., Sairam, S., Sitaraman, S., Bangalore, A., Kommu, J. V. S., Saini, L. K., et al. (2023) · Expert Systems · doi:10.1111/exsy.13253 · Cited by 22
Enhanced Spatial Stream of Two-Stream Network Using Optical Flow for Human Action Recognition
Khan, S. A., Hassan, A., Hussain, F., Perwaiz, A., Riaz, F., Alsabaan, M., & Abdul, W. (2023) · Applied Sciences · doi:10.3390/app13148003 · Cited by 22
A deep learning pipeline for Indian dance style classification
Dewan, S., Agarwal, S., & Singh, N. (2018) · International Conference on Machine Vision · doi:10.1117/12.2309445 · Cited by 22
Moving Foreground-Aware Visual Attention and Key Volume Mining for Human Action Recognition
Zhang, J., Hu, H., & Lu, X. (2019) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3321511 · Cited by 22
Martin, T., Peralta, M., Gilmore, G., Sauleau, P., Haegelen, C., Jannin, P., & Baxter, J. S. H. (2021) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2021.102529 · Cited by 22
Busy-Quiet Video Disentangling for Video Classification
Huang, G., & Borş, A. G. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00083 · Cited by 22
Mass Spectral Substance Detections Using Long Short-Term Memory Networks
Liu, J., Zhang, J., Luo, Y., Yang, S., Wang, J., & Fu, Q. (2019) · IEEE Access · doi:10.1109/access.2019.2891548 · Cited by 22
Deep Convolutional Network with Long Short-Term Memory Layers for Dynamic Gesture Recognition
Siriak, R., Skarga-Bandurova, I., & Boltov, Y. (2019) · IEEE International Conference on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications (IDAACS) · doi:10.1109/idaacs.2019.8924381 · Cited by 22
Scene Understanding: A Survey to See the World at a Single Glance
Pawar, P. G., & Devendran, V. (2019) · International Conference on Intelligent Communication and Computational Techniques (ICCT) · doi:10.1109/icct46177.2019.8969051 · Cited by 22
Applications of Deep Learning to Nuclear Fusion ResearchPreprint
Ferreira, D. R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.00333 · Cited by 22
Log Message Anomaly Detection and Classification Using Auto-B/LSTM and Auto-GRUPreprint
Farzad, A., & Gulliver, T. A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.08744 · Cited by 22
Khalaf, W. S., Morgan, R. N., & Elkhatib, W. F. (2025) · Journal of Microbiological Methods · doi:10.1016/j.mimet.2025.107125 · Cited by 21
Video Captioning Based on Channel Soft Attention and Semantic Reconstructor
Zhou, L., & Huang, Y. (2021) · Future Internet · doi:10.3390/fi13020055 · Cited by 21
Li, H., Khoo, S., & Yap, H. J. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19031744 · Cited by 21
An LSTM with Differential Structure and Its Application in Action Recognition
Chen, W., Zheng, F., Gao, S., & Hu, K. (2022) · Mathematical Problems in Engineering · doi:10.1155/2022/7316396 · Cited by 21
Acquisitions with random shim values enhance AI-driven NMR shimming
Becker, M., Lehmkuhl, S., Kesselheim, S., Korvink, J. G., & Jouda, M. (2022) · Journal of Magnetic Resonance · doi:10.1016/j.jmr.2022.107323 · Cited by 21
Invariant recognition drives neural representations of action sequences
Tacchetti, A., Işık, L., & Poggio, T. (2017) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005859 · Cited by 21
Autonomous Human Activity Classification From Wearable Multi-Modal Sensors
Lu, Y., & Velipasalar, S. (2019) · IEEE Sensors Journal · doi:10.1109/jsen.2019.2934678 · Cited by 21
Uncovering Human Multimodal Activity Recognition with a Deep Learning Approach
Ranieri, C. M., Vargas, P. A., & Romero, R. A. F. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207255 · Cited by 21
Multi-modal adaptive gated mechanism for visual question answering
Xu, Y., Zhang, L., & Shen, X. (2023) · PLoS ONE · doi:10.1371/journal.pone.0287557 · Cited by 20
Insights into Object Semantics: Leveraging Transformer Networks for Advanced Image Captioning
Hafeth, D. A., & Kollias, S. (2024) · Sensors · doi:10.3390/s24061796 · Cited by 20
Hybrid Deep Learning Approach for Aspect Detection on Reviews
Hùng, B. T., Semwal, V. B., Gaud, N., & Bijalwan, V. (2021) · Algorithms for intelligent systems · doi:10.1007/978-981-33-6307-6_100 · Cited by 20
Comparison of Keras Optimizers for Earthquake Signal Classification Based on Deep Neural Networks
Mustika, I. W., Adi, H. N., & Najib, F. (2021) · International Conference on Information and Communications Technology (ICOIACT) · doi:10.1109/icoiact53268.2021.9563990 · Cited by 20
SPNet: A deep network for broadcast sports video highlight generation
Khan, A. A., & Shao, J. (2022) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2022.107779 · Cited by 20
Paragraph Generation Network with Visual Relationship Detection
Che, W., Xiaopeng Fan, B., Xiong, R., & Zhao, D. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240695 · Cited by 20
Structure-Constrained Motion Sequence Generation
Yan, Y., Ni, B., Zhang, W., Xu, J., & Yang, X. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2018.2885235 · Cited by 20
Enhanced Attention Tracking With Multi-Branch Network for Egocentric Activity Recognition
Liu, T., Lam, K., Zhao, R., & Kong, J. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3104651 · Cited by 20
Generalized Rank Pooling for Activity RecognitionPreprint
Cherian, A., Fernando, B., Harandi, M. T., & Gould, S. J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.02112 · Cited by 20
Unsupervised Motion Representation Learning with Capsule AutoencodersPreprint
Xu, Z., Shen, X., Wong, Y., & Kankanhalli, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.00529 · Cited by 20
Xia, J., & Kiguchi, K. (2021) · IEEE Access · doi:10.1109/access.2021.3124304 · Cited by 19
Paramasivan, K., Subburaj, R., Jaiswal, S., & Sudarsanam, N. (2022) · Humanities and Social Sciences Communications · doi:10.1057/s41599-022-01393-0 · Cited by 19
Behavior detection and evaluation based on multi-frame MobileNet
Liu, L., Wang, X., Bao, Q., & Li, X. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-16150-x · Cited by 19
Enhanced coalbed methane well production prediction framework utilizing the CNN-BL-MHA approach
Li, X., Li, X., Xie, H., Feng, C., Cai, J., & He, Y. (2024) · Scientific Reports · doi:10.1038/s41598-024-65606-z · Cited by 19
Multi-Way adaptive Time Aware LSTM for irregularly collected sequential ICU data
Cissoko, M. B. H., Castelain, V., & Lachiche, N. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.125548 · Cited by 19
Sotomayor-Gómez, B., Battaglia, F. P., & Vinck, M. A. (2025) · Cell Reports · doi:10.1016/j.celrep.2025.115547 · Cited by 19
Research on Agricultural Environment Prediction Based on Deep Learning
Chen, S., Li, B., Cao, J., & Mao, B. (2018) · Procedia Computer Science · doi:10.1016/j.procs.2018.10.214 · Cited by 19
Further Understanding Videos through Adverbs: A New Video Task
Pang, B., Zha, K., Zhang, Y., & Lu, C. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6855 · Cited by 19
Vehicle theft recognition from surveillance video based on spatiotemporal attention
He, L., Wen, S., Wang, L., & Li, F. (2020) · Applied Intelligence · doi:10.1007/s10489-020-01933-8 · Cited by 19
Tong, X., Tan, X., Chen, L., Yang, J., & Zheng, Q. (2020) · International Conference on Hot Information-Centric Networking (HotICN) · doi:10.1109/hoticn50779.2020.9350824 · Cited by 19
A vision-based hand hygiene monitoring approach using self-attention convolutional neural network
Xie, T., Tian, J., & Ma, L. (2022) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2022.103651 · Cited by 19
Practical Skills Demand Forecasting via Representation Learning of Temporal Dynamics
Macedo, M. M. G., Clarke, W., Lucherini, E., Baldwin, T., Neto, D. Q., de Paula, R. A., & Das, S. (2022) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3514094.3534183 · Cited by 19
Image Representations and New Domains in Neural Image Captioning
Hessel, J., Savva, N., & Wilber, M. J. (2015) · Workshop on Vision and Language (VL) · doi:10.18653/v1/w15-2807 · Cited by 19
End-to-end Multiplayer Violence Detection based on Deep 3D CNN
Li, C., Zhu, L., Zhu, D., Chen, J., Pan, Z., Li, X., & Wang, B. (2018) · International Conference Network, Communication and Computing · doi:10.1145/3301326.3301367 · Cited by 19
Park, J., Wen, M., Sung, Y., & Cho, K. (2019) · Sensors · doi:10.3390/s19204456 · Cited by 19
FetNet: a recurrent convolutional network for occlusion identification in fetoscopic videos
Bano, S., Vasconcelos, F., Poorten, E. V., Vercauteren, T. K., Sebastien Ourselin, A., Deprest, J. A., & Stoyanov, D. V. (2020) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-020-02169-0 · Cited by 19
Continuous Molecular Representations of Ionic Liquids
Beckner, W., Ashraf, C. M., Lee, J., Beck, D. A. C., & Pfaendtner, J. (2020) · The Journal of Physical Chemistry B · doi:10.1021/acs.jpcb.0c05938 · Cited by 19
Abnormal Behavior Recognition Based on Key Points of Human Skeleton
Liu, Y., Zhang, S., Li, Z., & Zhang, Y. (2020) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2021.04.120 · Cited by 19
Metadata
- Authors
- Donahue, J., Hendricks, L. A., Rohrbach, M., Venugopalan, S., Guadarrama, S., Saenko, K., & Darrell, T.
- Affiliations
- University of California, Berkeley (US)
- International Computer Science Institute (US)
- The University of Texas at Austin (US)
- University of Massachusetts Lowell (US)
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2017-04-01
- Volume
- 39
- Issue
- 4
- Pages
- 677-691
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2508429489
- Cited by
- 1,547
- References
- 78
- Citations by year
- 2026: 46 · 2025: 79 · 2024: 111 · 2023: 164 · 2022: 202 · 2021: 250 · 2020: 227 · 2019: 225 · 2018: 149 · 2017: 70
- FWCI
- 102.49
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
- PubMed (publishedVersion)
- Funders
- DARPA's
- MSEE
- SMISC
- NSF (IIS-1427425, IIS-1212798)
- Berkeley Vision and Learning Center
- NVIDIA
- FITweltweit-Program
- German Academic Exchange Service (DAAD)
- NDSEG
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Keywords
- long-term recurrent convolutional network, activity recognition, image captioning, audio description, long-range dependencies, temporal dynamics, compositional representations, end-to-end learning, visual description generation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.