The DOI matches its DataCite record; 29 of the 30 references it cites were found in a registry or an index.
Unsupervised Learning of Video Representations using LSTMs
Open accessAbstract
We use multilayer Long Short Term Memory (LSTM) networks to learn representations of video sequences. Our model uses an encoder LSTM to map an input sequence into a fixed length representation. This representation is decoded using single or multiple decoder LSTMs to perform different tasks, such as reconstructing the input sequence, or predicting the future sequence. We experiment with two kinds of input sequences - patches of image pixels and high-level representations ("percepts") of video frames extracted using a pretrained convolutional net. We explore different design choices such as whether the decoder LSTMs should condition on the generated output. We analyze the outputs of the model qualitatively to see how well the model can extrapolate the learned video representation into the future and into the past. We try to visualize and interpret the learned features. We stress test the model by running it on longer time scales and on out-of-domain data. We further evaluate the representations by finetuning them for a supervised learning problem - human action recognition on the UCF-101 and HMDB-51 datasets. We show that the representations help improve classification accuracy, especially when there are only a few training examples. Even models pretrained on unrelated datasets (300 hours of YouTube videos) can help action recognition performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This is the first time that motion prediction with cross-dimensional learning has been used for self-supervised learning in the context of HAR.”
From Self-supervised Human Activity Recognition by Learning to Predict Cross-Dimensional Motion (2021) · cites this paper as [23]
In the citing paper
“While motion prediction has been used in the field of computer vision for self-supervised learning [23, 26], our model is novel in that the cross-dimensional aspect results in more effective learning.”
From Self-supervised Human Activity Recognition by Learning to Predict Cross-Dimensional Motion (2021) · cites this paper as [23]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Two-Stream Convolutional Networks for Action Recognition in Videos
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1406.2199 · Cited by 6,756
Large-Scale Video Classification with Convolutional Neural Networks
Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., & Fei-Fei, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.223 · Cited by 6,354
Show and tell: A neural image caption generator
Vinyals, O., Toshev, A., Bengio, S., & Erhan, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298935 · Cited by 6,318
3D Convolutional Neural Networks for Human Action Recognition
Ji, S., Xu, W., Yang, M., & Yu, K. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.59 · Cited by 6,313
Long-term recurrent convolutional networks for visual recognition and description
Donahue, J., Hendricks, L. A., Guadarrama, S., Rohrbach, M., Venugopalan, S., Darrell, T., & Saenko, K. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298878 · Cited by 5,228
Research works printed but not linked: 1
- Hochreiter, Sepp and Schmidhuber, J¨ urgen. Long short-term memory. Neural Computation , 9(8):1735-1780, 1997.
Cited by
Sorted by citations
Items 501–600 of 1,005
Symbolic pregression: Discovering physical laws from distorted video
Udrescu, S., & Tegmark, M. (2021) · Physical review. E · doi:10.1103/physreve.103.043307 · Cited by 56
Chaotic time series prediction of nonlinear systems based on various neural network models
Sun, Y., Zhang, L., & Yao, M. (2023) · Chaos Solitons & Fractals · doi:10.1016/j.chaos.2023.113971 · Cited by 56
Deep learning for precipitation nowcasting: A survey from the perspective of time series forecasting
An, S., Oh, T.-J., Sohn, E.-H., & Kim, D. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.126301 · Cited by 60
Cubic LSTMs for Video Prediction
Fan, H., Zhu, L., & Yang, Y. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33018263 · Cited by 55
A motion-aware ConvLSTM network for action recognition
Majd, M., & Safabakhsh, R. (2019) · Applied Intelligence · doi:10.1007/s10489-018-1395-8 · Cited by 53
Visual Forecasting by Imitating Dynamics in Natural Sequences
Zeng, K.-H., Shen, W. B., Huang, D.-A., Sun, M., & Niebles, J. C. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.326 · Cited by 55
Multi-Channel Weather Radar Echo Extrapolation with Convolutional Recurrent Neural Networks
Tran, Q.-K., & Song, S.-K. (2019) · Remote Sensing · doi:10.3390/rs11192303 · Cited by 53
Learning Long-Term Temporal Features With Deep Neural Networks for Human Action Recognition
Yu, S., Xie, L., Liu, L., & Xia, D. (2019) · IEEE Access · doi:10.1109/access.2019.2962284 · Cited by 53
Transformation-based Adversarial Video Prediction on Large-Scale DataPreprint
Luc, P., Clark, A., Dieleman, S., Casas, D. D. L., Doron, Y., Cassirer, A., & Simonyan, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.04035 · Cited by 91
Bayesian Adversarial Human Motion Synthesis
Zhao, R., Su, H., & Ji, Q. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00626 · Cited by 52
Ahmad, T., & Wu, J. (2023) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2023.3249152 · Cited by 52
Zhang, Z., Ringeval, F., Han, J., Deng, J., Marchi, E., & Schuller, B. W. (2016) · Interspeech (USB) · doi:10.21437/interspeech.2016-998 · Cited by 52
Advanced Data Exploitation in Speech Analysis: An overview
Zhang, Z., Cummins, N., & Schuller, B. W. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2699358 · Cited by 54
Spatial-temporal pyramid based Convolutional Neural Network for action recognition
Zheng, Z., An, G., Wu, D. O., & Ruan, Q. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.05.058 · Cited by 52
Fu, T.-Y., & Lee, W.-C. (2019) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3357384.3357870 · Cited by 51
Enabling spatio-temporal aggregation in Birds-Eye-View Vehicle Estimation
Saha, A., Méndez, O., Russell, C., & Bowden, R. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561169 · Cited by 52
Li, J., Cui, T., Yang, K., Yuan, R., He, L., & Li, M. (2021) · Sustainability · doi:10.3390/su132313050 · Cited by 53
Long-Short Temporal Contrastive Learning of Video Transformers
Wang, J., Bertasius, G., Tran, D., & Torresani, L. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01362 · Cited by 60
Kiran, B. R., Thomas, D. M., & Parakkal, R. (2018) · Journal of Imaging · doi:10.3390/jimaging4020036 · Cited by 73
Sub-Seasonal Climate Forecasting via Machine Learning: Challenges, Analysis, and Advances
He, S., Li, X., DelSole, T., Ravikumar, P., & Banerjee, A. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i1.16090 · Cited by 51
Zhang, F., He, X., Teng, Q., Wu, X., & Dong, X. (2021) · Journal of Petroleum Science and Engineering · doi:10.1016/j.petrol.2021.109652 · Cited by 51
Temporal Modeling Approaches for Large-scale Youtube-8M Video UnderstandingPreprint
Li, F., Gan, C., Liu, X., Bian, Y., Long, X., Li, Y., Li, Z., Zhou, J., & Wen, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.04555 · Cited by 60
Semi-supervised Federated Learning for Activity RecognitionPreprint
Zhao, Y., Liu, H., Li, H., Barnaghi, P. M., & Haddadi, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.00851 · Cited by 61
SODA10M: A Large-Scale 2D Self/Semi-Supervised Object Detection Dataset for Autonomous DrivingPreprint
Han, J., Liang, X., Xu, H., Chen, K., Hong, L., Mao, J., Ye, C., Zhang, W., Li, Z., Liang, X., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.11118 · Cited by 76
An Improved Inter-Intra Contrastive Learning Framework on Self-Supervised Video Representation
Tao, L., Wang, X., & Yamasaki, T. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3141051 · Cited by 50
Video Imagination from a Single Image with Transformation Generation
Chen, B., Wang, W., & Wang, J. (2017) · Thematic Workshops of ACM Multimedia · doi:10.1145/3126686.3126737 · Cited by 50
Deep Learning Based HEVC In-Loop Filtering for Decoder Quality Enhancement
Kuanar, S. P., Conly, C., & Rao, K. R. (2018) · Picture Coding Symposium · doi:10.1109/pcs.2018.8456278 · Cited by 50
An efficient human action recognition framework with pose-based spatiotemporal features
Agahian, S., Negin, F., & Köse, C. (2019) · Engineering Science and Technology an International Journal · doi:10.1016/j.jestch.2019.04.014 · Cited by 51
Image classification with caffe deep learning framework
Cengil, E., Çınar, A., & Özbay, E. (2017) · International Conference on Computer Science and Engineering (UBMK) · doi:10.1109/ubmk.2017.8093433 · Cited by 49
Making Convolutional Networks Recurrent for Visual Sequence Learning
Yang, X., Molchanov, P. A., & Kautz, J. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00677 · Cited by 49
Prediction of gait trajectories based on the Long Short Term Memory neural networks
Zaroug, A., Garofolini, A., Lai, D. T. H., Mudie, K., & Begg, R. (2021) · PLOS ONE · doi:10.1371/journal.pone.0255597 · Cited by 48
Bidirectional Long Short-Term Memory with Temporal Dense Sampling for human action recognition
Tan, K. S., Lim, K. M., Lee, C. P., & Kwek, L. C. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118484 · Cited by 48
Large-Scale Content-Only Video Recommendation
Lee, J., & Abu-El-Haija, S. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.121 · Cited by 49
Hierarchical Video Generation From Orthogonal Information: Optical Flow and Texture
Ohnishi, K., Yamamoto, S., Ushiku, Y., & Harada, T. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11881 · Cited by 48
Forecasting People’s Needs in Hurricane Events from Social Network
Nguyen, L., Yang, Z., Li, J., Pan, Z., Cao, G., & Jin, F. (2019) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2019.2941887 · Cited by 51
Deep-Learning-Based Human Intention Prediction Using RGB Images and Optical Flow
Li, S., Zhang, L., & Diao, X. (2019) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-019-01049-3 · Cited by 50
Neighborhood Preserving Hashing for Scalable Video Retrieval
Li, S., Chen, Z., Lu, J., Li, X., & Zhou, J. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00830 · Cited by 49
Video Frame Prediction by Deep Multi-Branch Mask Network
Li, S., Fang, J., Xu, H., & Xue, J. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.2984783 · Cited by 49
Shin, W., Bu, S.-J., & Cho, S. (2020) · International Journal of Neural Systems · doi:10.1142/s0129065720500343 · Cited by 48
de Souza, C. R., Gaidon, A., Vig, E., & López, A. M. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46478-7_43 · Cited by 47
Video prediction by efficient transformers
Ye, X., & Bilodeau, G.-A. (2022) · Image and Vision Computing · doi:10.1016/j.imavis.2022.104612 · Cited by 51
Yao, S., He, Y., Zhang, L., Wang, Y., Chen, Y., Sun, Q., Zhao, Z., & Cao, S. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3236510 · Cited by 47
On the Use of Deep Learning for Video Classification
Rehman, A. U., Belhouari, S. B., Kabir, M. A., & Khan, A. (2023) · Applied Sciences · doi:10.3390/app13032007 · Cited by 48
Loy-Benitez, J., Song, M. K., Choi, Y.-H., Lee, J.-K., & Lee, S. S. (2023) · Automation in Construction · doi:10.1016/j.autcon.2023.105199 · Cited by 48
Kladny, K.-R., Milanta, M., Mraz, O., Hufkens, K., & Stocker, B. D. (2024) · Ecological Informatics · doi:10.1016/j.ecoinf.2024.102474 · Cited by 52
Action recognition using spatial-optical data organization and sequential learning framework
Yuan, Y., Zhao, Y., & Wang, Q. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.06.071 · Cited by 48
Human Action Recognition Based on Selected Spatio-Temporal Features via Bidirectional LSTM
Li, W., Nie, W., & Su, Y. (2018) · IEEE Access · doi:10.1109/access.2018.2863943 · Cited by 48
Dynamic Filtering with Large Sampling Field for ConvNets
Wu, J., Dai, L., Yu, Y., Bajaj, C., & Ji, X. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01249-6_12 · Cited by 47
Favorite Video Classification Based on Multimodal Bidirectional LSTM
Ogawa, T., Sasaka, Y., Maeda, K., & Haseyama, M. (2018) · IEEE Access · doi:10.1109/access.2018.2876710 · Cited by 47
Loy-Benitez, J., Heo, S., & Yoo, C. (2020) · Building and Environment · doi:10.1016/j.buildenv.2020.107135 · Cited by 47
Bang, S., Hong, Y., & Kim, H. (2021) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12672 · Cited by 48
Video Question Answering with Spatio-Temporal Reasoning
Jang, Y., Song, Y., Kim, C. D., Yu, Y., Kim, Y., & Kim, G. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-019-01189-x · Cited by 46
Nurseitov, D., Bostanbekov, K. A., Alimova, A. N., Abdallah, A., & Abdimanap, G. S. (2020) · Advances in Science Technology and Engineering Systems Journal · doi:10.25046/aj0505114 · Cited by 49
COVID 19: Identification of Masked Face using CNN Architecture
Singh, S. K., Aggarwal, A. K., Ramesh, P., Nelson, L., Palaniappan, D., & Pandian, M. T. (2022) · International Conference on Electronics and Sustainable Communication Systems (ICESC) · doi:10.1109/icesc54411.2022.9885327 · Cited by 46
Alhnaity, B., Kollias, S., Leontidis, G., Jiang, S., Schamp, B., & Pearson, S. (2021) · Information Sciences · doi:10.1016/j.ins.2021.01.037 · Cited by 49
Learning Asynchronous and Sparse Human-Object Interaction in Videos
de Morais, R. F. A. B., Le, V., Venkatesh, S., & Tran, T. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01578 · Cited by 46
Intelligent modeling of nonlinear dynamical systems by machine learning
Chen, R., Jin, X., Laima, S., Huang, Y., & Li, H. (2022) · International Journal of Non-Linear Mechanics · doi:10.1016/j.ijnonlinmec.2022.103984 · Cited by 45
Machine learning Based on Body Points Estimation for Sports Event Recognition
Mudawi, N. A., Tayyab, M., Ahmed, M. W., & Jalal, A. (2024) · IEEE International Conference on Autonomous Robot Systems and Competitions · doi:10.1109/icarsc61747.2024.10535954 · Cited by 45
Bhattacharjee, P., & Das, S. (2017) · neural information processing systems · Cited by 45
Assessment of Autoencoder Architectures for Data Representation
Pawar, K., & Attar, V. (2019) · Studies in computational intelligence · doi:10.1007/978-3-030-31756-0_4 · Cited by 46
Hybrid approach for Anomaly Detection in Time Series Data
Ghrib, Z., Jaziri, R., & Romdhane, R. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207013 · Cited by 46
Driver Intention Anticipation Based on In-Cabin and Driving Scene Monitoring
Rong, Y., Akata, Z., & Kasneci, E. (2020) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc45102.2020.9294181 · Cited by 45
LS-LSTM-AE: Power load forecasting via Long-Short series features and LSTM-Autoencoder
Tong, X., Wang, J., Zhang, C., Wu, T., Wang, H., & Wang, Y. (2021) · Energy Reports · doi:10.1016/j.egyr.2021.11.172 · Cited by 45
A Survey on Self-supervised Pre-training for Sequential Transfer Learning in Neural NetworksPreprint
Mao, H. H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.00800 · Cited by 66
Video-based Human Action Recognition using Deep Learning: A ReviewPreprint
Pham, H., Khoudour, L., Crouzil, A., Zegers, P., & Velastín, S. A. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2208.03775 · Cited by 45
AI-Enabled Efficient and Safe Food Supply Chain
Kollia, I., Stevenson, J., & Kollias, S. (2021) · Electronics · doi:10.3390/electronics10111223 · Cited by 48
MIMO Is All You Need：A Strong Multi-in-Multi-Out Baseline for Video Prediction
Ning, S., Lan, M., Li, Y., Chen, C., Chen, Q., Chen, X., Han, X., & Cui, S. R. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i2.25289 · Cited by 44
MMVP: Motion-Matrix-based Video Prediction
Zhong, Y., Liang, L., Zharkov, I., & Neumann, U. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00394 · Cited by 44
Effective Quantization Approaches for Recurrent Neural Networks
Alom, M. Z., Moody, A. T., Maruyama, N., Essen, B. C. V., & Taha, T. M. (2018) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489341 · Cited by 49
Forecasting People Trajectories and Head Poses by Jointly Reasoning on Tracklets and Vislets
Hasan, I., Setti, F., Tsesmelis, T., Belagiannis, V., Amin, S., Bue, A. D., Cristani, M., & Galasso, F. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2949414 · Cited by 49
Depth2Action: Exploring Embedded Depth for Large-Scale Action Recognition
Zhu, Y., & Newsam, S. D. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46604-0_47 · Cited by 44
DeepOcean: A General Deep Learning Framework for Spatio-Temporal Ocean Sensing Data Prediction
Gou, Y., Zhang, T., Liu, J., Wei, L., & Cui, J. (2020) · IEEE Access · doi:10.1109/access.2020.2990939 · Cited by 44
Self-Supervised Learning Based on Spatial Awareness for Medical Image Analysis
Nguyen, X.-B., Lee, G.-S., Kim, S.-H., & Yang, H.-J. (2020) · IEEE Access · doi:10.1109/access.2020.3021469 · Cited by 48
Deep Learning for Vision-based Prediction: A SurveyPreprint
Rasouli, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.00095 · Cited by 51
Enhanced Surveillance Video Compression with Dual Reference Frames Generation
Zhao, L., Wang, S., Wang, S., Ye, Y., Ma, S., & Gao, W. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3073114 · Cited by 43
SeaMo: A season-aware multimodal foundation model for remote sensing
Li, X., Li, C., Vivone, G., & Hong, D. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103334 · Cited by 54
A3N: Attention-based adversarial autoencoder network for detecting anomalies in video sequence
Aslam, N., Kumar, P., & Kolekar, M. H. (2022) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2022.103598 · Cited by 43
Bian, Y., Gan, C., Liu, X., Li, F., Long, X., Li, Y., Qi, H., Zhou, J., Wen, S., & Lin, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.03805 · Cited by 48
CATER: A diagnostic dataset for Compositional Actions & TEmporal Reasoning
Girdhar, R., & Ramanan, D. (2020) · International Conference on Learning Representations · Cited by 42
Adiban, M., Siniscalchi, S. M., & Salvi, G. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.03.056 · Cited by 47
Scalable Video Object Segmentation with Simplified Framework
Wu, Q., Yang, T.-Y., Wu, W., & Chan, A. B. (2023) · IEEE International Conference on Computer Vision · doi:10.1109/iccv51070.2023.01276 · Cited by 52
Snap Video: Scaled Spatiotemporal Transformers for Text-to-Video Synthesis
Menapace, W., Siarohin, A., Skorokhodov, I., Deyneka, E., Chen, T.-S., Kag, A., Fang, Y., Stoliar, A., Ricci, E., Ren, J., et al. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00672 · Cited by 68
Sea Surface Temperature Prediction Using ConvLSTM-Based Model with Deformable Attention
Shi, B., Ge, C., Lin, H., Xu, Y., Tan, Q., Peng, Y., & He, H. (2024) · Remote Sensing · doi:10.3390/rs16224126 · Cited by 42
Video Question Answering via Hierarchical Dual-Level Attention Network Learning
Zhao, Z., Lin, J., Jiang, X., Cai, D., He, X., & Zhuang, Y. (2017) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3123266.3123364 · Cited by 43
Future-State Predicting LSTM for Early Surgery Type Recognition
Kannan, S., Yengera, G., Mutter, D., Marescaux, J., & Padoy, N. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2931158 · Cited by 48
Deep Manifold Structure Transfer for Action Recognition
Li, C., Zhang, B., Chen, C., Ye, Q., Han, J., Guo, G., & Ji, R. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2912357 · Cited by 43
Chen, Y.-C., Huang, S.-F., Lee, H.-Y., Wang, Y., & Shen, C.-H. (2019) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2019.2922832 · Cited by 43
Unsupervised Variational Video Hashing With 1D-CNN-LSTM Networks
Li, S., Chen, Z., Li, X., Lu, J., & Zhou, J. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2946096 · Cited by 42
Long-Term Anticipation of Activities with Cycle Consistency
Farha, Y. A., Ke, Q., Schiele, B., & Gall, J. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-71278-5_12 · Cited by 42
Introduction to Supervised Learning
Verma, R., Nagar, V., & Mahapatra, S. (2021) · Wiley eBooks · doi:10.1002/9781119785620.ch1 · Cited by 42
Generative Models for Low-Dimensional Video Representation and Reconstruction
Hyder, R., & Asif, M. S. (2020) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2020.2977256 · Cited by 41
Spatiotemporal prediction of microstructure evolution with predictive recurrent neural network
Farizhandi, A. A. K., & Mamivand, M. (2023) · Computational Materials Science · doi:10.1016/j.commatsci.2023.112110 · Cited by 42
Overview of intelligent video coding: from model-based to learning-based approaches
Ma, S., Gao, J., Wang, R., Chang, J., Mao, Q., Huang, Z., & Jia, C. (2023) · Visual Intelligence · doi:10.1007/s44267-023-00018-7 · Cited by 42
Masked Motion Encoding for Self-Supervised Video Representation Learning
Sun, X., Chen, P., Chen, L., Li, C., Li, T. H., Tan, M., & Gan, C. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00222 · Cited by 48
A bag-of-words equivalent recurrent neural network for action recognition
Richard, A., & Gall, J. (2016) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2016.10.014 · Cited by 42
del Molino, A. G., & Gygli, M. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240599 · Cited by 41
Pose Encoding for Robust Skeleton-Based Action Recognition
Demisse, G., Papadopoulos, K., Aouada, D., & Ottersten, B. (2018) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00056 · Cited by 42
Semantic Image Networks for Human Action Recognition
Khowaja, S. A., & Lee, S.-L. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-019-01248-3 · Cited by 41
Low-Complexity Distributed-Arithmetic-Based Pipelined Architecture for an LSTM Network
Yalamarthy, K. P., Dhall, S., Khan, M. T., & Ahamed, S. R. (2019) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2019.2941921 · Cited by 41
A Discriminative Deep Model With Feature Fusion and Temporal Attention for Human Action Recognition
Yu, J., Gao, H., Yang, W. H., Jiang, Y., Chin, W., Kubota, N., & Ju, Z. (2020) · IEEE Access · doi:10.1109/access.2020.2977856 · Cited by 41
Metadata
- Authors
- Srivastava, N., Mansimov, E., & Salakhutdinov, R.
- Affiliations
- University of Toronto (CA)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2015
- Pages
- 843-852
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1502.04681
- OpenAlex
- W2116435618
- Cited by
- 1,861
- References
- 30
- Citations by year
- 2026: 3 · 2025: 56 · 2024: 128 · 2023: 148 · 2022: 183 · 2021: 279 · 2020: 308 · 2019: 286 · 2018: 238 · 2017: 146 · 2016: 62 · 2015: 23
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- International Conference on Machine Learning
- Funders
- Raytheon Company
- Nvidia
- Samsung
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- video representation learning, unsupervised learning, long short-term memory networks, LSTM encoder-decoder, video reconstruction, future frame prediction, perceptual features, feature visualization, human action recognition, transfer learning, few-shot learning, out-of-domain generalization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
