The DOI matches its DataCite record; 29 of the 30 references it cites were found in a registry or an index.
Unsupervised Learning of Video Representations using LSTMs
Open accessAbstract
We use multilayer Long Short Term Memory (LSTM) networks to learn representations of video sequences. Our model uses an encoder LSTM to map an input sequence into a fixed length representation. This representation is decoded using single or multiple decoder LSTMs to perform different tasks, such as reconstructing the input sequence, or predicting the future sequence. We experiment with two kinds of input sequences - patches of image pixels and high-level representations ("percepts") of video frames extracted using a pretrained convolutional net. We explore different design choices such as whether the decoder LSTMs should condition on the generated output. We analyze the outputs of the model qualitatively to see how well the model can extrapolate the learned video representation into the future and into the past. We try to visualize and interpret the learned features. We stress test the model by running it on longer time scales and on out-of-domain data. We further evaluate the representations by finetuning them for a supervised learning problem - human action recognition on the UCF-101 and HMDB-51 datasets. We show that the representations help improve classification accuracy, especially when there are only a few training examples. Even models pretrained on unrelated datasets (300 hours of YouTube videos) can help action recognition performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This is the first time that motion prediction with cross-dimensional learning has been used for self-supervised learning in the context of HAR.”
From Self-supervised Human Activity Recognition by Learning to Predict Cross-Dimensional Motion (2021) · cites this paper as [23]
In the citing paper
“While motion prediction has been used in the field of computer vision for self-supervised learning [23, 26], our model is novel in that the cross-dimensional aspect results in more effective learning.”
From Self-supervised Human Activity Recognition by Learning to Predict Cross-Dimensional Motion (2021) · cites this paper as [23]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Two-Stream Convolutional Networks for Action Recognition in Videos
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1406.2199 · Cited by 6,756
Large-Scale Video Classification with Convolutional Neural Networks
Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., & Fei-Fei, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.223 · Cited by 6,354
Show and tell: A neural image caption generator
Vinyals, O., Toshev, A., Bengio, S., & Erhan, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298935 · Cited by 6,318
3D Convolutional Neural Networks for Human Action Recognition
Ji, S., Xu, W., Yang, M., & Yu, K. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.59 · Cited by 6,313
Long-term recurrent convolutional networks for visual recognition and description
Donahue, J., Hendricks, L. A., Guadarrama, S., Rohrbach, M., Venugopalan, S., Darrell, T., & Saenko, K. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298878 · Cited by 5,228
Research works printed but not linked: 1
- Hochreiter, Sepp and Schmidhuber, J¨ urgen. Long short-term memory. Neural Computation , 9(8):1735-1780, 1997.
Cited by
Sorted by citations
Items 901–1,000 of 1,005
ModeRNN: Harnessing Spatiotemporal Mode Collapse in Unsupervised Predictive Learning
Yao, Z., Wang, Y., Wu, H., Wang, J., & Long, M. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3293145 · Cited by 18
Empirical Evaluation of Variational Autoencoders for Data Augmentation
Jorge, J., Vieco, J., Paredes, R., Sánchez, J. A., & Benedí, J.-M. (2018) · International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP) · doi:10.5220/0006618600960104 · Cited by 18
Elsayed, N., Maida, A. S., & Bayoumi, M. (2020) · Computational Intelligence · doi:10.1111/coin.12277 · Cited by 19
Self-Supervised Multi-Object Tracking with Cross-Input ConsistencyPreprint
Bastani, F., He, S., & Madden, S. R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.05943 · Cited by 18
Deep Learning for Video Classification: A Review
Rehman, A., & Belhaouari, S. B. (2021) · doi:10.36227/techrxiv.15172920 · Cited by 17
Physics-aware parameter diffusion for spatio-temporal continuum field modeling for governance
Zhang, A., Chen, S., Wu, P., Wu, C., Wu, H., Xu, F., & Wang, K. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.131262 · Cited by 17
Diffractive tensorized unit for million-TOPS general-purpose computing
Wang, C., Cheng, Y., Xu, Z., Dai, Q., & Fang, L. (2025) · Nature Photonics · doi:10.1038/s41566-025-01749-3 · Cited by 20
Prediction of sea ice motion with recurrent neural networks
Petrou, Z. I., & Tian, Y. (2017) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2017.8128230 · Cited by 17
MVCLN: Multi-View Convolutional LSTM Network for Cross-Media 3D Shape Recognition
Liang, Q., Wang, Z., Nie, W., & Li, Q. (2020) · IEEE Access · doi:10.1109/access.2020.3012692 · Cited by 17
How and What to Learn: Taxonomizing Self-Supervised Learning for 3D Action Recognition
Tanfous, A. B., Zerroug, A., Linsley, D. A., & Serre, T. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00294 · Cited by 17
Wang, D., Wen, C., & Feng, X. (2023) · International Journal of Systems Science · doi:10.1080/00207721.2023.2293686 · Cited by 17
Triplet Attention Transformer for Spatiotemporal Predictive Learning
Nie, X., Chen, X., Jin, H., Zhu, Z., Yan, Y., & Qi, D. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00688 · Cited by 20
IoT as a Service for Smart Cities and Nations
Brincat, A. A., Pacifici, F., & Mazzola, F. (2019) · IEEE Internet of Things Magazine · doi:10.1109/iotm.2019.1900014 · Cited by 17
Further Understanding Videos through Adverbs: A New Video Task
Pang, B., Zha, K., Zhang, Y., & Lu, C. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6855 · Cited by 17
Prediction of Weather Radar Images via a Deep LSTM for Nowcasting
Yao, G., Liu, Z., Guo, X., Wei, C., Li, X., & Chen, Z. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9206889 · Cited by 17
Learning sparse and meaningful representations through embodiment
Clay, V., Peter König, B., Kühnberger, K., & Pipa, G. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.11.004 · Cited by 18
One-Shot Imitation Drone Filming of Human Motion Videos
Huang, C. X., Dang, Y., Chen, P., Yang, X. Y., & Cheng, K.-T. T. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3067359 · Cited by 19
Pandeya, Y. R., Bhattarai, B., & Lee, J. (2021) · Scientific Reports · doi:10.1038/s41598-021-98856-2 · Cited by 17
Predictive Feature Learning for Future Segmentation Prediction
Lin, Z., Sun, J., Hu, J., Yu, Q., Lai, J., & Zheng, W. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00727 · Cited by 17
Activity Recognition Based on a Magnitude-Orientation Stream Network
Caetano, C., de Melo, V. H. C., dos Santos, J. A., & Schwartz, W. R. (2017) · SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI) · doi:10.1109/sibgrapi.2017.13 · Cited by 17
Learning to Generate Radar Image Sequences Using Two-Stage Generative Adversarial Networks
Zhang, C., Yang, X., Tang, Y., & Zhang, W. (2019) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2019.2922326 · Cited by 17
Attention with structure regularization for action recognition
Quan, Y., Chen, Y., Xu, R., & Ji, H. (2019) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2019.102794 · Cited by 17
A Proposal-Based Approach for Activity Image-to-Video Retrieval
Xu, R., Niu, L., Zhang, J., & Zhang, L. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6941 · Cited by 17
Gupta, A., Vedaldi, A., & Zisserman, A. (2018) · Indian Conference on Computer Vision, Graphics and Image Processing · doi:10.1145/3293353.3293386 · Cited by 17
A Deep-Unfolded Reference-Based RPCA Network For Video Foreground-Background Separation
Luong, H. V., Joukovsky, B., Eldar, Y. C., & Deligiannis, N. (2020) · European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco47968.2020.9287416 · Cited by 17
Sequence Transfer Learning for Neural DecodingPreprint
Elango, V., Patel, A. N., Miller, K. J., & Gilja, V. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/210732 · Cited by 19
Sahu, A., Nguyen, T., Chen, K., Zhang, X., & Hassanaly, M. (2024) · IEEE Access · doi:10.1109/access.2024.3524942 · Cited by 20
Kim, J., Lee, S., & Lee, I.-B. (2023) · Agriculture · doi:10.3390/agriculture13040795 · Cited by 17
Spatiotemporal networks for ENSO forecasting with LICOM3 and remote sensing data
Zhang, X., Wang, Y., Wei, L., Jiang, J., Lin, P., & Liu, H. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.106641 · Cited by 17
Multimodal feature fusion for illumination-invariant recognition of abnormal human behaviors
Nguyen, V.-A., & Kong, S. G. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101949 · Cited by 16
Human Action Representation Learning Using an Attention-Driven Residual 3DCNN Network
Ullah, H., & Munir, A. (2023) · Algorithms · doi:10.3390/a16080369 · Cited by 16
Comprehensive early warning of rockburst hazards based on unsupervised learning
Song, Y., Wang, E., Yang, H., Liu, C., Di, Y., Li, B., & Chen, D. (2024) · Physics of Fluids · doi:10.1063/5.0221722 · Cited by 16
Wang, Q., Tu, Z., Li, C., & Tang, J. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102665 · Cited by 17
Sparsity-inducing dictionaries for effective action classification
Roy, D., Srinivas, M., & Mohan, C. K. (2016) · Pattern Recognition · doi:10.1016/j.patcog.2016.03.011 · Cited by 16
LSTM-Based Temperature Prediction for Hot-Axles of Locomotives
Luo, C., Yang, D., Huang, J. H., & Deng, Y. S. (2017) · ITM Web of Conferences · doi:10.1051/itmconf/20171201013 · Cited by 16
Webpage Depth Viewability Prediction Using Deep Sequential Neural Networks
Wang, C., Zhao, S., Kalra, A., Borcea, C., & Chen, Y. (2018) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2018.2839599 · Cited by 16
Action Recognition Using Visual Attention with Reinforcement Learning
Li, H., Chen, J., Hu, R., Yu, M., Chen, H., & Xu, Z. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-05716-9_30 · Cited by 16
Li, Q., Dong, Q., Ge, F., Qiang, N., Wu, X., & Liu, T. (2021) · Brain Imaging and Behavior · doi:10.1007/s11682-021-00469-w · Cited by 18
Hybrid Model of Convolutional LSTM and CNN to Predict Particulate Matter
Lee, S., & Shin, J. (2019) · International Journal of Information and Electronics Engineering · doi:10.18178/ijiee.2019.9.1.701 · Cited by 16
A Driving Scenario Representation for Scalable Real-Data Analytics with Neural Networks
Ries, L., Langner, J., Otten, S., Bach, J., & Sax, E. (2019) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2019.8813881 · Cited by 17
Reactive Load Prediction Based on a Long Short-Term Memory Neural Network
Zhang, X., Wang, Y., Zheng, Y., Ding, R., Chen, Y., Wang, Y., Cheng, X., & Yue, S. (2020) · IEEE Access · doi:10.1109/access.2020.2991739 · Cited by 16
Stochastic Dynamics for Video Infilling
Xu, Q., Zhang, H., Wang, W., Belhumeur, P. N., & Neumann, U. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093530 · Cited by 16
Exploiting Multiple Correlations Among Urban Regions for Crowd Flow Prediction
Zhou, Q., Gu, J., Ling, C., Li, W., Zhuang, Y., & Wang, J. (2020) · Journal of Computer Science and Technology · doi:10.1007/s11390-020-9970-y · Cited by 16
Strong Spatiotemporal Radar Echo Nowcasting Combining 3DCNN and Bi-Directional Convolutional LSTM
Chen, S., Zhang, S., Geng, H., Chen, Y., Zhang, C., & Min, J. (2020) · Atmosphere · doi:10.3390/atmos11060569 · Cited by 16
Visual Reaction: Learning to Play Catch With Your Drone
Zeng, K.-H., Mottaghi, R., Weihs, L., & Farhadi, A. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01159 · Cited by 16
Multi-task Learning with Future States for Vision-Based Autonomous Driving
Kim, I., Lee, H., Lee, J., Lee, E., & Kim, D. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-69535-4_40 · Cited by 16
ExHPD: Exploiting Human, Physical, and Driving Behaviors to Detect Vehicle Cyber Attacks
Chen, Q., Romanowich, P., Castillo, J., Roy, K. C., Chavez, G. M., & Xu, S. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3069951 · Cited by 16
Strumming to the Beat: Audio-Conditioned Contrastive Video Textures
Narasimhan, M., Ginosar, S., Owens, A., Efros, A. A., & Darrell, T. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00058 · Cited by 17
Yuan, L.-P., Liu, P., & Zhu, S. (2021) · ACM Asia Conference on Computer and Communications Security (ASIA CCS) · doi:10.1145/3433210.3453098 · Cited by 16
Nesting spatiotemporal attention networks for action recognition
Li, J., Wei, P., & Zheng, N. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.06.088 · Cited by 16
Vehicle Destination Prediction Using Bidirectional LSTM with Attention Mechanism
Casabianca, P., Zhang, Y., Martínez-García, M., & Wan, J. (2021) · Sensors · doi:10.3390/s21248443 · Cited by 16
A Spatiotemporal Ensemble Approach to Rainfall Forecasting
Souto, Y. M., Porto, F. A. M., Moura, A. M., & Bezerra, E. A. D. (2018) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489693 · Cited by 17
Application of ConvLSTM Network in Numerical Temperature Prediction Interpretation
Lin, H., Hua, Y., Ma, L., & Chen, L. (2019) · International Conference on Machine Learning and Computing (ICMLC) · doi:10.1145/3318299.3318381 · Cited by 16
Fast Memory-efficient Extreme Events Prediction in Complex Time series
Wambura, S. M., Li, H., & Nigussie, A. (2020) · International Conference on Robot Systems and Applications (ICRSA) · doi:10.1145/3402597.3402609 · Cited by 16
Anomaly Detection Using Predictive Convolutional Long Short-Term Memory Units
Medel, J. R. (2016) · RIT Scholar Works (Rochester Institute of Technology) · Cited by 16
About Time: Advances, Challenges, and Outlooks of Action Understanding
Stergiou, A., & Poppe, R. W. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02478-4 · Cited by 17
Jafari, S., & Byun, Y.-C. (2025) · Energy Reports · doi:10.1016/j.egyr.2025.07.027 · Cited by 17
Liu, J., Zhu, C., Long, Z., & Liu, Y. (2021) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000087 · Cited by 15
A Probabilistic Autoencoder for Type Ia Supernova Spectral Time Series
Stein, G., Seljak, U., Böhm, V., Aldering, G., Antilogus, P. E., Aragon, C., Bailey, S., Baltay, C., Bongard, S., Boone, K., et al. (2022) · The Astrophysical Journal · doi:10.3847/1538-4357/ac7c08 · Cited by 23
Multi-Task Learning based Video Anomaly Detection with Attention
Baradaran, M., & Bergevin, R. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00290 · Cited by 15
Extreme Video Compression with Prediction Using Pre-trained Diffusion Models
Li, B., Liu, Y., Niu, X., Bait, B., Han, W., Deng, L., & Gündüz, D. (2024) · International Conference on Wireless Communications and Signal Processing (WCSP) · doi:10.1109/wcsp62071.2024.10827256 · Cited by 17
Mänttäri, J., Folkesson, J. B., & Ward, E. (2018) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2018.8500426 · Cited by 15
Adaptive Context Reading Network for Movie Scene Detection
Liu, D., Kamath, N., Bhattacharya, S., & Puri, R. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.3042476 · Cited by 15
Moving SLAM: Fully Unsupervised Deep Learning in Non-Rigid Scenes
Xu, D., Vedaldi, A., & Henriques, J. F. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636075 · Cited by 15
Jia, X., Hong, H., & DiCarlo, J. J. (2021) · eLife · doi:10.7554/elife.60830 · Cited by 18
Spectrum Situation Awareness Based on Time-Series Depth Networks for LTE-R Communication System
Cai, X., Wu, C., Sheng, J., Wang, Y., & Ai, B. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3083968 · Cited by 15
Kolhar, S., & Jagtap, J. (2021) · Ecological Informatics · doi:10.1016/j.ecoinf.2021.101334 · Cited by 15
Developing Deep Learning Models for Storm Nowcasting
Cuomo, J., & Chandrasekar, V. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3110180 · Cited by 15
A Hierarchical Variational Neural Uncertainty Model for Stochastic Video Prediction
Chatterjee, M., Ahuja, N., & Cherian, A. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00961 · Cited by 15
Trajectory distributions: A new description of movement for trajectory prediction
Lv, P., Wei, H., Gu, T., Zhang, Y., Jiang, X., Zhou, B., & Xu, M. (2021) · Computational Visual Media · doi:10.1007/s41095-021-0236-6 · Cited by 16
Fitton, D., Laurens, E., Hongkarnjanakul, N., Schwob, C., & Mezeix, L. (2022) · Remote Sensing Applications Society and Environment · doi:10.1016/j.rsase.2022.100740 · Cited by 15
State-of-the-Art Versus Deep Learning: A Comparative Study of Motor Imagery Decoding Techniques
George, O., Dabas, S., Sikder, A., Smith, R. O., Madiraju, P., Yahyasoltani, N., & Ahamed, S. I. (2022) · IEEE Access · doi:10.1109/access.2022.3165197 · Cited by 15
Hierarchical Contrastive Motion Learning for Video Action Recognition
Yang, X., Yang, X., Liu, S., Sun, D., Davis, L. S., & Kautz, J. (2021) · British Machine Vision Conference (BMVC) · doi:10.5244/c.35.236 · Cited by 15
LSTM-based Deep Learning Models for Answer Ranking
Li, Z., Huang, J., Zhou, Z., Zhang, H., Chang, S., & Huang, Z. (2016) · IEEE International Conference on Data Science in Cyberspace · doi:10.1109/dsc.2016.37 · Cited by 15
Saif, S., Tehsin, S., & Kausar, S. (2018) · Sensors · doi:10.3390/s18113979 · Cited by 15
Interpretable Multi-task Learning for Product Quality Prediction with Attention Mechanism
Yeh, C.-H., Fan, Y.-C., & Peng, W.-C. (2019) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde.2019.00207 · Cited by 15
Temporally Consistent Depth Prediction With Flow-Guided Memory Units
Eom, C., Park, H., & Ham, B. (2019) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2942096 · Cited by 18
Learning-Based Real-Time Process-Aware Anomaly Monitoring for Assured Autonomy
Patel, N., Saridena, A. N., Choromanska, A., Krishnamurthy, P., & Khorrami, F. (2020) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2020.2997025 · Cited by 15
A Time Attention based Fraud Transaction Detection FrameworkPreprint
Li, L., Liu, Z., Chen, C., Zhang, Y., Zhou, J., & Li, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.11760 · Cited by 22
Video Prediction via Example GuidancePreprint
Xu, J., Xu, H., Ni, B., Yang, X., & Darrell, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.01738 · Cited by 15
Rain-Code Fusion: Code-to-Code ConvLSTM Forecasting Spatiotemporal Precipitation
Yasuno, T., Ishii, A., & Amakata, M. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-68787-8_2 · Cited by 14
Spatiotemporal Prediction of Radar Echoes Based on ConvLSTM and Multisource Data
Lu, M., Li, Y., Yu, M., Zhang, Q., Zhang, Y., Liu, B., & Wang, M. (2023) · Remote Sensing · doi:10.3390/rs15051279 · Cited by 14
Infrared Object-Tracking Algorithm With Temporal Features Fusion Siamese Network
Song, J., Hao, X., Ren, G., & Miao, Q. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3335522 · Cited by 14
Interpretable Neural Networks for Video Separation: Deep Unfolding RPCA With Foreground Masking
Joukovsky, B., Eldar, Y. C., & Deligiannis, N. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3336176 · Cited by 14
Hu, J., Yin, B., & Guo, C. (2024) · Remote Sensing · doi:10.3390/rs16061063 · Cited by 14
GenHowTo: Learning to Generate Actions and State Transformations from Instructional Videos
Souček, T., Damen, D., Wray, M., Laptev, I., & Šivic, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00627 · Cited by 23
Multi-Way adaptive Time Aware LSTM for irregularly collected sequential ICU data
Cissoko, M. B. H., Castelain, V., & Lachiche, N. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.125548 · Cited by 14
Unsupervised Human Action Detection by Action Matching
Fernando, B., Rowlands, S., & Gould, S. J. (2017) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.205 · Cited by 14
Evolving memory-augmented neural architecture for deep memory problems
Khadka, S., Chung, J. J., & Tumer, K. (2017) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3071178.3071346 · Cited by 14
LSTM-Based Memory Profiling for Predicting Data Attacks in Distributed Big Data Systems
Aditham, S., Ranganathan, N., & Katkoori, S. (2017) · IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum · doi:10.1109/ipdpsw.2017.76 · Cited by 14
Power Load Forecasting Using a Refined LSTM
Tang, D., Li, C., Ji, X., Chen, Z., & Di, F. (2019) · International Conference on Machine Learning and Computing (ICMLC) · doi:10.1145/3318299.3318353 · Cited by 16
A component-based video content representation for action recognition
Adeli, V., Fazl-Ersi, E., & Harati, A. (2019) · Image and Vision Computing · doi:10.1016/j.imavis.2019.08.009 · Cited by 14
Zhao, L., Peng, X., Tian, Y., Kapadia, M., & Metaxas, D. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-020-01328-9 · Cited by 14
ML for RT: Priority Assignment Using Machine Learning
Lee, S., Baek, H., Woo, H., Shin, K. G., & Lee, J. (2021) · IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS) · doi:10.1109/rtas52030.2021.00018 · Cited by 14
Thermal fault diagnosis of marine diesel engine based on LSTM neural network algorithm
Zhao, Y., Wang, S., & Chen, N. (2022) · Vibroengineering PROCEDIA · doi:10.21595/vp.2022.22515 · Cited by 14
GAN-rcLSTM: A Deep Learning Model for Radar Echo Extrapolation
Geng, H., Wang, T., Zhuang, X., Du, X., Hu, Z., & Geng, L. (2022) · Atmosphere · doi:10.3390/atmos13050684 · Cited by 15
Interaction Classification with Key Actor Detection in Multi-Person Sports Videos
Askari, F., Ramaprasad, R., Clark, J. J., & Levine, M. D. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00402 · Cited by 14
Formula-Driven Supervised Learning in Computer Vision: A Literature Survey
Hafiz, A. M., Hassaballah, M., & Binbusayyis, A. (2023) · Applied Sciences · doi:10.3390/app13020723 · Cited by 15
Deep generative video prediction
Yu, T., Wang, L., Gu, H., Xiang, S., & Pan, C. (2018) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.03.027 · Cited by 15
Predicting Diverse Future Frames With Local Transformation-Guided Masking
Wang, J., Wang, W., & Gao, W. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2882061 · Cited by 14
Metadata
- Authors
- Srivastava, N., Mansimov, E., & Salakhutdinov, R.
- Affiliations
- University of Toronto (CA)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2015
- Pages
- 843-852
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1502.04681
- OpenAlex
- W2116435618
- Cited by
- 1,861
- References
- 30
- Citations by year
- 2026: 3 · 2025: 56 · 2024: 128 · 2023: 148 · 2022: 183 · 2021: 279 · 2020: 308 · 2019: 286 · 2018: 238 · 2017: 146 · 2016: 62 · 2015: 23
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- International Conference on Machine Learning
- Funders
- Raytheon Company
- Nvidia
- Samsung
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- video representation learning, unsupervised learning, long short-term memory networks, LSTM encoder-decoder, video reconstruction, future frame prediction, perceptual features, feature visualization, human action recognition, transfer learning, few-shot learning, out-of-domain generalization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
