The DOI matches its DataCite record; 29 of the 30 references it cites were found in a registry or an index.
Unsupervised Learning of Video Representations using LSTMs
Open accessAbstract
We use multilayer Long Short Term Memory (LSTM) networks to learn representations of video sequences. Our model uses an encoder LSTM to map an input sequence into a fixed length representation. This representation is decoded using single or multiple decoder LSTMs to perform different tasks, such as reconstructing the input sequence, or predicting the future sequence. We experiment with two kinds of input sequences - patches of image pixels and high-level representations ("percepts") of video frames extracted using a pretrained convolutional net. We explore different design choices such as whether the decoder LSTMs should condition on the generated output. We analyze the outputs of the model qualitatively to see how well the model can extrapolate the learned video representation into the future and into the past. We try to visualize and interpret the learned features. We stress test the model by running it on longer time scales and on out-of-domain data. We further evaluate the representations by finetuning them for a supervised learning problem - human action recognition on the UCF-101 and HMDB-51 datasets. We show that the representations help improve classification accuracy, especially when there are only a few training examples. Even models pretrained on unrelated datasets (300 hours of YouTube videos) can help action recognition performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This is the first time that motion prediction with cross-dimensional learning has been used for self-supervised learning in the context of HAR.”
From Self-supervised Human Activity Recognition by Learning to Predict Cross-Dimensional Motion (2021) · cites this paper as [23]
In the citing paper
“While motion prediction has been used in the field of computer vision for self-supervised learning [23, 26], our model is novel in that the cross-dimensional aspect results in more effective learning.”
From Self-supervised Human Activity Recognition by Learning to Predict Cross-Dimensional Motion (2021) · cites this paper as [23]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Two-Stream Convolutional Networks for Action Recognition in Videos
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1406.2199 · Cited by 6,756
Large-Scale Video Classification with Convolutional Neural Networks
Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., & Fei-Fei, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.223 · Cited by 6,354
Show and tell: A neural image caption generator
Vinyals, O., Toshev, A., Bengio, S., & Erhan, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298935 · Cited by 6,318
3D Convolutional Neural Networks for Human Action Recognition
Ji, S., Xu, W., Yang, M., & Yu, K. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.59 · Cited by 6,313
Long-term recurrent convolutional networks for visual recognition and description
Donahue, J., Hendricks, L. A., Guadarrama, S., Rohrbach, M., Venugopalan, S., Darrell, T., & Saenko, K. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298878 · Cited by 5,228
Research works printed but not linked: 1
- Hochreiter, Sepp and Schmidhuber, J¨ urgen. Long short-term memory. Neural Computation , 9(8):1735-1780, 1997.
Cited by
Sorted by citations
Items 601–700 of 1,005
Romaguera, L. V., Plantefève, R., Romero, F., Hébert, F., Carrier, J., & Kadoury, S. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101754 · Cited by 41
Xiong, T., He, J., Wang, H., Tang, X., Shi, Z., & Zeng, Q. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2021.3128522 · Cited by 44
Sequential Neural ProcessesPreprint
Singh, G., Yoon, J., Son, Y.-S., & Ahn, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.10264 · Cited by 45
Anuranji, R., & Srimathi, H. (2020) · Digital Signal Processing · doi:10.1016/j.dsp.2020.102729 · Cited by 40
A deep-learning search for technosignatures from 820 nearby stars
Ma, P. X., Ng, C., Rizk, L., Croft, S., Siemion, A. P. V., Brzycki, B., Czech, D. J., Drew, J., Gajjar, V., Hoang, J., et al. (2023) · Nature Astronomy · doi:10.1038/s41550-022-01872-z · Cited by 46
A review and guide on selecting and optimizing machine learning algorithms for daylight prediction
Qiu-ping, L., Chen, Y., Liu, Y., Lei, Y., Wang, Y., & Hu, P. (2023) · Building and Environment · doi:10.1016/j.buildenv.2023.110822 · Cited by 41
Convolutional Long Short-Term Memory Networks for Recognizing First Person Interactions
Sudhakaran, S., & Lanz, O. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.276 · Cited by 40
Dense Dilated Network for Video Action Recognition
Xu, B., Ye, H., Zheng, Y., Wang, H., Luwang, T., & Jiang, Y. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2917283 · Cited by 40
Deep Network-Based Frame Extrapolation With Reference Frame Alignment
Huo, S., Liu, D., Li, B., Ma, S., Wu, F., & Gao, W. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.2995243 · Cited by 40
Wang, C., Wang, P., Wang, P., Xue, B., & Wang, D. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2021.3083647 · Cited by 40
EduNet: A New Video Dataset for Understanding Human Activity in the Classroom Environment
Sharma, V., Gupta, M., Kumar, A., & Mishra, D. (2021) · Sensors · doi:10.3390/s21175699 · Cited by 45
Contrastive predictive coding with transformer for video representation learning
Liu, Y., Ma, J., Xie, Y., Yang, X., Tao, X., Peng, L., & Gao, W. G. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.11.031 · Cited by 41
Ullah, F. U. M., Ullah, A., Khan, N., Lee, M. Y., Rho, S., & Baik, S. W. (2022) · Complexity · doi:10.1155/2022/2993184 · Cited by 44
Long, Y., She, X., & Mukhopadhyay, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.07439 · Cited by 40
van der Grinten, M., de Ruyter van Steveninck, J., Lozano, A., Pijnacker, L., Rueckauer, B., Roelfsema, P., van Gerven, M., van Wezel, R., Güçlü, U., & Güçlütürk, Y. (2024) · eLife · doi:10.7554/elife.85812 · Cited by 39
Robust Video Frame Interpolation With Exceptional Motion Map
Park, M., Kim, H. G., Lee, S., & Ro, Y. M. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.2981964 · Cited by 40
Efficient online learning with improved LSTM neural networks
Mirza, A. H., Kerpiççi, M., & Kozat, S. S. (2020) · Digital Signal Processing · doi:10.1016/j.dsp.2020.102742 · Cited by 41
Human Action Recognition in Video Using DB-LSTM and ResNet
Mihanpour, A., Rashti, M. J., & Alavi, S. E. (2020) · International Conference on Web Research (ICWR) · doi:10.1109/icwr49608.2020.9122304 · Cited by 39
Adversarial 3D Convolutional Auto-Encoder for Abnormal Event Detection in Videos
Sun, C., Jia, Y., Song, H., & Wu, Y. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.3023303 · Cited by 39
MMHAR-EnsemNet: A Multi-Modal Human Activity Recognition Model
Das, A., Sil, P., Singh, P. K., Bhateja, V., & Sarkar, R. (2020) · IEEE Sensors Journal · doi:10.1109/jsen.2020.3034614 · Cited by 39
BézierSketch: A Generative Model for Scalable Vector Sketches
Das, A., Yang, Y., Hospedales, T. M., Xiang, T., & Song, Y.-Z. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58574-7_38 · Cited by 43
MoNet: Motion-Based Point Cloud Prediction Network
Lü, F., Chen, G., Li, Z., Zhang, L., Liu, Y., Qu, S., & Knoll, A. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3128424 · Cited by 43
FitVid: Overfitting in Pixel-Level Video PredictionPreprint
Babaeizadeh, M., Saffar, M., Nair, S., Levine, S., Finn, C., & Erhan, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.13195 · Cited by 94
Sharma, D., Dhiman, C., & Kumar, D. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.119773 · Cited by 43
Zuo, Z., Zhang, H., Ma, L., Liu, T., & Liang, S. (2023) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2023.3294645 · Cited by 40
Crowded Scene Understanding by Deeply Learned Volumetric Slices
Shao, J., Loy, C. C., Kang, K., & Wang, X. (2016) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2016.2593647 · Cited by 38
Unsupervised Learning of Deep Feature Representation for Clustering Egocentric Actions
Bhatnagar, B. L., Singh, S., Arora, C., & Jawahar, C. V. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/200 · Cited by 38
Rothfuss, J., Ferreira, F., Aksoy, E. E., Zhou, Y., & Asfour, T. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2860057 · Cited by 38
Soccer Video Event Detection Based on Deep Learning
Yu, J., Lei, A., & Hu, Y. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-05716-9_31 · Cited by 38
Recurrent Reconstructive Network for Sequential Anomaly Detection
Yoo, Y.-H., Kim, U.-H., & Kim, J.-H. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2019.2933548 · Cited by 40
A Neural Architecture for Detecting User Confusion in Eye-tracking Data
Sims, S. D., & Conati, C. (2020) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3382507.3418828 · Cited by 40
Sketch Recognition with Deep Visual-Sequential Fusion Model
He, J.-Y., Wu, X. Y., Jiang, Y., Zhao, B., & Peng, Q. (2017) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3123266.3123321 · Cited by 38
Procedure-Aware Pretraining for Instructional Video Understanding
Zhou, H., Martín-Martín, R., Kapadia, M., Savarese, S., & Niebles, J. C. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01033 · Cited by 37
Temporal Tessellation: A Unified Approach for Video Analysis
Kaufman, D., Levi, G., Hassner, T., & Wolf, L. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.20 · Cited by 37
Neural Program Synthesis from Diverse Demonstration Videos
Sun, S., Noh, H., Somasundaram, S., & Lim, J. J. (2018) · International Conference on Machine Learning · Cited by 37
Action Recognition by an Attention-Aware Temporal Weighted Convolutional Neural Network
Wang, L., Zang, J., Zhang, Q., Niu, Z., Hua, G., & Zheng, N. (2018) · Sensors · doi:10.3390/s18071979 · Cited by 37
Hierarchical Video Frame Sequence Representation with Deep Convolutional Graph Network
Mao, F., Wu, X., Xue, H., & Zhang, R. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-11018-5_24 · Cited by 37
Singh, S. K., Kaushal, R., Buduru, A. B., & Kumaraguru, P. (2019) · ACM Symposium on Applied Computing · doi:10.1145/3297280.3297487 · Cited by 38
Comparing recurrent and convolutional neural networks for predicting wave propagationPreprint
Fotiadis, S., Pignatelli, E., Valencia, M. L., Cantwell, C. D., Storkey, A., & Bharath, A. A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.08981 · Cited by 37
DTR-HAR: deep temporal residual representation for human activity recognition
Basly, H., Ouarda, W., Sayadi, F. E., Ouni, B., & Alimi, A. M. (2022) · The Visual Computer · doi:10.1007/s00371-021-02064-y · Cited by 36
Geometry-based next frame prediction from monocular video
Mahjourian, R., Wicke, M., & Angelova, A. (2017) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2017.7995953 · Cited by 36
Predictive-Corrective Networks for Action Detection
Dave, A., Russakovsky, O., & Ramanan, D. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.223 · Cited by 36
Temporal Difference Networks for Video Action Recognition
Ng, J. Y.-H., & Davis, L. S. (2018) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2018.00176 · Cited by 36
Controllable Image-to-Video Translation: A Case Study on Facial Expression Generation
Fan, L., Huang, W., Gan, C., Huang, J., & Gong, B. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33013510 · Cited by 36
Comprehensive Video Understanding: Video Summarization with Content-Based Video Recommender Design
Jiang, Y., Cui, K., Peng, B., & Xu, C. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00195 · Cited by 36
Ng, Y. B., & Fernando, B. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3021497 · Cited by 36
Lian, J., Dong, P., Zhang, Y., & Pan, J. (2020) · Applied Sciences · doi:10.3390/app10113965 · Cited by 36
Temporally smooth online action detection using cycle-consistent future anticipation
Kim, Y. H., Nam, S., & Kim, S. J. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.107954 · Cited by 36
Device-independent cellular-based indoor location tracking using deep learning
Rizk, H., Abbas, M., & Youssef, M. A. (2021) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2021.101420 · Cited by 36
A comparative study of different machine learning methods for dissipative quantum dynamics
Rodríguez, L. E. H., Ullah, A., Espinosa, K. J. R., Dral, P. O., & Kananenka, A. A. (2022) · Machine Learning Science and Technology · doi:10.1088/2632-2153/ac9a9d · Cited by 37
Combining Static and Dynamic Features for Multivariate Sequence Classification
Leontjeva, A., & Kuzovkin, I. (2016) · IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2016.10 · Cited by 40
Dual GroupGAN: An unsupervised four-competitor (2V2) approach for video anomaly detection
Sun, Z., Wang, P., Wang, Z., & Zhang, M. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110500 · Cited by 35
An Overview of Machine-Learning Methods for Soil Moisture Estimation
Taheri, M., Bigdeli, M., Imanian, H., & Mohammadian, A. (2025) · Water · doi:10.3390/w17111638 · Cited by 36
A deep learning enabled subspace spectral ensemble clustering approach for web anomaly detection
Yuan, G., Li, B. H., Yao, Y., & Zhang, S. (2017) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966347 · Cited by 35
Longitudinal Detection of Radiological Abnormalities with Time-Modulated LSTM
Santeramo, R., Withey, S., & Montana, G. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00889-5_37 · Cited by 38
CF-LSTM: Cascaded Feature-Based Long Short-Term Networks for Predicting Pedestrian Trajectory
Xu, Y., Yang, J., & Du, S. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6943 · Cited by 36
Multi-feature fusion for deep learning to predict plant lncRNA-protein interaction
Wekesa, J. S., Meng, J., & Luan, Y. (2020) · Genomics · doi:10.1016/j.ygeno.2020.05.005 · Cited by 35
Heart Disease prediction using MLP and LSTM models
Djerioui, M., Brik, Y., Ladjal, M., & Attallah, B. (2020) · doi:10.1109/icee49691.2020.9249935 · Cited by 36
Physics-as-Inverse-Graphics: Unsupervised Physical Parameter Estimation from VideoPreprint
Jaques, M., Burke, M., & Hospedales, T. M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.11169 · Cited by 50
STAM: A SpatioTemporal Attention Based Memory for Video Prediction
Chang, Z., Zhang, X., Wang, S., Ma, S., & Gao, W. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3146721 · Cited by 35
Self-Supervised 3D Action Representation Learning With Skeleton Cloud Colorization
Yang, S., Liu, J., Lu, S., Er, M. H., Hu, Y., & Kot, A. C. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3325463 · Cited by 36
Xue, D., Dongwei, G. U. I., Ci, M., Liu, Q., Wei, G., & Liu, Y. (2023) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2023.167908 · Cited by 34
Second-order Temporal Pooling for Action Recognition
Cherian, A., & Gould, S. J. (2018) · International Journal of Computer Vision · doi:10.1007/s11263-018-1111-5 · Cited by 34
Action recognition with multi-scale trajectory-pooled 3D convolutional descriptors
Lu, X., Yao, H., Zhao, S., Sun, X., & Zhang, S. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-017-5251-3 · Cited by 34
Dilated Convolutional Neural Networks for Sequential Manifold-Valued Data
Chakraborty, R., Zhen, X., Vogt, N., Bendlin, B. B., & Singh, V. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.01072 · Cited by 35
Temporally Coherent Embeddings for Self-Supervised Video Representation Learning
Knights, J., Harwood, B., Ward, D., Vanderkop, A., Mackenzie-Ross, O., & Moghadam, P. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412071 · Cited by 34
Recurrent generative adversarial networks for unsupervised WCE video summarization
Lan, L., & Ye, C. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.106971 · Cited by 34
KOHTD: Kazakh offline handwritten text dataset
Toiganbayeva, N., Kasem, M. S., Abdimanap, G. S., Bostanbekov, K. A., Abdallah, A., Alimova, A. N., & Nurseitov, D. B. (2022) · Signal Processing Image Communication · doi:10.1016/j.image.2022.116827 · Cited by 35
Neighbor-Guided Consistent and Contrastive Learning for Semi-Supervised Action Recognition
Wu, J., Sun, W., Gan, T., Ding, N., Jiang, F., Shen, J., & Nie, L. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3265261 · Cited by 34
Deep Learning Improves Global Satellite Observations of Ocean Eddy Dynamics
Martin, S. A., Manucharyan, G. E., & Klein, P. (2024) · Geophysical Research Letters · doi:10.1029/2024gl110059 · Cited by 38
DYAN: A Dynamical Atoms-Based Network for Video Prediction
Liu, W., Sharma, A., Camps, O., & Sznaier, M. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01258-8_11 · Cited by 33
Plant Growth Prediction using Convolutional LSTM
Sakurai, S., Uchiyama, H., Shimada, A., & Taniguchi, R.-I. (2019) · International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP) · doi:10.5220/0007404900002108 · Cited by 33
Cascade multi-head attention networks for action recognition
Wang, J., Peng, X., & Qiao, Y. (2020) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2019.102898 · Cited by 34
BikeNet: Accurate Bike Demand Prediction Using Graph Neural Networks for Station Rebalancing
Guo, R., Jiang, Z., Huang, J., Tao, J., Wang, C., Li, J., & Chen, L. (2019) · IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI) · doi:10.1109/smartworld-uic-atc-scalcom-iop-sci.2019.00153 · Cited by 35
Convolutional LSTM Architecture for Precipitation Nowcasting Using Satellite Data
Gamboa-Villafruela, C. J., Fernández‐Alvarez, J. C., Márquez‐Mijares, M., Pérez‐Alarcón, A., & Batista-Leyva, A. J. (2021) · International Electronic Conference on Atmospheric Sciences (ECAS) · doi:10.3390/ecas2021-10340 · Cited by 36
A comprehensive review of the video-to-text problem
Perez-Martin, J., Bustos, B., Guimarães, S. J. F., Sipiran, I., Pérez, J. E. P., & Said, G. C. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10104-1 · Cited by 36
Fully Convolutional Network-Based Self-Supervised Learning for Semantic Segmentation
Yang, Z., Yu, H., He, Y., Sun, W., Mao, Z., & Mian, A. S. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3172423 · Cited by 34
Self-supervised Learning for Deep Models in Recommendations.Preprint
Yao, T., Yi, X., Cheng, D. Z., Yu, F. X., Menon, A. K., Hong, L., Ed, H., Tjoa, S., Kang, J., & Ettinger, E. (2020) · arXiv (Cornell University) · Cited by 33
VarNet: Exploring Variations for Unsupervised Video Prediction
Jin, B., Hu, Y. H., Zeng, Y., Tang, Q., Liu, S., & Ye, J. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8594264 · Cited by 32
Spatiotemporal Model Based on Deep Learning for ENSO Forecasts
Geng, H., & Wang, T. (2021) · Atmosphere · doi:10.3390/atmos12070810 · Cited by 33
Cloud2Curve: Generation and Vectorization of Parametric Sketches
Das, A., Yang, Y., Hospedales, T. M., Xiang, T., & Song, Y.-Z. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00701 · Cited by 34
Li, Y., Wang, Z., Jiang, W., Xie, Z., Kong, C., & Chang, J. (2022) · Physics of Fluids · doi:10.1063/5.0073109 · Cited by 32
Learning to Recognize Actions From Limited Training Examples Using a Recurrent Spiking Neural Model
Panda, P., & Srinivasa, N. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00126 · Cited by 33
Bihlo, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.05037 · Cited by 32
VPTR: Efficient Transformers for Video Prediction
Ye, X., & Bilodeau, G.-A. (2022) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr56361.2022.9956707 · Cited by 32
Transductive Learning With Prior Knowledge for Generalized Zero-Shot Action Recognition
Su, T., Wang, H., Qi, Q., Wang, L., & He, B. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3284977 · Cited by 31
Learning-Based Genetic Algorithm to Schedule an Extended Flexible Job Shop
Cao, Z., Lin, C., Zhou, M., & Wen, X. (2024) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2024.3413054 · Cited by 32
On the Content Bias in Fréchet Video Distance
Ge, S., Mahapatra, A., Parmar, G., Zhu, J.-Y., & Huang, J.-B. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00695 · Cited by 50
Regularizing Deep Networks by Modeling and Predicting Label Structure
Mostajabi, M., Maire, M., & Shakhnarovich, G. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00590 · Cited by 31
Predicting Visual Context for Unsupervised Event Segmentation in Continuous Photo-streams
del Molino, A. G., Lim, J., & Tan, A. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240624 · Cited by 31
Nano-Intrinsic True Random Number Generation: A Device to Data Study
Kim, J., Nili, H., Truong, N. D., Ahmed, T., Yang, J., Jeong, D. S., Sriram, S., Ranasinghe, D. C., Ippolito, S. J., Chun, H., et al. (2019) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2019.2895045 · Cited by 31
A critical study on the recent deep learning based semi-supervised video anomaly detection methods
Baradaran, M., & Bergevin, R. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-16445-z · Cited by 31
Hierarchical Latent Concept Discovery for Video Event Detection
Li, C., Huang, Z. H., Yang, Y., Cao, J., Sun, X., & Shen, H. T. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2670782 · Cited by 31
Detecting Anomalous Trajectories via Recurrent Neural Networks
Ma, C., Miao, Z., Li, M., Song, S., & Yang, M. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-20870-7_23 · Cited by 31
Multimodal Autoencoder Predicts fNIRS Resting State From EEG Signals
Sirpal, P., Damseh, R., Peng, K., Nguyen, D. K., & Lesage, F. (2021) · Neuroinformatics · doi:10.1007/s12021-021-09538-3 · Cited by 31
Photo-Realistic Video Prediction on Natural Videos of Largely Changing FramesPreprint
Shouno, O. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.08635 · Cited by 31
Sequence Multi-task Learning to Forecast Mental Wellbeing from Sparse Self-reported Data
Spathis, D., Servia-Rodriguez, S., Farrahi, K., Mascolo, C., & Rentfrow, J. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330730 · Cited by 30
Zheng, B., Xu, D., Tan, G., Chen, Y., & Cai, Y. (2023) · Minerals Engineering · doi:10.1016/j.mineng.2023.108179 · Cited by 30
A Physics-Guided Attention-Based Neural Network for Sea Surface Temperature Prediction
Shi, B., Feng, L., He, H., Hao, Y., Peng, Y., Liu, M., Liu, Y., & Liu, J. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3457039 · Cited by 30
Object-Centric Representation Learning from Unlabeled Videos
Gao, R., Jayaraman, D., & Grauman, K. L. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-54193-8_16 · Cited by 30
Metadata
- Authors
- Srivastava, N., Mansimov, E., & Salakhutdinov, R.
- Affiliations
- University of Toronto (CA)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2015
- Pages
- 843-852
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1502.04681
- OpenAlex
- W2116435618
- Cited by
- 1,861
- References
- 30
- Citations by year
- 2026: 3 · 2025: 56 · 2024: 128 · 2023: 148 · 2022: 183 · 2021: 279 · 2020: 308 · 2019: 286 · 2018: 238 · 2017: 146 · 2016: 62 · 2015: 23
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- International Conference on Machine Learning
- Funders
- Raytheon Company
- Nvidia
- Samsung
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- video representation learning, unsupervised learning, long short-term memory networks, LSTM encoder-decoder, video reconstruction, future frame prediction, perceptual features, feature visualization, human action recognition, transfer learning, few-shot learning, out-of-domain generalization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
