The DOI matches its DataCite record; 29 of the 30 references it cites were found in a registry or an index.
Unsupervised Learning of Video Representations using LSTMs
Open accessAbstract
We use multilayer Long Short Term Memory (LSTM) networks to learn representations of video sequences. Our model uses an encoder LSTM to map an input sequence into a fixed length representation. This representation is decoded using single or multiple decoder LSTMs to perform different tasks, such as reconstructing the input sequence, or predicting the future sequence. We experiment with two kinds of input sequences - patches of image pixels and high-level representations ("percepts") of video frames extracted using a pretrained convolutional net. We explore different design choices such as whether the decoder LSTMs should condition on the generated output. We analyze the outputs of the model qualitatively to see how well the model can extrapolate the learned video representation into the future and into the past. We try to visualize and interpret the learned features. We stress test the model by running it on longer time scales and on out-of-domain data. We further evaluate the representations by finetuning them for a supervised learning problem - human action recognition on the UCF-101 and HMDB-51 datasets. We show that the representations help improve classification accuracy, especially when there are only a few training examples. Even models pretrained on unrelated datasets (300 hours of YouTube videos) can help action recognition performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This is the first time that motion prediction with cross-dimensional learning has been used for self-supervised learning in the context of HAR.”
From Self-supervised Human Activity Recognition by Learning to Predict Cross-Dimensional Motion (2021) · cites this paper as [23]
In the citing paper
“While motion prediction has been used in the field of computer vision for self-supervised learning [23, 26], our model is novel in that the cross-dimensional aspect results in more effective learning.”
From Self-supervised Human Activity Recognition by Learning to Predict Cross-Dimensional Motion (2021) · cites this paper as [23]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Two-Stream Convolutional Networks for Action Recognition in Videos
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1406.2199 · Cited by 6,756
Large-Scale Video Classification with Convolutional Neural Networks
Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., & Fei-Fei, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.223 · Cited by 6,354
Show and tell: A neural image caption generator
Vinyals, O., Toshev, A., Bengio, S., & Erhan, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298935 · Cited by 6,318
3D Convolutional Neural Networks for Human Action Recognition
Ji, S., Xu, W., Yang, M., & Yu, K. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.59 · Cited by 6,313
Long-term recurrent convolutional networks for visual recognition and description
Donahue, J., Hendricks, L. A., Guadarrama, S., Rohrbach, M., Venugopalan, S., Darrell, T., & Saenko, K. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298878 · Cited by 5,228
Research works printed but not linked: 1
- Hochreiter, Sepp and Schmidhuber, J¨ urgen. Long short-term memory. Neural Computation , 9(8):1735-1780, 1997.
Cited by
Sorted by citations
Items 701–800 of 1,005
Gao, J., Zhang, T., & Xu, C. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240566 · Cited by 30
Dynamic Environment Prediction in Urban Scenes using Recurrent Representation Learning
Itkina, M., Driggs-Campbell, K., & Kochenderfer, M. J. (2019) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2019.8917271 · Cited by 30
Deep Multi-Kernel Convolutional LSTM Networks and an Attention-Based Mechanism for Videos
Agethen, S., & Hsu, W. H. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2932564 · Cited by 31
Visual exploration of latent space for traditional Chinese music
Shen, J., Wang, R., & Shen, H. (2020) · Visual Informatics · doi:10.1016/j.visinf.2020.04.003 · Cited by 30
Bhagat, S., Uppal, S., Yin, Z., & Lim, N. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58592-1_7 · Cited by 30
Purely Attention Based Local Feature Integration for Video Classification
Long, X., de Melo, G., He, D., Li, F., Chi, Z., Wen, S., & Gan, C. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3029554 · Cited by 30
Recurrent attention network using spatial-temporal relations for action recognition
Zhang, M., Yang, Y., Ji, Y., Xie, N., & Shen, F. (2017) · Signal Processing · doi:10.1016/j.sigpro.2017.12.008 · Cited by 30
Deep Endoscope: Intelligent Duct Inspection for the Avionic Industry
Martelli, S., Mazzei, L., Canali, C., Guardiani, P., Giunta, S., Ghiazza, A., Mondino, I., Cannella, F., Murino, V., & Bue, A. D. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2807797 · Cited by 31
Overview of Research in the field of Video Compression using Deep Neural Networks
Birman, R., Segal, Y., & Hadar, O. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-019-08572-3 · Cited by 32
Noise Estimation Using Density Estimation for Self-Supervised Multimodal Learning
Amrani, E., Ben‐Ari, R., Rotman, D., & Bronstein, A. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i8.16822 · Cited by 35
Action Recognition Based on Efficient Deep Feature Learning in the Spatio-Temporal Domain
Husain, F., Dellen, B. K., & Carme Torras, A. (2016) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2016.2529686 · Cited by 29
Jeon, H., Kum, D., & Jeong, W.-Y. (2018) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2018.8500567 · Cited by 29
Appearance and Motion Enhancement for Video-Based Person Re-Identification
Li, S., Yu, H., & Hu, H. R. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6802 · Cited by 29
Learning Predictive Models from Observation and Interaction
Schmeckpeper, K., Xie, A., Rybkin, O., Tian, S., Daniilidis, K., Levine, S., & Finn, C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58565-5_42 · Cited by 30
Few-Shot Learning of Video Action Recognition Only Based on Video Contents
Yang, B., Lu, Y., & He, W. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093481 · Cited by 29
Motion-Aware Feature Enhancement Network for Video Prediction
Lin, X., Zou, Q., Xu, X., Huang, Y., & Tian, Y. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.2987141 · Cited by 30
Context-Aware Human Trajectories Prediction via Latent Variational Model
Berenguer, A. D., Alioscha‐Perez, M., Oveneke, M. C., & Hichem Sahli, B. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.3014869 · Cited by 30
Spatial–Temporal Prediction of Vegetation Index With Deep Recurrent Neural Networks
Yu, W., Li, J., Liu, Q., Zhao, J., Dong, Y., Wang, C., Lin, S., Zhu, X., & Zhang, H. (2021) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2021.3064814 · Cited by 29
Facing airborne attacks on ADS-B data with autoencoders
Fried, A., & Last, M. (2021) · Computers & Security · doi:10.1016/j.cose.2021.102405 · Cited by 30
Self-supervised Learning for Sonar Image Classification
Preciado-Grijalva, A., Wehbe, B., Firvida, M. B., & Valdenegro-Toro, M. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00156 · Cited by 33
Kwak, D., Choi, S., & Chang, W. (2022) · Information Sciences · doi:10.1016/j.ins.2022.12.042 · Cited by 30
Anomaly detection in thermal images using deep neural networks
Cai, L., & Li, Y. (2017) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2017.8296692 · Cited by 29
Unsupervised Video Representation Learning by Bidirectional Feature Prediction
Behrmann, N., Gall, J., & Noroozi, M. (2021) · 2021 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv48630.2021.00171 · Cited by 28
ExtDM: Distribution Extrapolation Diffusion Model for Video Prediction
Zhang, Z., Hu, J., Cheng, W., Paudel, D. P., & Yang, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01827 · Cited by 32
Weakly Semantic Guided Action Recognition
Yu, T., Wang, L., Da, C., Gu, H., Xiang, S., & Pan, C. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2907060 · Cited by 28
Basha, S. H. S., Pulabaigari, V., & Mukherjee, S. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-022-12856-6 · Cited by 29
Short-term daily precipitation forecasting with seasonally-integrated autoencoder
Ponnoprat, D. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2021.107083 · Cited by 28
Multi-Modal Temporal Convolutional Network for Anticipating Actions in Egocentric Videos
Zatsarynna, O., Farha, Y. A., & Gall, J. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00254 · Cited by 31
Scenes-Objects-Actions: A Multi-task, Multi-label Video Dataset
Ray, J., Wang, H., Tran, D., Wang, Y., Feiszli, M., Torresani, L., & Paluri, M. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01264-9_39 · Cited by 28
Learning Traffic Behaviors by Extracting Vehicle Trajectories from Online Video Streams
Ren, X., Wang, D., Laskey, M., & Goldberg, K. Y. (2018) · IEEE International Conference on Automation Science and Engineering (CASE) · doi:10.1109/coase.2018.8560597 · Cited by 28
DeepLandscape: Adversarial Modeling of Landscape Videos
Logacheva, E., Suvorov, R. E., Khomenko, O., Mashikhin, A., & Lempitsky, V. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58592-1_16 · Cited by 28
Consistent Generative Query NetworksPreprint
Kumar, A., Eslami, S. M. A., Rezende, D. J., Garnelo, M., Viola, F., Lockhart, E., & Shanahan, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.02033 · Cited by 28
Towards deep clustering of human activities from wearables
Abedin, A., Motlagh, F., Shi, Q., Rezatofighi, H., & Ranasinghe, D. (2020) · Proceedings of the 2020 International Symposium on Wearable Computers · doi:10.1145/3410531.3414312 · Cited by 27
AutoSoccerPose: Automated 3D posture Analysis of Soccer Shot Movements
Yeung, C., Ide, K., & Fujii, K. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00327 · Cited by 27
Motion-supervised Co-Part Segmentation
Siarohin, A., Roy, S., Lathuilière, S., Tulyakov, S., Ricci, E., & Sebe, N. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412520 · Cited by 27
Center-of-Mass-based Robust Grasp Planning for Unknown Objects Using Tactile-Visual Sensors
Feng, Q., Chen, Z., Deng, J., Gao, C., Zhang, J., & Knoll, A. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9196815 · Cited by 28
Designing Interpretable Recurrent Neural Networks for Video Reconstruction via Deep Unfolding
Luong, H. V., Joukovsky, B., & Deligiannis, N. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3069296 · Cited by 29
Federated Variational Learning for Anomaly Detection in Multivariate Time Series
Zhang, K., Jiang, Y., Seversky, L. M., Xu, C., Liu, D., & Song, H. (2021) · IEEE International Performance, Computing, and Communications Conference · doi:10.1109/ipccc51483.2021.9679367 · Cited by 30
Data-Driven Haptic Texture Modeling and Rendering Based on Deep Spatio-Temporal Networks
Joolee, J. B., & Jeon, S. (2021) · IEEE Transactions on Haptics · doi:10.1109/toh.2021.3137936 · Cited by 27
MAD: Self-Supervised Masked Anomaly Detection Task for Multivariate Time Series
Fu, Y., & Feng, X. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9892218 · Cited by 34
A 3D-CAE-CNN model for Deep Representation Learning of 3D images
Pintelas, E. G., & Pintelas, P. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.104978 · Cited by 27
Yan, B., Yang, C., Chen, F., Takeda, K., & Wang, C. (2023) · Journal of Computer Science and Technology · doi:10.1007/s11390-021-1103-8 · Cited by 28
Learning explicit video attributes from mid-level representation for video captioning
Nian, F., Li, T., Wang, Y., Wu, X., Ni, B., & Xu, C. (2017) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2017.06.012 · Cited by 27
Zhao, N., Zhang, H., Hong, R., Wang, M., & Chua, T. (2017) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2722687 · Cited by 27
Unsupervised Deep Video Hashing with Balanced Rotation
Wu, G., Liu, L., Guo, Y., Ding, G., Han, J., Shen, J., & Shao, L. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/429 · Cited by 27
Region-based Activity Recognition Using Conditional GAN
Li, X., Zhang, Y., Zhang, J., Chen, Y., Li, H., Marsic, I., & Burd, R. S. (2017) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3123266.3123365 · Cited by 27
Attention-Based Video Hashing for Large-Scale Video Retrieval
Wang, Y., Nie, X., Shi, Y., Zhou, X., & Yin, Y. (2019) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2019.2963339 · Cited by 27
Continual Learning with Gated Incremental Memories for sequential data processing
Cossu, A., Carta, A., & Bacciu, D. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207550 · Cited by 28
Temporal Hallucinating for Action Recognition with Few Still Images
Wang, Y., Zhou, L., & Qiao, Y. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00557 · Cited by 26
Sound2Sight: Generating Visual Dynamics from Sound and Context
Chatterjee, M., & Cherian, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58583-9_42 · Cited by 29
Scene image and human skeleton-based dual-stream human action recognition
Xu, Q., Zheng, W., Song, Y. H., Zhang, C., Yuan, X., & Li, Y. (2021) · Pattern Recognition Letters · doi:10.1016/j.patrec.2021.06.003 · Cited by 26
Write Like You: Synthesizing Your Cursive Online Chinese Handwriting via Metric‐based Meta Learning
Tang, S., & Lian, Z. (2021) · Computer Graphics Forum · doi:10.1111/cgf.142621 · Cited by 26
Self-Supervised Representation Learning for Videos by Segmenting via Sampling Rate Order Prediction
Huang, J., Huang, Y., Wang, Q., Yang, W., & Meng, H. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3114209 · Cited by 26
Radar Echo Spatiotemporal Sequence Prediction Using an Improved ConvGRU Deep Learning Model
He, W., Xiong, T., Wang, H., He, J., Ren, X., Yan, Y., & Tan, L. (2022) · Atmosphere · doi:10.3390/atmos13010088 · Cited by 26
Zhu, H., Shou, T., Guo, R., Jiang, Z., Wang, Z., Wang, Z., Yu, Z., Zhang, W., Wang, C., & Chen, L. (2022) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2022.3145979 · Cited by 26
Lee, S., Lee, I.-B., Yeo, U.-H., Kim, J., & Kim, R.-W. (2022) · Agriculture · doi:10.3390/agriculture12030318 · Cited by 28
A novel recurrent hybrid network for feature fusion in action recognition
Yu, S., Cheng, Y., Xie, L., Luo, Z., Huang, M., & Li, S. (2017) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2017.09.007 · Cited by 26
Palm oil fresh fruit bunch ripeness grading identification using color features
Sabri, N., Ibrahim, Z., Syahlan, S., Jamil, N., & Mangshor, N. N. A. (2018) · Journal of Fundamental and Applied Sciences · doi:10.4314/jfas.v9i4s.32 · Cited by 26
Frontiers of Multimedia Research
Chang, S.-F. (2017) · doi:10.1145/3122865 · Cited by 26
Pointly-Supervised Action Localization
Mettes, P., & Snoek, C. G. M. (2018) · International Journal of Computer Vision · doi:10.1007/s11263-018-1120-4 · Cited by 26
Learning Discriminative Video Representations Using Adversarial Perturbations
Wang, J., & Cherian, A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01225-0_42 · Cited by 26
Learning How to Smile: Expression Video Generation With Conditional Adversarial Recurrent Nets
Wang, W., Alameda-Pineda, X., Xu, D., Ricci, E., & Sebe, N. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2963621 · Cited by 26
Tamper-Proofing Video With Hierarchical Attention Autoencoder Hashing on Blockchain
Bui, T., Cooper, D., Collomosse, J. P., Bell, M. R., Green, A., Sheridan, J., Higgins, J., Das, A., Keller, D. J. R., & Thereaux, O. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.2967640 · Cited by 26
Azari, E., & Vrudhula, S. B. K. (2020) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3366634 · Cited by 26
Liang, Q. Y., Zeng, Y., & Xu, B. (2020) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2020.00051 · Cited by 27
Learning audio sequence representations for acoustic event classification
Zhang, Z., Liu, D., Han, J., Qian, K., & Schuller, B. W. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115007 · Cited by 28
Lu, S., Zhang, W., Guo, J., Liu, H., Li, H., & Wang, N. (2024) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2024.102366 · Cited by 25
Moon, Y., Lee, Y., Hwang, Y., & Jeong, J. (2024) · Energies · doi:10.3390/en17153666 · Cited by 25
Tayyab, M., Alateyah, S. A., Alnusayri, M., Alatiyyah, M. H., AlHammadi, D. A., Jalal, A., & Liu, H. (2025) · Sensors · doi:10.3390/s25020441 · Cited by 25
Contextual RNN-GANs for Abstract Reasoning Diagram Generation
Kulharia, V., Ghosh, A., Mukerjee, A., Namboodiri, V. P., & Bansal, M. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10738 · Cited by 25
Scalable Discrete Supervised Multimedia Hash Learning With Clustering
Zhang, S., Li, J., Jiang, M., Yuan, P., & Zhang, B. (2017) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2017.2710345 · Cited by 25
Let the robot tell: Describe car image with natural language via LSTM
Chen, L. F., He, Y., & Fan, L. (2017) · Pattern Recognition Letters · doi:10.1016/j.patrec.2017.09.007 · Cited by 25
Adversarial Learning-Based On-Line Anomaly Monitoring for Assured Autonomy
Patel, N., Saridena, A. N., Choromanska, A., Krishnamurthy, P., & Khorrami, F. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593375 · Cited by 25
Z-Order Recurrent Neural Networks for Video Prediction
Zhang, J., Wang, Y., Long, M., Jianmin, W., & Yu, P. S. (2019) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2019.00048 · Cited by 26
Video classification and retrieval through spatio-temporal Radon features
Sasithradevi, A., & Roomi, S. M. M. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.107099 · Cited by 25
Focus on the Positives: Self-Supervised Learning for Biodiversity Monitoring
Pantazis, O., Brostow, G., Jones, K. E., & Aodha, O. M. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01041 · Cited by 26
Rock mass fracture maps prediction based on spatiotemporal image sequence modeling
Xue, Y., Cao, Y., Zhou, M., Zhang, F., Shen, K., & Jia, F. (2022) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12841 · Cited by 25
DynamicNet: A time-variant ODE network for multi-step wind speed prediction
Ye, R., Li, X., Ye, Y., & Zhang, B. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.04.004 · Cited by 25
Look for the Change: Learning Object States and State-Modifying Actions from Untrimmed Web Videos
Souček, T., Alayrac, J.-B., Miech, A., Laptev, I., & Šivic, J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01357 · Cited by 25
Exploring multimodal video representation for action recognition
Wang, C., Yang, H., & Meinel, C. (2016) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2016.7727435 · Cited by 26
Sequential data classification by dynamic state warping
Gong, Z., & Chen, H. (2017) · Knowledge and Information Systems · doi:10.1007/s10115-017-1139-9 · Cited by 25
Video Error Concealment Using Deep Neural Networks
Sankisa, A., Punjabi, A., & Katsaggelos, A. K. (2018) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2018.8451090 · Cited by 27
A Survey of Deep Learning Solutions for Multimedia Visual Content Analysis
Nadeem, M. S., Franqueira, V. N. L., Zhai, X., & Kurugöllü, F. (2019) · IEEE Access · doi:10.1109/access.2019.2924733 · Cited by 27
Multi-level Attention Networks for Multi-step Citywide Passenger Demands Prediction
Zhou, X., Shen, Y., Huang, L., Zang, T., & Zhu, Y. (2019) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2019.2948005 · Cited by 26
Unsupervised Disentanglement of Pose, Appearance and Background from Images and Videos
Dündar, A., Shih, K. J., Garg, A., Pottorff, R., Tao, A., & Catanzaro, B. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3055560 · Cited by 25
CMS-LSTM: Context Embedding and Multi-Scale Spatiotemporal Expression LSTM for Predictive Learning
Chai, Z., Xu, Z., Bail, Y., Lin, Z., & Yuan, C. (2022) · 2022 IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme52920.2022.9859659 · Cited by 24
MoonShot: Towards Controllable Video Generation and Editing with Motion-Aware Multimodal Conditions
Zhang, D. J., Li, D., Le, H., Shou, M. Z., Xiong, C., & Sahoo, D. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02346-1 · Cited by 66
A fully trainable network with RNN-based pooling
Li, S., Li, W., Cook, C., Zhu, C., & Gao, Y. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.02.004 · Cited by 24
Predicting Future Instance Segmentations by Forecasting Convolutional Features
Luc, P., Couprie, C., LeCun, Y., & Verbeek, J. J. (2018) · HAL · Cited by 24
Learning a deep predictive coding network for a semi-supervised 3D-hand pose estimation
Banzi, J. F., Bulugu, I., & Ye, Z. (2020) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2020.1003090 · Cited by 24
From Local to Global Semantic Clone Detection
Yuan, Y., Kong, W., Hou, G., Hu, Y. Z., Watanabe, M., & Fukuda, A. (2020) · International Conference on Dependable Systems and Their Applications (DSA) · doi:10.1109/dsa.2019.00012 · Cited by 24
Fu, X., Meng, H., Wang, X., Yang, H., & Wang, J. (2022) · PLoS ONE · doi:10.1371/journal.pone.0263030 · Cited by 26
Learning to Align Sequential Actions in the Wild
Liu, W., Tekin, B., Coskun, H., Vineet, V., Fua, P., & Pollefeys, M. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00222 · Cited by 25
A deep learning approach for error detection and quantification in extrusion-based bioprinting
Bonatti, A. F., Vozzi, G., Chua, C. K., & Maria, C. D. (2022) · Materials Today Proceedings · doi:10.1016/j.matpr.2022.09.006 · Cited by 24
Tell Me What Happened: Unifying Text-guided Video Completion via Multimodal Masked Video Generation
Fu, T.-J., Yu, L., Zhang, N., Fu, C.-Y., Su, J.-C., Wang, W. Y., & Bell, S. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01029 · Cited by 27
End-to-End Video Text Spotting with Transformer
Wu, W., Cai, Y., Shen, C., Zhang, D., Fu, Y., Zhou, H., & Luo, P. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02063-1 · Cited by 24
Scene Understanding Using Deep Learning
Husain, F., Dellen, B. K., & Carme Torras, A. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-811318-9.00020-x · Cited by 24
Pandhre, S., Mittal, H., Gupta, M., & Balasubramanian, V. N. (2018) · Joint International Conference on Data Science & Management of Data (CODS-COMAD) · doi:10.1145/3152494.3152512 · Cited by 27
Yu, T., Guo, C., Wang, L., Xiang, S., & Pan, C. (2018) · IEEE Signal Processing Letters · doi:10.1109/lsp.2018.2843295 · Cited by 24
Sequence to Sequence Pattern Learning Algorithm for Real-Time Anomaly Detection in Network Traffic
Loganathan, G., Samarabandu, J. K., & Wang, X. (2018) · Conference proceedings - Canadian Conference on Electrical and Computer Engineering · doi:10.1109/ccece.2018.8447597 · Cited by 25
Metadata
- Authors
- Srivastava, N., Mansimov, E., & Salakhutdinov, R.
- Affiliations
- University of Toronto (CA)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2015
- Pages
- 843-852
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1502.04681
- OpenAlex
- W2116435618
- Cited by
- 1,861
- References
- 30
- Citations by year
- 2026: 3 · 2025: 56 · 2024: 128 · 2023: 148 · 2022: 183 · 2021: 279 · 2020: 308 · 2019: 286 · 2018: 238 · 2017: 146 · 2016: 62 · 2015: 23
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- International Conference on Machine Learning
- Funders
- Raytheon Company
- Nvidia
- Samsung
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- video representation learning, unsupervised learning, long short-term memory networks, LSTM encoder-decoder, video reconstruction, future frame prediction, perceptual features, feature visualization, human action recognition, transfer learning, few-shot learning, out-of-domain generalization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
