The DOI matches its DataCite record; 29 of the 30 references it cites were found in a registry or an index.
Unsupervised Learning of Video Representations using LSTMs
Open accessAbstract
We use multilayer Long Short Term Memory (LSTM) networks to learn representations of video sequences. Our model uses an encoder LSTM to map an input sequence into a fixed length representation. This representation is decoded using single or multiple decoder LSTMs to perform different tasks, such as reconstructing the input sequence, or predicting the future sequence. We experiment with two kinds of input sequences - patches of image pixels and high-level representations ("percepts") of video frames extracted using a pretrained convolutional net. We explore different design choices such as whether the decoder LSTMs should condition on the generated output. We analyze the outputs of the model qualitatively to see how well the model can extrapolate the learned video representation into the future and into the past. We try to visualize and interpret the learned features. We stress test the model by running it on longer time scales and on out-of-domain data. We further evaluate the representations by finetuning them for a supervised learning problem - human action recognition on the UCF-101 and HMDB-51 datasets. We show that the representations help improve classification accuracy, especially when there are only a few training examples. Even models pretrained on unrelated datasets (300 hours of YouTube videos) can help action recognition performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This is the first time that motion prediction with cross-dimensional learning has been used for self-supervised learning in the context of HAR.”
From Self-supervised Human Activity Recognition by Learning to Predict Cross-Dimensional Motion (2021) · cites this paper as [23]
In the citing paper
“While motion prediction has been used in the field of computer vision for self-supervised learning [23, 26], our model is novel in that the cross-dimensional aspect results in more effective learning.”
From Self-supervised Human Activity Recognition by Learning to Predict Cross-Dimensional Motion (2021) · cites this paper as [23]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Two-Stream Convolutional Networks for Action Recognition in Videos
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1406.2199 · Cited by 6,756
Large-Scale Video Classification with Convolutional Neural Networks
Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., & Fei-Fei, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.223 · Cited by 6,354
Show and tell: A neural image caption generator
Vinyals, O., Toshev, A., Bengio, S., & Erhan, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298935 · Cited by 6,318
3D Convolutional Neural Networks for Human Action Recognition
Ji, S., Xu, W., Yang, M., & Yu, K. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.59 · Cited by 6,313
Long-term recurrent convolutional networks for visual recognition and description
Donahue, J., Hendricks, L. A., Guadarrama, S., Rohrbach, M., Venugopalan, S., Darrell, T., & Saenko, K. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298878 · Cited by 5,228
Research works printed but not linked: 1
- Hochreiter, Sepp and Schmidhuber, J¨ urgen. Long short-term memory. Neural Computation , 9(8):1735-1780, 1997.
Cited by
Sorted by citations
Items 401–500 of 1,005
Towards Micro-video Understanding by Joint Sequential-Sparse Modeling
Liu, M., Nie, L., Wang, M., & Chen, B. (2017) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3123266.3123341 · Cited by 74
DriveGAN: Towards a Controllable High-Quality Neural Simulation
Kim, S. W., Philion, J., Torralba, A., & Fidler, S. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00576 · Cited by 72
Spatio-Temporal Neural Networks for Space-Time Series Forecasting and Relations Discovery
Ziat, A., Delasalles, E., Denoyer, L., & Gallinari, P. (2017) · Proceedings · doi:10.1109/icdm.2017.80 · Cited by 76
Deep Learning for Proactive Network Monitoring and Security Protection
Nguyen, G., Dlugolinský, Š., Tran, V., & García, Á. L. (2020) · IEEE Access · doi:10.1109/access.2020.2968718 · Cited by 75
Zuo, Z., Ma, L., Liang, S., Liang, J., Zhang, H., & Liu, T. (2022) · Process Safety and Environmental Protection · doi:10.1016/j.psep.2022.06.036 · Cited by 72
Unsupervised Action Segmentation by Joint Representation Learning and Online Clustering
Kumar, S., Haresh, S., Ahmed, A., Konin, A., Zia, M. Z., & Tran, Q.-H. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01954 · Cited by 72
Forecast the Plausible Paths in Crowd Scenes
Su, H., Zhu, J., Dong, Y., & Zhang, B. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/386 · Cited by 72
A Review of Artificial Intelligence Algorithms Used for Smart Machine Tools
Chang, C., Lee, H.-W., & Liu, C.-H. (2018) · Inventions · doi:10.3390/inventions3030041 · Cited by 76
Yengera, G., Mutter, D., Marescaux, J., & Padoy, N. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.08569 · Cited by 85
Unsupervised Learning of Object Structure and Dynamics from VideosPreprint
Minderer, M., Sun, C., Villegas, R., Cole, F. H., Murphy, K. P., & Lee, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.07889 · Cited by 79
Unsupervised Feature Learning of Human Actions As Trajectories in Pose Embedding Manifold
Kundu, J. N., Gor, M., Uppala, P. K., & Radhakrishnan, V. B. (2019) · 2019 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2019.00160 · Cited by 72
Sensory cortex is optimized for prediction of future input
Singer, Y., Teramoto, Y., Willmore, B. D. B., King, A. J., Schnupp, J. W. H., & Harper, N. S. (2018) · eLife · doi:10.7554/elife.31557 · Cited by 78
VMRNN: Integrating Vision Mamba and LSTM for Efficient and Accurate Spatiotemporal Forecasting
Tang, Y., Dong, P., Tang, Z., Chu, X., & Liang, J. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00575 · Cited by 70
Action Prediction From Videos via Memorizing Hard-to-Predict Samples
Kong, Y., Gao, S., Sun, B., & Fu, Y. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12324 · Cited by 72
Learning representations of multivariate time series with missing data
Bianchi, F. M., Livi, L., Mikalsen, K. Ø., Kampffmeyer, M., & Jenssen, R. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.106973 · Cited by 74
Multi-Step Prediction of Occupancy Grid Maps With Recurrent Neural Networks
Mohajerin, N., & Rohani, M. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01085 · Cited by 69
Video Representation Learning Using Discriminative Pooling
Wang, J., Cherian, A., Porikli, F., & Gould, S. J. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00126 · Cited by 69
Convolutional Spiking Neural Networks for Spatio-Temporal Feature Extraction
Samadzadeh, A., Far, F. S. T., Javadi, A., Nickabadi, A., & Chehreghani, M. H. (2023) · Neural Processing Letters · doi:10.1007/s11063-023-11247-8 · Cited by 69
Unsupervised Video Summarization With Cycle-Consistent Adversarial LSTM Networks
Yuan, L., Tay, F. E. H., Li, P., & Feng, J. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2959451 · Cited by 71
Learning Temporal Embeddings for Complex Video Analysis
Ramanathan, V., Tang, K., Mori, G., & Fei-Fei, L. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.508 · Cited by 73
Wang, P., Wen, J., Si, C., Qian, Y., & Wang, L. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3207577 · Cited by 70
Attentive Semantic Video Generation Using Captions
Marwah, T., Mittal, G., & Balasubramanian, V. N. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.159 · Cited by 69
Looking Ahead: Anticipating Pedestrians Crossing with Future Frames Prediction
Chaâbane, M. A., Trabelsi, A., Blanchard, N., & Beveridge, R. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093426 · Cited by 68
Rethinking Self-supervised Correspondence Learning: A Video Frame-level Similarity Perspective
Xu, J., & Wang, X. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00992 · Cited by 71
Learning Cross-Modal Contrastive Features for Video Domain Adaptation
Kim, D., Tsai, Y., Zhuang, B., Yu, X., Sclaroff, S., Saenko, K., & Chandraker, M. K. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01336 · Cited by 68
Deep features for automatic spoofing detection
Qian, Y., Chen, N., & Yu, K. (2016) · Speech Communication · doi:10.1016/j.specom.2016.10.007 · Cited by 69
Only Time Can Tell: Discovering Temporal Data for Temporal Modeling
Sevilla-Lara, L., Zha, S., Yan, Z., Goswami, V., Feiszli, M., & Torresani, L. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00058 · Cited by 68
An Encoder-Decoder Based Approach for Anomaly Detection with Application in Additive Manufacturing
Tan, Y., Jin, B., Nettekoven, A., Chen, Y., Yue, Y., Topcu, U., & Sangiovanni-Vincentelli, A. L. (2019) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2019.00171 · Cited by 71
NeuralFusion: Online Depth Fusion in Latent Space
Weder, S., Schönberger, J. L., Pollefeys, M., & Oswald, M. R. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00318 · Cited by 67
Learning end-to-end video classification with rank-pooling
Fernando, B., & Gould, S. J. (2016) · International Conference on Machine Learning · Cited by 66
Change Detection in Image Time-Series Using Unsupervised LSTM
Saha, S., Bovolo, F., & Bruzzone, L. (2020) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2020.3043822 · Cited by 66
STRPM: A Spatiotemporal Residual Predictive Model for High-Resolution Video Prediction
Chang, Z., Zhang, X., Wang, S., Ma, S., & Gao, W. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01356 · Cited by 68
Convolutional Invasion and Expansion Networks for Tumor Growth Prediction
Zhang, L., Lü, L., Summers, R. M., Kebebew, E., & Yao, J. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2774044 · Cited by 68
Forecast of Solar Energy Production - A Deep Learning Approach
Zhang, R., Feng, M., Zhang, W., Lu, S., & Wang, F. (2018) · IEEE International Conference on Big Knowledge (ICBK) · doi:10.1109/icbk.2018.00018 · Cited by 67
Ahmad, T., Wu, J., Alwageed, H. S., Khan, F. N., Khan, J., & Lee, Y. (2023) · IEEE Access · doi:10.1109/access.2023.3263155 · Cited by 67
Lindroth, H. L., Nalaie, K., Raghu, R., Ayala, I. N., Busch, C., Bhattacharyya, A., Franco, P. M., Diedrich, D. A., Pickering, B. W., & Herasevich, V. (2024) · Journal of Imaging · doi:10.3390/jimaging10040081 · Cited by 71
Chen, X., Song, L., & Yang, X. (2016) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2239260 · Cited by 65
Sequential Learning-Based Energy Consumption Prediction Model for Residential and Commercial Sectors
Haq, I. U., Ullah, A., Khan, S. U., Khan, N., Lee, M. Y., Rho, S., & Baik, S. W. (2021) · Mathematics · doi:10.3390/math9060605 · Cited by 67
Bringing Alive Blurred Moments
Purohit, K., Shah, A., & Rajagopalan, A. N. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00699 · Cited by 64
Lower Limb Kinematics Trajectory Prediction Using Long Short-Term Memory Neural Networks
Zaroug, A., Lai, D. T. H., Mudie, K. L., & Begg, R. K. (2020) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2020.00362 · Cited by 69
Lyu, J., Li, G., Wang, C., Qin, C., Wang, S., Dou, Q., & Qin, J. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102760 · Cited by 66
SkeletonMAE: Graph-based Masked Autoencoder for Skeleton Sequence Pre-training
Yan, H., Liu, Y., Wei, Y., Li, Z., Li, G., & Lin, L. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00516 · Cited by 76
Every Smile is Unique: Landmark-Guided Diverse Smile Generation
Wang, W., Alameda-Pineda, X., Xu, D., Fua, P., Ricci, E., & Sebe, N. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00740 · Cited by 64
Pathological Gait Classification Using Kinect v2 and Gated Recurrent Neural Networks
Jun, K., Lee, Y., Lee, S., Lee, D.-W., & Kim, M. S. (2020) · IEEE Access · doi:10.1109/access.2020.3013029 · Cited by 64
Which Way Are You Going? Imitative Decision Learning for Path Forecasting in Dynamic Scenes
Li, Y. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00038 · Cited by 63
Pustokhina, I. V., Pustokhin, D. A., Aswathy, R. H., Jayasankar, T., Jeyalakshmi, C., García‐Díaz, V., & Shankar, K. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102706 · Cited by 63
Watching the World Go By: Representation Learning from Unlabeled VideosPreprint
Gordon, D., Ehsani, K., Fox, D., & Farhadi, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.07990 · Cited by 88
Prediction of Sea Ice Motion With Convolutional Long Short-Term Memory Networks
Petrou, Z. I., & Tian, Y. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2909057 · Cited by 62
Learning the Predictability of the Future
Surís, D., Liu, R., & Vondrick, C. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01242 · Cited by 62
Requena‐Mesa, C., Benson, V., Reichstein, M., Runge, J., & Denzler, J. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00124 · Cited by 69
A Novel AI-Based System for Detection and Severity Prediction of Dementia Using MRI
Jain, V., Nankar, O., Jerrish, D. J., Gite, S., Patil, S., & Kotecha, K. V. (2021) · IEEE Access · doi:10.1109/access.2021.3127394 · Cited by 62
Learning To Recognize Procedural Activities with Distant Supervision
Lin, X., Petroni, F., Bertasius, G., Rohrbach, M., Chang, S., & Torresani, L. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01348 · Cited by 70
IA-LSTM: Interaction-Aware LSTM for Pedestrian Trajectory Prediction
Yang, J., Chen, Y., Du, S., Chen, B., & Príncipe, J. C. (2024) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2024.3359237 · Cited by 70
CSVideoNet: A Real-Time End-to-End Learning Framework for High-Frame-Rate Video Compressive Sensing
Xu, K., & Ren, F. (2018) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2018.00187 · Cited by 62
Multi-view Action Recognition Using Cross-View Video Prediction
Vyas, S., Rawat, Y. S., & Shah, M. A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58583-9_26 · Cited by 62
Self-supervised Spatiotemporal Feature Learning by Video Geometric TransformationsPreprint
Jing, L., & Tian, Y. (2018) · arXiv (Cornell University) · Cited by 62
An Exploratory Analysis on Visual Counterfeits Using Conv-LSTM Hybrid Architecture
Hashmi, M. F., Ashish, B. K. K., Keskar, A. G., Bokde, N. D., Yoon, J. H., & Geem, Z. W. (2020) · IEEE Access · doi:10.1109/access.2020.2998330 · Cited by 62
Toward End-to-End Deception Detection in Videos
Karimi, H., Tang, J., & Li, Y. (2018) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2018.8621909 · Cited by 63
SkeletonMAE: Spatial-Temporal Masked Autoencoders for Self-Supervised Skeleton Action Recognition
Wu, W., Hua, Y., Zheng, C., Wu, S., Chen, C., & Lu, A. (2023) · 2023 IEEE International Conference on Multimedia and Expo Workshops (ICMEW) · doi:10.1109/icmew59549.2023.00045 · Cited by 60
“Self-supervised learning aims to extract feature representations without using labeled data and achieves promising performance in image-based and video-based representation learning [11, 12].”
BackgroundStructured Images for RGB-D Action Recognition
Wang, P., Wang, S., Gao, Z., Hou, Y., & Li, W. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.123 · Cited by 60
An Energy-Based Generative Adversarial Forecaster for Radar Echo Map Extrapolation
Xie, P., Li, X., Ji, X., Chen, X., Chen, Y., Liu, J., & Ye, Y. (2020) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2020.3023950 · Cited by 60
Learning by Aligning Videos in Time
Haresh, S., Kumar, S., Coskun, H., Syed, S. N., Konin, A., Zia, M. Z., & Tran, Q.-H. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00550 · Cited by 61
VIDM: Video Implicit Diffusion Models
Mei, K., & Patel, V. M. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i8.26094 · Cited by 70
Continual Learning of Recurrent Neural Networks by Locally Aligning Distributed Representations
Ororbia, A. G., Mali, A., Giles, C. L., & Kifer, D. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2953622 · Cited by 66
Cross Pixel Optical-Flow Similarity for Self-supervised Learning
Mahendran, A., Thewlis, J., & Vedaldi, A. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-20873-8_7 · Cited by 59
Self-Supervised Learning of Video-Induced Visual Invariances
Tschannen, M., Djolonga, J., Ritter, M., Mahendran, A., Houlsby, N., Gelly, S., & Lučić, M. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01382 · Cited by 63
Efficient Spatio-Temporal Contrastive Learning for Skeleton-Based 3-D Action Recognition
Gao, X., Yang, Y., Zhang, Y., Li, M., Yu, J.-G., & Du, S. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3127040 · Cited by 59
Learning deep representation for trajectory clustering
Yao, D., Zhang, C., Zhu, Z., Hu, Q., Wang, Z., Huang, J., & Bi, J. (2018) · Expert Systems · doi:10.1111/exsy.12252 · Cited by 59
Who Let the Dogs Out? Modeling Dog Behavior from Visual Data
Ehsani, K., Bagherinezhad, H., Redmon, J., Mottaghi, R., & Farhadi, A. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00426 · Cited by 64
Yamada, T., Matsunaga, H., & Ogata, T. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2852838 · Cited by 59
Akhter, I., Jalal, A., & Kim, K. (2021) · 2021 International Bhurban Conference on Applied Sciences and Technologies (IBCAST) · doi:10.1109/ibcast51254.2021.9393293 · Cited by 58
Video Contrastive Learning with Global Context
Kuang, H., Zhu, Y., Zhang, Z., Li, X., Tighe, J., Schwertfeger, S., Stachniss, C., & Li, M. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00358 · Cited by 58
Mittal, G., Marwah, T., & Balasubramanian, V. N. (2017) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3123266.3123309 · Cited by 61
Deep Learning for Domain-Specific Action Recognition in Tennis
Mora, S. V., & Knottenbelt, W. J. (2017) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.27 · Cited by 57
Action-Attending Graphic Neural Network
Li, C., Cui, Z., Zheng, W., Xu, C., Ji, R., & Yang, J. J. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2815744 · Cited by 58
Video Summarization Via Actionness Ranking
Elfeki, M., & Borji, A. (2019) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2019.00085 · Cited by 57
Joint Visual-Temporal Embedding for Unsupervised Learning of Actions in Untrimmed Sequences
VidalMata, R. G., Scheirer, W. J., Kukleva, A., Cox, D., & Kuehne, H. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00128 · Cited by 60
Multi-label LSTM autoencoder for non-intrusive appliance load monitoring
Verma, S., Singh, S., & Majumdar, A. (2021) · Electric Power Systems Research · doi:10.1016/j.epsr.2021.107414 · Cited by 57
Dancing to MusicPreprint
Lee, H. Y., Yang, X.-D., Liu, M., Wang, T. C., Lu, Y., Yang, M., & Kautz, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.02001 · Cited by 57
Attention-Based Fully Gated CNN-BGRU for Russian Handwritten Text
Abdallah, A., Hamada, M., & Nurseitov, D. B. (2020) · Journal of Imaging · doi:10.3390/jimaging6120141 · Cited by 57
Precipitation Nowcasting with Weather Radar Images and Deep Learning in São Paulo, Brasil
Bonnet, S. M., Evsukoff, A. G., & Morales, C. A. (2020) · Atmosphere · doi:10.3390/atmos11111157 · Cited by 58
Li, Y., Chang, J., Wang, Z., & Kong, C. (2021) · Physics of Fluids · doi:10.1063/5.0048170 · Cited by 56
Earthfarsser: Versatile Spatio-Temporal Dynamical Systems Modeling in One Model
Wu, H., Liang, Y., Xiong, W. H., Zhou, Z., Huang, W., Wang, S., & Wang, K. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i14.29521 · Cited by 56
Advancing Arctic Sea Ice Remote Sensing with AI and Deep Learning: Opportunities and Challenges
Li, W., Hsu, C.-Y., & Tedesco, M. (2024) · Remote Sensing · doi:10.3390/rs16203764 · Cited by 65
Trajectory prediction of vehicles turning at intersections using deep neural networks
Shirazi, M. S., & Morris, B. (2019) · Machine Vision and Applications · doi:10.1007/s00138-019-01040-w · Cited by 56
Zhang, C., Zou, Y., Chen, G., & Gan, L. (2019) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3343031.3350876 · Cited by 56
FASTER Recurrent Networks for Efficient Video Classification
Zhu, L., Tran, D., Sevilla-Lara, L., Yang, Y., Feiszli, M., & Wang, H. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.7012 · Cited by 56
Sikka, A., Jamalabadi, H., Krylova, M., Alizadeh, S., van der Meer, J. N., Danyeli, L. V., Deliano, M., Vicheva, P., Hahn, T., Koenig, T. W., et al. (2020) · Human Brain Mapping · doi:10.1002/hbm.24949 · Cited by 62
Unsupervised t-Distributed Video Hashing and Its Deep Hashing Extension
Hao, Y., Mu, T., Goulermas, J. Y., Jiang, J., Hong, R., & Wang, M. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2737329 · Cited by 55
A Temporally-Aware Interpolation Network for Video Frame Inpainting
Szeto, R. B., Sun, X., Kunyi, L., & Corso, J. J. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2951667 · Cited by 55
Chen, C., Zhu, W., Oczak, M., Maschat, K., Baumgartner, J., Larsen, M. L. V., & Norton, T. (2020) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2020.105580 · Cited by 59
Contrast and Order Representations for Video Self-supervised Learning
Hu, K., Shao, J., Liu, Y., Raj, B., Savvides, M., & Shen, Z. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00784 · Cited by 56
Interpretable Intuitive Physics Model
Ye, T., Wang, X., Davidson, J., & Gupta, A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01258-8_6 · Cited by 55
Deep Image-to-Video Adaptation and Fusion Networks for Action Recognition
Liu, Y., Lu, Z., Li, J., Yang, T., & Yao, C. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2957930 · Cited by 55
Deep Ensemble Machine for Video Classification
Zheng, J., Cao, X., Zhang, B., Zhen, X., & Su, X. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2844464 · Cited by 55
Aircraft Fleet Health Monitoring with Anomaly Detection Techniques
Basora, L., Bry, P., Olivé, X., & Freeman, F. C. (2021) · Aerospace · doi:10.3390/aerospace8040103 · Cited by 60
Unsupervised Anomaly Video Detection via a Double-Flow ConvLSTM Variational Autoencoder
Wang, L., Tan, H., Zhou, F., Zuo, W., & Sun, P. (2022) · IEEE Access · doi:10.1109/access.2022.3165977 · Cited by 54
Deep learning and transfer learning for device-free human activity recognition: A survey
Yang, J., Xu, Y., Cao, H., Zou, H., & Xie, L. (2022) · Journal of Automation and Intelligence · doi:10.1016/j.jai.2022.100007 · Cited by 56
Optimizing Video Prediction via Video Frame Interpolation
Wu, Y., Wen, Q., & Chen, Q. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01729 · Cited by 54
Dual Convolutional LSTM Network for Referring Image Segmentation
Ye, L., Liu, Z., & Wang, Y. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.2971171 · Cited by 54
Metadata
- Authors
- Srivastava, N., Mansimov, E., & Salakhutdinov, R.
- Affiliations
- University of Toronto (CA)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2015
- Pages
- 843-852
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1502.04681
- OpenAlex
- W2116435618
- Cited by
- 1,861
- References
- 30
- Citations by year
- 2026: 3 · 2025: 56 · 2024: 128 · 2023: 148 · 2022: 183 · 2021: 279 · 2020: 308 · 2019: 286 · 2018: 238 · 2017: 146 · 2016: 62 · 2015: 23
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- International Conference on Machine Learning
- Funders
- Raytheon Company
- Nvidia
- Samsung
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- video representation learning, unsupervised learning, long short-term memory networks, LSTM encoder-decoder, video reconstruction, future frame prediction, perceptual features, feature visualization, human action recognition, transfer learning, few-shot learning, out-of-domain generalization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
