The DOI matches its DataCite record; 29 of the 30 references it cites were found in a registry or an index.
Unsupervised Learning of Video Representations using LSTMs
Open accessAbstract
We use multilayer Long Short Term Memory (LSTM) networks to learn representations of video sequences. Our model uses an encoder LSTM to map an input sequence into a fixed length representation. This representation is decoded using single or multiple decoder LSTMs to perform different tasks, such as reconstructing the input sequence, or predicting the future sequence. We experiment with two kinds of input sequences - patches of image pixels and high-level representations ("percepts") of video frames extracted using a pretrained convolutional net. We explore different design choices such as whether the decoder LSTMs should condition on the generated output. We analyze the outputs of the model qualitatively to see how well the model can extrapolate the learned video representation into the future and into the past. We try to visualize and interpret the learned features. We stress test the model by running it on longer time scales and on out-of-domain data. We further evaluate the representations by finetuning them for a supervised learning problem - human action recognition on the UCF-101 and HMDB-51 datasets. We show that the representations help improve classification accuracy, especially when there are only a few training examples. Even models pretrained on unrelated datasets (300 hours of YouTube videos) can help action recognition performance.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This is the first time that motion prediction with cross-dimensional learning has been used for self-supervised learning in the context of HAR.”
From Self-supervised Human Activity Recognition by Learning to Predict Cross-Dimensional Motion (2021) · cites this paper as [23]
In the citing paper
“While motion prediction has been used in the field of computer vision for self-supervised learning [23, 26], our model is novel in that the cross-dimensional aspect results in more effective learning.”
From Self-supervised Human Activity Recognition by Learning to Predict Cross-Dimensional Motion (2021) · cites this paper as [23]
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Two-Stream Convolutional Networks for Action Recognition in Videos
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1406.2199 · Cited by 6,756
Large-Scale Video Classification with Convolutional Neural Networks
Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., & Fei-Fei, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.223 · Cited by 6,354
Show and tell: A neural image caption generator
Vinyals, O., Toshev, A., Bengio, S., & Erhan, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298935 · Cited by 6,318
3D Convolutional Neural Networks for Human Action Recognition
Ji, S., Xu, W., Yang, M., & Yu, K. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.59 · Cited by 6,313
Long-term recurrent convolutional networks for visual recognition and description
Donahue, J., Hendricks, L. A., Guadarrama, S., Rohrbach, M., Venugopalan, S., Darrell, T., & Saenko, K. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298878 · Cited by 5,228
Flagged first, then by citations
1 of the 30 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Items 101–200 of 1,005
A Review on Deep Learning Techniques for Video Prediction
Oprea, S., Martinez-Gonzalez, P., Garcia-Garcia, A., Castro-Vargas, J. A., Orts-Escolano, S., Garcia-Rodriguez, J., & Argyros, A. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3045007 · Cited by 301
Peeking Into the Future: Predicting Future Person Activities and Locations in Videos
Liang, J., Jiang, L., Niebles, J. C., Hauptmann, A. G., & Fei-Fei, L. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00587 · Cited by 300
Self-Supervised Learning by Cross-Modal Audio-Video Clustering
Alwassel, H., Mahajan, D., Korbar, B., Torresani, L., Ghanem, B., & Tran, D. (2019) · arXiv · doi:10.48550/arxiv.1911.12667 · Cited by 298
Neural Encoding and Decoding with Deep Learning for Dynamic Natural Vision
Wen, H., Shi, J., Zhang, Y., Lu, K., Cao, J., & Liu, Z. (2017) · Cerebral Cortex · doi:10.1093/cercor/bhx268 · Cited by 318
Unsupervised deep learning for optical flow estimation
Ren, Z., Yan, J., Ni, B., Liu, B., Yang, X., & Zha, H. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10723 · Cited by 296
Spatiotemporal Recurrent Convolutional Networks for Recognizing Spontaneous Micro-Expressions
Xia, Z., Hong, X., Gao, X., Feng, X., & Zhao, G. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2931351 · Cited by 296
Self-supervised Learning for Large-scale Item Recommendations
Yao, T., Yi, X., Cheng, D. Z., Yu, F., Chen, T., Menon, A. K., Hong, L., Ed, H., Tjoa, S., Kang, J., et al. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3481952 · Cited by 291
Integrating prediction and reconstruction for anomaly detection
Tang, Y., Zhao, L., Zhang, S., Gong, C., Li, G., & Yang, J. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2019.11.024 · Cited by 296
Clustering Driven Deep Autoencoder for Video Anomaly Detection
Chang, Y., Tu, Z., Xie, W. C., & Yuan, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58555-6_20 · Cited by 280
AdaCoF: Adaptive Collaboration of Flows for Video Frame Interpolation
Lee, H., Kim, T., Chung, T.-Y., Pak, D., Ban, Y., & Lee, S. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00536 · Cited by 277
A CFCC-LSTM Model for Sea Surface Temperature Prediction
Yang, Y., Dong, J., Sun, X., Lima, E. B., Mu, Q., & Wang, X. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2780843 · Cited by 280
Deep Learning-Based Weather Prediction: A Survey
Ren, X., Li, X., Ren, K., Song, J., Xu, Z., Deng, K., & Wang, X. (2020) · Big Data Research · doi:10.1016/j.bdr.2020.100178 · Cited by 290
Spatiotemporal Pyramid Network for Video Action Recognition
Wang, Y., Long, M., Wang, J., & Yu, P. S. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.226 · Cited by 272
DeepCare: A Deep Dynamic Memory Model for Predictive Medicine
Pham, T., Tran, T., Phung, D., & Venkatesh, S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-31750-2_3 · Cited by 269
Action Recognition with Dynamic Image Networks
Bilen, H., Fernando, B., Gavves, E., & Vedaldi, A. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2769085 · Cited by 269
Video Coding for Machines: A Paradigm of Collaborative Compression and Intelligent Analytics
Duan, L., Liu, J., Yang, W., Huang, T., & Gao, W. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3016485 · Cited by 260
Spatio-temporal video autoencoder with differentiable memoryPreprint
Pătrăucean, V., Handa, A., & Cipolla, R. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06309 · Cited by 270
Predicting Deeper into the Future of Semantic Segmentation
Luc, P., Neverova, N., Couprie, C., Verbeek, J. J., & LeCun, Y. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.77 · Cited by 255
MiCT: Mixed 3D/2D Convolutional Tube for Human Action Recognition
Zhou, Y., Sun, X., Zha, Z.-J., & Zeng, W. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00054 · Cited by 247
TS-LSTM and temporal-inception: Exploiting spatiotemporal dynamics for activity recognition
Ma, C., Chen, M.-H., Kira, Z., & AlRegib, G. (2018) · Signal Processing Image Communication · doi:10.1016/j.image.2018.09.003 · Cited by 247
A Key Volume Mining Deep Framework for Action Recognition
Zhu, W., Hu, J., Sun, G., Cao, X., & Qiao, Y. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.219 · Cited by 246
PREDICT & CLUSTER: Unsupervised Skeleton Based Action Recognition
Su, K., Liu, X., & Shlizerman, E. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00965 · Cited by 244
Peeking Into the Future: Predicting Future Person Activities and Locations in Videos
Liang, J., Jiang, L., Niebles, J. C., Hauptmann, A. G., & Fei-Fei, L. (2019) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00358 · Cited by 240
Video anomaly detection with spatio-temporal dissociation
Chang, Y., Tu, Z., Xie, W. C., Luo, B., Zhang, S., Sui, H., & Yuan, J. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.108213 · Cited by 239
VideoMoCo: Contrastive Video Representation Learning with Temporally Adversarial Examples
Tian, P., Song, Y., Yang, T., Jiang, W., & Liu, W. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01105 · Cited by 245
3D Human Action Representation Learning via Cross-View Consistency Pursuit
Li, L., Wang, M., Ni, B., Wang, H., Yang, J., & Zhang, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00471 · Cited by 236
Generative Adversarial Networks for Image and Video Synthesis: Algorithms and Applications
Liu, M.-Y., Huang, X., Yu, J., Wang, T.-C., & Mallya, A. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3049196 · Cited by 236
Deep Temporal Linear Encoding Networks
Diba, A., Sharma, V., & Gool, L. V. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.168 · Cited by 238
Temporal Attention Unit: Towards Efficient Spatiotemporal Predictive Learning
Tan, C., Gao, Z., Wu, L., Xu, Y., Xia, J., Li, S., & Li, S. Z. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01800 · Cited by 256
Rao, H., Xu, S., Hu, X., Cheng, J., & Hu, B. (2021) · Information Sciences · doi:10.1016/j.ins.2021.04.023 · Cited by 235
Deep Attention-Based Spatially Recursive Networks for Fine-Grained Visual Recognition
Wu, L. Y., Wang, Y., Li, X., & Gao, J. (2018) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2813971 · Cited by 234
Attention Clusters: Purely Attention Based Local Feature Integration for Video Classification
Long, X., Gan, C., de Melo, G., Wu, J., Liu, X., & Wen, S. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00817 · Cited by 233
Wang, X., Farhadi, A., & Gupta, A. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.291 · Cited by 232
Self-Supervised Contrastive Representation Learning for Semi-Supervised Time-Series Classification
Eldele, E., Ragab, M., Chen, Z., Wu, M., Kwoh, C.-K., Li, X., & Guan, C. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3308189 · Cited by 224
Deep Autoencoder-Based Anomaly Detection of Electricity Theft Cyberattacks in Smart Grids
Takiddin, A., Ismail, M., Zafar, U., & Serpedin, E. (2022) · IEEE Systems Journal · doi:10.1109/jsyst.2021.3136683 · Cited by 232
Self-supervised Video Representation Learning by Pace Prediction
Wang, J., Jiao, J., & Liu, Y. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58520-4_30 · Cited by 223
A large-scale study on unsupervised spatiotemporal representation learning
Feichtenhofer, C., Fan, H., Xiong, B., Girshick, R., & He, K. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00331 · Cited by 222
MotionRNN: A Flexible Model for Video Prediction with Spacetime-Varying Motions
Wu, H., Yao, Z., Wang, J., & Long, M. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01518 · Cited by 236
Recurrent Spatial-Temporal Attention Network for Action Recognition in Videos
Du, W., Wang, Y., & Qiao, Y. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2778563 · Cited by 220
Identifying behavioral structure from deep variational embeddings of animal motion
Luxem, K., Mocellin, P., Fuhrmann, F., Kürsch, J., Miller, S. R., Palop, J. J., Remy, S., & Bauer, P. (2022) · Communications Biology · doi:10.1038/s42003-022-04080-7 · Cited by 218
Predicting Citywide Crowd Flows in Irregular Regions Using Multi-View Graph Convolutional Networks
Sun, J., Zhang, J., Li, Q., Yi, X., Liang, Y., & Zheng, Y. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.3008774 · Cited by 227
Behaviour recognition of pigs and cattle: Journey from computer vision to deep learning
Chen, C., Zhu, W., & Norton, T. (2021) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2021.106255 · Cited by 235
An AIS-based deep learning framework for regional ship behavior prediction
Murray, B., & Perera, L. P. (2021) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2021.107819 · Cited by 223
Short‐Term Precipitation Forecast Based on the PERSIANN System and LSTM Recurrent Neural Networks
Asanjan, A. A., Yang, T., Hsu, K., Sorooshian, S., Lin, J., & Peng, Q. (2018) · Journal of Geophysical Research Atmospheres · doi:10.1029/2018jd028375 · Cited by 217
MATNet: Motion-Attentive Transition Network for Zero-Shot Video Object Segmentation
Zhou, T., Li, J., Wang, S., Tao, R., & Shen, J. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3013162 · Cited by 215
Uncovering the Temporal Context for Video Question Answering
Zhu, L., Xu, Z., Yang, Y., & Hauptmann, A. G. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-017-1033-7 · Cited by 217
Zhang, J., Verschae, R., Nobuhara, S., & Lalonde, J. (2018) · Solar Energy · doi:10.1016/j.solener.2018.10.024 · Cited by 219
Lattice Long Short-Term Memory for Human Action Recognition
Sun, L., Jia, K., Chen, K., Yeung, D., Shi, B. E., & Savarese, S. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.236 · Cited by 208
Learning Spatio-Temporal Representation With Local and Global Diffusion
Qiu, Z., Yao, T., Ngo, C., Tian, X., & Mei, T. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01233 · Cited by 209
Towards Accurate Generative Models of Video: A New Metric & Challenges
Unterthiner, T., van Steenkiste, S., Kurach, K., Marinier, R., Michalski, M., & Gelly, S. (2018) · arXiv · doi:10.48550/arxiv.1812.01717 · Cited by 204
A survey of computer-aided diagnosis of lung nodules from CT scans using deep learning
Gu, Y., Chi, J., Liu, J., Yang, L., Zhang, B., Yu, D., Zhao, Y., & Lu, X. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104806 · Cited by 212
Unsupervised Representation Learning With Long-Term Dynamics for Skeleton Based Action Recognition
Zheng, N., Wen, J., Liu, R., Long, L., Dai, J., & Gong, Z. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11853 · Cited by 201
Deep phenotyping: deep learning for temporal phenotype/genotype classification
Namin, S. T., Esmaeilzadeh, M., Najafi, M., Brown, T. B., & Borevitz, J. (2018) · Plant Methods · doi:10.1186/s13007-018-0333-4 · Cited by 207
A novel framework for spatio-temporal prediction of environmental data using deep learning
Amato, F., Guignard, F., Robert, S., & Kanevski, M. (2020) · Scientific Reports · doi:10.1038/s41598-020-79148-7 · Cited by 200
StyleGAN-V: A Continuous Video Generator with the Price, Image Quality and Perks of StyleGAN2
Skorokhodov, I., Tulyakov, S., & Elhoseiny, M. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00361 · Cited by 199
RPAN: An End-to-End Recurrent Pose-Attention Network for Action Recognition in Videos
Du, W., Wang, Y., & Qiao, Y. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.402 · Cited by 199
Chung, Y.-A., Wu, C.-C., Shen, C.-H., Lee, H.-Y., & Lee, L.-S. (2016) · Interspeech (USB) · doi:10.21437/interspeech.2016-82 · Cited by 215
A deep-learning model for urban traffic flow prediction with traffic events mined from twitter
Essien, A. E., Petrounias, I., Sampaio, P., & Sampaio, S. (2020) · World Wide Web · doi:10.1007/s11280-020-00800-3 · Cited by 209
Information Diffusion Prediction via Recurrent Cascades Convolution
Chen, X., Zhou, F., Zhang, K., Trajcevski, G., Zhong, T., & Zhang, F. (2019) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde.2019.00074 · Cited by 199
Trajectory clustering via deep representation learning
Yao, D., Zhang, C., Zhu, Z., Huang, J., & Bi, J. (2017) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966345 · Cited by 196
Action-conditional video prediction using deep networks in Atari games
Oh, J., Guo, X., Lee, H., Lewis, R. L., & Singh, S. P. (2015) · Cited by 196
Protein–protein interaction prediction with deep learning: A comprehensive review
Soleymani, F., Paquet, E., Viktor, H. L., Michalowski, W., & Spinello, D. (2022) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2022.08.070 · Cited by 209
Dynamic Sign Language Recognition Based on Video Sequence With BLSTM-3D Residual Networks
Liao, Y., Xiong, P., Min, W., Min, W., & Lu, J. (2019) · IEEE Access · doi:10.1109/access.2019.2904749 · Cited by 195
Makansi, O., Ilg, E., Çiçek, Ö., & Brox, T. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00731 · Cited by 193
Talking Face Generation by Conditional Recurrent Adversarial Network
Song, Y., Zhu, J., Li, D., Wang, A. Y.-D., & Qi, H. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/129 · Cited by 214
DropMAE: Masked Autoencoders with Spatial-Attention Dropout for Tracking Tasks
Wu, Q., Yang, T., Liu, Z., Wu, B., Shan, Y., & Chan, A. B. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01399 · Cited by 205
Unsupervised Learning of Long-Term Motion Dynamics for Videos
Luo, Z., Peng, B., Huang, D.-A., Alahi, A., & Fei-Fei, L. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.751 · Cited by 196
Anomaly Detection in Road Traffic Using Visual Surveillance
Santhosh, K. K., Dogra, D. P., & Roy, P. P. (2020) · ACM Computing Surveys · doi:10.1145/3417989 · Cited by 198
Huang, Z., Yang, F., Xu, F., Song, X., & Tsui, K. (2019) · IEEE Access · doi:10.1109/access.2019.2928037 · Cited by 192
Automated IT system failure prediction: A deep learning approach
Zhang, K., Xu, J., Min, M. R., Jiang, G., Pelechrinis, K., & Zhang, H. (2016) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2016.7840733 · Cited by 193
Learning in an Uncertain World: Representing Ambiguity Through Multiple Hypotheses
Rupprecht, C., Laina, I., DiPietro, R. S., Baust, M., Tombari, F., Navab, N., & Hager, G. D. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.388 · Cited by 195
Ullah, A., Muhammad, K., Haq, I. U., & Baik, S. W. (2019) · Future Generation Computer Systems · doi:10.1016/j.future.2019.01.029 · Cited by 186
Learning-Based Video Motion Magnification
Oh, T.-H., Jaroensri, R., Kim, C., Elgharib, M. A., Durand, F., Freeman, W. T., & Matusik, W. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01225-0_39 · Cited by 189
Depth Pooling Based Large-Scale 3-D Action Recognition With Convolutional Neural Networks
Wang, P., Li, W., Gao, Z., Tang, C., & Ogunbona, P. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2018.2818329 · Cited by 184
When will you do what? - Anticipating Temporal Occurrences of Activities
Farha, Y. A., Richard, A., & Gall, J. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00560 · Cited by 180
Robust LSTM-Autoencoders for Face De-Occlusion in the Wild
Zhao, F., Feng, J., Zhao, J. C., Yang, W., & Yan, S. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2771408 · Cited by 182
Dense Optical Flow Prediction from a Static Image
Walker, J., Gupta, A., & Hebert, M. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.281 · Cited by 182
Predicting Remaining Useful Life using Time Series Embeddings based on Recurrent Neural Networks
Gugulothu, N., Tv, V., Malhotra, P., Vig, L., Agarwal, P., & Shroff, G. M. (2020) · International Journal of Prognostics and Health Management · doi:10.36001/ijphm.2018.v9i1.2689 · Cited by 190
Diffusion Probabilistic Modeling for Video Generation
Yang, R., Srivastava, P. K., & Mandt, S. (2023) · Entropy · doi:10.3390/e25101469 · Cited by 261
Action Recognition With Spatio–Temporal Visual Attention on Skeleton Image Sequences
Yang, Z., Li, Y., Yang, J., & Luo, J. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2864148 · Cited by 176
Intelligent character recognition using fully convolutional neural networks
Ptucha, R., Such, F. P., Pillai, S., Brockler, F., Singh, V., & Hutkowski, P. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.12.017 · Cited by 180
An ensemble deep learning model for cyber threat hunting in industrial internet of things
Yazdinejad, A., Kazemi, M., Parizi, R. M., Dehghantanha, A., & Karimipour, H. (2022) · Digital Communications and Networks · doi:10.1016/j.dcan.2022.09.008 · Cited by 181
Slip Detection with Combined Tactile and Visual Information
Jian-hua, L., Dong, S., & Adelson, E. H. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8460495 · Cited by 183
Bampoula, X., Siaterlis, G., Nikolakis, N., & Alexopoulos, K. (2021) · Sensors · doi:10.3390/s21030972 · Cited by 174
SwinLSTM: Improving Spatiotemporal Prediction Accuracy using Swin Transformer and LSTM
Tang, S., Li, C., Zhang, P., & Tang, R. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01239 · Cited by 189
One-Class Adversarial Nets for Fraud Detection
Zheng, P., Yuan, S., Wu, X., Li, J., & Lu, A. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33011286 · Cited by 173
Transitive Invariance for Self-Supervised Visual Representation Learning
Wang, X., He, K., & Gupta, A. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.149 · Cited by 175
D’Angelo, G., & Palmieri, F. (2020) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2020.102890 · Cited by 176
Multi-Stream Multi-Class Fusion of Deep Networks for Video Classification
Wu, Z., Jiang, Y., Wang, X., Ye, H., & Xue, X. (2016) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2964284.2964328 · Cited by 174
Daw, A., Thomas, R. Q., Carey, C. C., Read, J. S., Appling, A., & Karpatne, A. (2020) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611976236.60 · Cited by 172
Kar, A., Rai, N., Sikka, K., & Sharma, G. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.604 · Cited by 172
Regularizing Long Short Term Memory with 3D Human-Skeleton Sequences for Action Recognition
Mahasseni, B., & Todorović, S. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.333 · Cited by 171
Spatial-Temporal Transformer for Dynamic Scene Graph Generation
Cong, Y., Liao, W., Ackermann, H., Rosenhahn, B., & Yang, M. Y. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01606 · Cited by 176
Generating the Future with Adversarial Transformers
Vondrick, C., & Torralba, A. B. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.319 · Cited by 167
Anomaly detection based on LSTM and autoencoders using federated learning in smart electric grid
Shrestha, R., Mohammadi, M., Sinaei, S., Salcines, A., Pampliega, D., Clemente, R., Sanz, A. L., Nowroozi, E., & Lindgren, A. (2024) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2024.104951 · Cited by 166
Generative Image Modeling Using Spatial LSTMsPreprint
Theis, L., & Bethge, M. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.03478 · Cited by 160
On Learning Disentangled Representations for Gait Recognition
Zhang, Z., Tran, L., Liu, F., & Liu, X. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2998790 · Cited by 158
Adversarial Video Generation on Complex Datasets
Clark, A., Donahue, J., & Simonyan, K. (2019) · arXiv · doi:10.48550/arxiv.1907.06571 · Cited by 157
VideoGPT: Video Generation using VQ-VAE and Transformers
Yan, W., Zhang, Y., Abbeel, P., & Srinivas, A. (2021) · arXiv · doi:10.48550/arxiv.2104.10157 · Cited by 156
Predicting Multi-step Citywide Passenger Demands Using Attention-based Neural Networks
Zhou, X., Shen, Y., Zhu, Y., & Huang, L. (2018) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3159652.3159682 · Cited by 156
Metadata
- Authors
- Srivastava, N., Mansimov, E., & Salakhutdinov, R.
- Affiliations
- University of Toronto (CA)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2015
- Pages
- 843-852
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1502.04681
- OpenAlex
- W2116435618
- Cited by
- 1,861
- References
- 30
- Citations by year
- 2026: 3 · 2025: 56 · 2024: 128 · 2023: 148 · 2022: 183 · 2021: 279 · 2020: 308 · 2019: 286 · 2018: 238 · 2017: 146 · 2016: 62 · 2015: 23
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- International Conference on Machine Learning
- Funders
- Raytheon Company
- Nvidia
- Samsung
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- video representation learning, unsupervised learning, long short-term memory networks, LSTM encoder-decoder, video reconstruction, future frame prediction, perceptual features, feature visualization, human action recognition, transfer learning, few-shot learning, out-of-domain generalization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
