Deep learning from temporal coherence in video
Abstract
This work proposes a learning method for deep architectures that takes advantage of sequential data, in particular from the temporal coherence that naturally exists in unlabeled video recordings. That is, two successive frames are likely to contain the same object or objects. This coherence is used as a supervisory signal over the unlabeled data, and is used to improve the performance on a supervised task of interest. We demonstrate the effectiveness of this method on some pose invariant object and face recognition tasks. 1.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
This idea of continuity is used in a great number of artificial neural networks and related models.
“This idea of continuity is used in a great number of artificial neural networks and related models (Wiskott and Sejnowski, 2002; Földiák, 2008; Mobahi et al., 2009).”
From Toward an integration of deep learning and neuroscience (2016) · cites this paper as Mobahi et al., 2009
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · see citing works
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138 · see citing works
Nonlinear Dimensionality Reduction by Locally Linear Embedding
Roweis, S. T., & Saul, L. K. (2000) · Science · doi:10.1126/science.290.5500.2323 · Cited by 14,965 · see citing works
A Global Geometric Framework for Nonlinear Dimensionality Reduction
Tenenbaum, J. B., Silva, V. D., & Langford, J. C. (2000) · Science · doi:10.1126/science.290.5500.2319 · Cited by 13,585 · see citing works
Chapelle, O., Schölkopf, B., & Zien, A. (2006) · The MIT Press eBooks · doi:10.7551/mitpress/9780262033589.001.0001 · Cited by 4,560 · see citing works
Learning a Similarity Metric Discriminatively, with Application to Face Verification
Chopra, S., Hadsell, R., & LeCun, Y. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.202 · Cited by 4,036 · see citing works
Face recognition: a convolutional neural-network approach
Lawrence, S., Giles, C. L., Tsoi, A. C., & Back, A. D. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.554195 · Cited by 3,092 · see citing works
Parameterisation of a stochastic model for human face identification
Samaria, F., & Harter, A. (2002) · doi:10.1109/acv.1994.341300 · Cited by 2,632 · see citing works
SIGNATURE VERIFICATION USING A “SIAMESE” TIME DELAY NEURAL NETWORK
BROMLEY, J., BENTZ, J. W., BOTTOU, L., GUYON, I., LECUN, Y., MOORE, C., SÄCKINGER, E., & SHAH, R. (1994) · Series in Machine Perception and Artificial Intelligence · doi:10.1142/9789812797926_0003 · Cited by 2,350 · see citing works
Signature Verification Using A "Siamese" Time Delay Neural Network
BROMLEY, J., BENTZ, J. W., BOTTOU, L., GUYON, I., LECUN, Y., MOORE, C., SÄCKINGER, E., & SHAH, R. (1993) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001493000339 · Cited by 2,077 · see citing works
80 Million Tiny Images: A Large Data Set for Nonparametric Object and Scene Recognition
Torralba, A., Fergus, R., & Freeman, W. T. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.128 · Cited by 1,921 · see citing works
Adaptive Computation and Machine Learning
(2012) · The MIT Press eBooks · doi:10.7551/mitpress/8291.003.0026 · Cited by 1,453 · see citing works
Slow Feature Analysis: Unsupervised Learning of Invariances
Wiskott, L., & B, T. J. S. A. (2002) · Neural Computation · doi:10.1162/089976602317318938 · Cited by 1,351 · see citing works
Learning methods for generic object recognition with invariance to pose and lighting
LeCun, Y., Huang, F. J., & Bottou, L. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315150 · Cited by 1,324 · see citing works
Semi-Supervised Classification by Low Density Separation
Chapelle, O., Zien, A., & Ghahramani, R. C. Z. (2005) · Cited by 705 · see citing works
Stochastic Gradient Learning in Neural Networks
Bottou, L. (1991) · Cited by 578 · see citing works
Self-organizing neural network that discovers surfaces in random-dot stereograms
Becker, S., & Hinton, G. E. (1992) · Nature · doi:10.1038/355161a0 · Cited by 559 · see citing works
Deep learning via semi-supervised embedding
Weston, J., Ratle, F., & Collobert, R. (2008) · International Conference on Machine Learning · doi:10.1145/1390156.1390303 · Cited by 380 · see citing works
Self-citationBelkin, M., Niyogi, P., & Sindhwani, V. (2005) · Cited by 321 · see citing works
(1999) · The MIT Press eBooks · doi:10.7551/mitpress/7011.001.0001 · Cited by 271 · see citing works
Unsupervised learning : foundations of neural computation
Hinton, G. E., & Sejnowski, T. J. (1999) · Cited by 270 · see citing works
Synergistic Face Detection and Pose Estimation with Energy-Based Models
Osadchy, M., LeCun, Y., & Miller, M. L. (2006) · Lecture notes in computer science · doi:10.1007/11957959_10 · Cited by 211 · see citing works
Nayar, S. K., Watanabe, M., & Noguchi, M. (1996) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.546256 · Cited by 207 · see citing works
Semi-Supervised Learning (Adaptive Computation and Machine Learning)
Chapelle, O., Schölkopf, B., & Zien, A. (2006) · The MIT Press eBooks · Cited by 185 · see citing works
Learning optimized features for hierarchical models of invariant object recognition.
Wersing, H., & Körner, E. (2003) · Neural Computation · doi:10.1162/089976603321891800 · Cited by 169 · see citing works
Mutual information maximization: models of cortical self-organization
Becker, S. (1996) · Network Computation in Neural Systems · doi:10.1080/0954898x.1996.11978653 · Cited by 137 · see citing works
Building models of animals from video
Ramanan, D., Forsyth, D. A., & Barnard, K. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.155 · Cited by 101 · see citing works
View-based 3D object recognition with support vector machines
Roobaert, D., & Hulle, M. M. V. (2003) · doi:10.1109/nnsp.1999.788125 · Cited by 99 · see citing works
A hybrid Face Recognition Method using Markov random Fields
Huang, R., Pavlovic, V., & Metaxas, D. N. (2004) · Cited by 62 · see citing works
Implicit Learning in 3D Object Recognition: The Importance of Temporal Context
Becker, S. (1999) · Neural Computation · doi:10.1162/089976699300016683 · Cited by 55 · see citing works
Bowling, M., Ghodsi, A., & Wilkinson, D. F. (2005) · International Conference on Machine Learning · doi:10.1145/1102351.1102360 · Cited by 53 · see citing works
Hinton, G. E., & Sejnowski, T. J. (1999) · Cited by 50 · see citing works
Model generation for video-based object recognition
Noor, H., Mirza, S. H., Sheikh, Y. A., Jain, A., & Shah, M. A. (2006) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1180639.1180791 · Cited by 17 · see citing works
Learning Temporally Persistent Hierarchical Representations
Becker, S. (1996) · neural information processing systems · Cited by 11 · see citing works
Flagged first, then by citations
1 of the 35 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001 · see citing works
3D Convolutional Neural Networks for Human Action Recognition
Ji, S., Xu, W., Yang, M., & Yu, K. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.59 · Cited by 6,222 · see citing works
Learning Deep Architectures for AI
Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 5,037 · see citing works
Why Does Unsupervised Pre-training Help Deep Learning?
Erhan, D., Bengio, Y., Courville, A. C., Manzagol, P.-A., Vincent, P., & Samy Bengio, A. (2010) · Cited by 2,180 · see citing works
Deep Metric Learning Using Triplet Network
Hoffer, E., & Ailon, N. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-24261-3_7 · Cited by 2,134 · see citing works
Tian, Y., Krishnan, D., & Isola, P. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58621-8_45 · Cited by 1,997 · see citing works
Deep Learning Face Representation by Joint Identification-Verification
Sun, Y., Wang, X., & Tang, X. (2014) · arXiv · doi:10.48550/arxiv.1406.4773 · Cited by 1,906 · see citing works
Unsupervised Learning of Video Representations using LSTMs
Srivastava, N., Mansimov, E., & Salakhutdinov, R. (2015) · arXiv · doi:10.48550/arxiv.1502.04681 · Cited by 1,861 · see citing works
Deep Machine Learning - A New Frontier in Artificial Intelligence Research [Research Frontier]
Arel, I., Rose, D. C., & Karnowski, T. P. (2010) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2010.938364 · Cited by 1,128 · see citing works
Recent advances in deep learning for object detection
Wu, X., Sahoo, D., & Hoi, S. C. H. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.01.085 · Cited by 1,047 · see citing works
Unsupervised Learning of Visual Representations Using Videos
Wang, X., & Gupta, A. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.320 · Cited by 1,005 · see citing works
Generating Videos with Scene DynamicsPreprint
Vondrick, C., Pirsiavash, H., & Torralba, A. B. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.02612 · Cited by 976 · see citing works
Discriminative Learning of Deep Convolutional Feature Point Descriptors
Simo‐Serra, E., Trulls, E., Ferraz, L., Kokkinos, I., Fua, P., & Moreno-Noguer, F. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.22 · Cited by 804 · see citing works
Shuffle and Learn: Unsupervised Learning Using Temporal Order Verification
Misra, I., Zitnick, C. L., & Hebert, M. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_32 · Cited by 779 · see citing works
Siamese Neural Networks: An Overview
Chicco, D. (2020) · Methods in molecular biology · doi:10.1007/978-1-0716-0826-5_3 · Cited by 681 · see citing works
Deep Predictive Coding Networks for Video Prediction and Unsupervised LearningPreprint
Lotter, W. E., Kreiman, G., & Cox, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08104 · Cited by 805 · see citing works
Zhong, J.-X., Li, N., Kong, W., Liu, S., Li, T. H., & Li, G. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00133 · Cited by 626 · see citing works
Multi-task Self-Supervised Visual Learning
Doersch, C., & Zisserman, A. (2017) · IEEE International Conference on Computer Vision · doi:10.1109/iccv.2017.226 · Cited by 682 · see citing works
Deep Learning via Semi-supervised Embedding
Weston, J., Ratle, F., Mobahi, H., & Collobert, R. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-35289-8_34 · Cited by 577 · see citing works
Self-citationSelf-supervised learning for medical image analysis using image context restoration
Chen, L., Bentley, P., Mori, K., Misawa, K., Fujiwara, M., & Rueckert, D. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.101539 · Cited by 575 · see citing works
Unsupervised Representation Learning by Sorting Sequences
Lee, H.-Y., Huang, J., Singh, M., & Yang, M. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.79 · Cited by 529 · see citing works
Anticipating Visual Representations from Unlabeled Video
Vondrick, C., Pirsiavash, H., & Torralba, A. B. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.18 · Cited by 538 · see citing works
Facial Expression Recognition Based on Deep Evolutional Spatial-Temporal Networks
Zhang, K., Huang, Y., Du, Y., & Wang, L. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2689999 · Cited by 486 · see citing works
Colorization as a Proxy Task for Visual Understanding
Larsson, G., Maire, M., & Shakhnarovich, G. (2017) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2017.96 · Cited by 527 · see citing works
Tian, Y., Krishnan, D., & Isola, P. (2019) · arXiv · doi:10.48550/arxiv.1906.05849 · Cited by 465 · see citing works
What makes ImageNet good for transfer learning?Preprint
Huh, M., Agrawal, P., & Efros, A. A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1608.08614 · Cited by 591 · see citing works
Unsupervised Feature Learning and Deep Learning: A Review and New Perspectives
Bengio, Y., Courville, A. C., & Vincent, P. (2012) · Cited by 455 · see citing works
Agrawal, P., Carreira, J., & Malik, J. (2015) · IEEE International Conference on Computer Vision · doi:10.1109/iccv.2015.13 · Cited by 639 · see citing works
Self-Supervised Video Representation Learning with Odd-One-Out Networks
Fernando, B., Bilen, H., Gavves, E., & Gould, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.607 · Cited by 421 · see citing works
3D Convolutional Neural Networks for Crop Classification with Multi-Temporal Remote Sensing Images
Ji, S., Zhang, C., Xu, A., Shi, Y. B., & Duan, Y. (2018) · Remote Sensing · doi:10.3390/rs10010075 · Cited by 397 · see citing works
Ambient Sound Provides Supervision for Visual Learning
Owens, A., Wu, J., McDermott, J. H., Freeman, W. T., & Torralba, A. B. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46448-0_48 · Cited by 385 · see citing works
Deep learning via semi-supervised embedding
Weston, J., Ratle, F., & Collobert, R. (2008) · International Conference on Machine Learning · doi:10.1145/1390156.1390303 · Cited by 380 · see citing works
Self-citationPrediction as a candidate for learning deep hierarchical models of data
Palm, R. (2012) · Cited by 378 · see citing works
Generating Videos with Scene Dynamics
Vondrick, C., Pirsiavash, H., & Torralba, A. (2016) · Maryland Shared Open Access Repository · doi:10.13016/m26gih-tnyz · Cited by 441 · see citing works
Owens, A., Isola, P., McDermott, J. H., Torralba, A. B., Adelson, E. H., & Freeman, W. T. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.264 · Cited by 352 · see citing works
Scaling and Benchmarking Self-Supervised Visual Representation Learning
Goyal, P., Mahajan, D. K., Gupta, A., & Misra, I. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00649 · Cited by 344 · see citing works
Self-Supervised Video Representation Learning with Space-Time Cubic Puzzles
Kim, D., Cho, D., & Kweon, I. S. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33018545 · Cited by 314 · see citing works
A Deep Neural Network-Driven Feature Learning Method for Multi-view Facial Expression Recognition
Zhang, T., Zheng, W., Cui, Z., Zong, Y., Yan, J., & Yan, K. (2016) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2016.2598092 · Cited by 314 · see citing works
Comparative Evaluation of Hand-Crafted and Learned Local Features
Schönberger, J. L., Hans, H., Sattler, T., & Pollefeys, M. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.736 · Cited by 313 · see citing works
Deep Machine Learning—A New Frontier in Artificial Intelligence Research
Arel, I., Rose, D. C., & Karnowski, T. P. (2010) · Cited by 314 · see citing works
Multi-task Representation Learning for Travel Time Estimation
Li, Y., Fu, K., Wang, Z., Shahabi, C., Ye, J., & Liu, Y. (2018) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3219819.3220033 · Cited by 264 · see citing works
Shallow vs. Deep Sum-Product Networks
Delalleau, O., & Bengio, Y. (2011) · Cited by 248 · see citing works
Representation Learning: A Review and New PerspectivesPreprint
Bengio, Y., Courville, A. C., & Vincent, P. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.5538 · Cited by 235 · see citing works
A large-scale study on unsupervised spatiotemporal representation learning
Feichtenhofer, C., Fan, H., Xiong, B., Girshick, R., & He, K. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00331 · Cited by 222 · see citing works
Sharma, V., & Mir, R. N. (2020) · Computer Science Review · doi:10.1016/j.cosrev.2020.100301 · Cited by 208 · see citing works
Learning Image Representations Tied to Ego-Motion
Jayaraman, D., & Grauman, K. L. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.166 · Cited by 229 · see citing works
Audio-Visual Instance Discrimination with Cross-Modal Agreement
Morgado, P. M., Vasconcelos, N. M., & Misra, I. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01229 · Cited by 218 · see citing works
Wang, J., Jiao, J., Bao, L., He, S., Liu, Y., & Liu, W. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00413 · Cited by 210 · see citing works
Autonomous reinforcement learning on raw visual input data in a real world application
Lange, S., Riedmiller, M., & Voigtländer, A. (2012) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2012.6252823 · Cited by 209 · see citing works
Online Deep Clustering for Unsupervised Representation Learning
Zhan, X., Xie, J., Liu, Z., Ong, Y.-S., & Loy, C. C. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00672 · Cited by 204 · see citing works
On the Expressive Power of Deep Architectures
Bengio, Y., & Delalleau, O. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-24477-3_1 · Cited by 209 · see citing works
Learning Image Matching by Simply Watching Video
Long, G., Kneip, L., Álvarez, J. M., Li, H., Zhang, X., & Yu, Q. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46466-4_26 · Cited by 193 · see citing works
Learning Video Object Segmentation From Unlabeled Videos
Lu, X., Wang, W., Shen, J., Tai, Y., Crandall, D., & Hoi, S. C. H. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00898 · Cited by 182 · see citing works
On the Expressive Power of Deep Architectures
Bengio, Y., & Delalleau, O. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-24412-4_3 · Cited by 182 · see citing works
Unsupervised Feature Extraction by Time-Contrastive Learning and Nonlinear ICAPreprint
Hyvärinen, A., & Morioka, H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.06336 · Cited by 176 · see citing works
Learning and transferring representations for image steganalysis using convolutional neural network
Qian, Y., Dong, J., Wang, W., & Tan, T. (2016) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2016.7532860 · Cited by 165 · see citing works
The Curious Robot: Learning Visual Representations via Physical Interactions
Pinto, L., Gandhi, D., Han, Y., Park, Y., & Gupta, A. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46475-6_1 · Cited by 160 · see citing works
Generating the Future with Adversarial Transformers
Vondrick, C., & Torralba, A. B. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.319 · Cited by 164 · see citing works
Deep neural network and whale optimization algorithm to assess flyrock induced by blasting
Guo, H., Zhou, J., Koopialipoor, M., Armaghani, D. J., & Tahir, M. M. (2019) · Engineering With Computers · doi:10.1007/s00366-019-00816-y · Cited by 153 · see citing works
Data-driven synthesis of smoke flows with CNN-based feature descriptors
Chu, M., & Thuerey, N. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073643 · Cited by 146 · see citing works
Slow Down to Go Better: A Survey on Slow Feature Analysis
Song, P., & Zhao, C. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3201621 · Cited by 139 · see citing works
Slow and Steady Feature Analysis: Higher Order Temporal Coherence in Video
Jayaraman, D., & Grauman, K. L. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.418 · Cited by 135 · see citing works
Deep Learning of Invariant Features via Simulated Fixations in Video
Zou, W. Y., Shenghuo Zhu, B., Yu, K., & Ng, A. Y. (2012) · Cited by 131 · see citing works
Pan, Y., Qiu, Z., Yao, T., Li, H., & Mei, T. (2017) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3123266.3127905 · Cited by 124 · see citing works
Self-Supervised Spatiotemporal Feature Learning via Video Rotation PredictionPreprint
Jing, L., Yang, X., Liu, J., & Tian, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.11387 · Cited by 149 · see citing works
Unsupervised Learning of Spatiotemporally Coherent Metrics
Goroshin, R., Bruna, J., Tompson, J., Eigen, D., & LeCun, Y. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.465 · Cited by 156 · see citing works
Geometry Guided Convolutional Neural Networks for Self-Supervised Video Representation Learning
Gan, C., Gong, B., Liu, K., Su, H., & Guibas, L. J. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00586 · Cited by 124 · see citing works
Deep Learning-Based Model for Financial Distress Prediction
Elhoseny, M., Metawa, N., Sztanó, G., & El‐Hasnony, I. M. (2022) · Annals of Operations Research · doi:10.1007/s10479-022-04766-5 · Cited by 123 · see citing works
Toward an integration of deep learning and neuroscience
Marblestone, A. H., Wayne, G., & Kording, K. P. (2016) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2016.00094 · Cited by 119 · see citing works
Deep Learners Benefit More from Out-of-Distribution Examples
Bengio, Y., Bastien, F., Bergeron, A., Boulanger-Lewandowski, N., Breuel, T. M., Chherawala, Y., Cissé, M., Côté, M., Erhan, D., Eustache, J., et al. (2011) · Cited by 117 · see citing works
Video Jigsaw: Unsupervised Learning of Spatiotemporal Context for Video Action Recognition
Ahsan, U., Madhok, R., & Essa, I. A. (2019) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2019.00025 · Cited by 113 · see citing works
Robust Audio-Visual Instance Discrimination
Morgado, P. M., Misra, I., & Vasconcelos, N. M. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01274 · Cited by 108 · see citing works
SeCo: Exploring Sequence Supervision for Unsupervised Representation Learning
Yao, T., Zhang, Y., Qiu, Z., Pan, Y., & Mei, T. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17274 · Cited by 106 · see citing works
ClusterFit: Improving Generalization of Visual Representations
Yan, X., Misra, I., Gupta, A. K., Ghadiyaram, D., & Mahajan, D. K. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00654 · Cited by 106 · see citing works
Ego-Topo: Environment Affordances From Egocentric Video
Nagarajan, T., Li, Y., Feichtenhofer, C., & Grauman, K. L. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00024 · Cited by 100 · see citing works
Semi-supervised learning using greedy max-cut
Wang, J., Jebara, T., & Chang, S. (2013) · doi:10.5555/2567709.2502605 · Cited by 100 · see citing works
Discriminative deep belief networks for visual data classification
Liu, Y., Zhou, S., & Chen, Q. (2010) · Pattern Recognition · doi:10.1016/j.patcog.2010.12.012 · Cited by 98 · see citing works
Walk and Learn: Facial Attribute Representation Learning from Egocentric Video and Contextual Data
Wang, J., Cheng, Y., & Feris, R. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.252 · Cited by 97 · see citing works
Unsupervised Learning of Visual Structure using Predictive Generative NetworksPreprint
Lotter, W. E., Kreiman, G., & Cox, D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06380 · Cited by 105 · see citing works
Efficient and robust deep learning with Correntropy-induced loss function
Chen, L., Qu, H., Zhao, J., Chen, B., & Príncipe, J. C. (2015) · Neural Computing and Applications · doi:10.1007/s00521-015-1916-x · Cited by 96 · see citing works
Anticipating the future by watching unlabeled video.Preprint
Vondrick, C., Pirsiavash, H., & Torralba, A. B. (2015) · arXiv (Cornell University) · Cited by 98 · see citing works
Unsupervised Learning of Edges
Li, Y., Paluri, M., Rehg, J. M., & Dollár, P. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.179 · Cited by 94 · see citing works
Step-by-step Erasion, One-by-one Collection
Zhong, J.-X., Li, N., Kong, W., Zhang, T., Li, T. H., & Li, G. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240511 · Cited by 103 · see citing works
Nonlinear ICA of temporally dependent stationary sources
Hyvärinen, A., & Morioka, H. (2017) · Työväentutkimus Vuosikirja · Cited by 90 · see citing works
Autonomous aerial cinematography in unstructured environments with learned artistic decision‐making
Bonatti, R., Wang, W., Ho, C., Ahuja, A., Gschwindt, M., Camci, E., Kayacan, E., Choudhury, S., & Scherer, S. (2020) · Journal of Field Robotics · doi:10.1002/rob.21931 · Cited by 94 · see citing works
Learning visual groups from co-occurrences in space and time
Isola, P., Zoran, D., Krishnan, D., & Adelson, E. H. (2015) · arXiv · doi:10.48550/arxiv.1511.06811 · Cited by 90 · see citing works
Discriminative deep multi-task learning for facial expression recognition
Zheng, H., Wang, R., Ji, W., Zong, M., Wong, W. K., Lai, Z., & Lv, H. (2020) · Information Sciences · doi:10.1016/j.ins.2020.04.041 · Cited by 90 · see citing works
Self-Supervised Relative Depth Learning for Urban Scene Understanding
Jiang, H., Larsson, G., Maire, M., Shakhnarovich, G., & Miller, E. G. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01252-6_2 · Cited by 81 · see citing works
Action Anticipation with RBF Kernelized Feature Mapping RNN
Shi, Y., Fernando, B., & Hartley, R. I. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01249-6_19 · Cited by 78 · see citing works
Learning visual feature descriptors for dynamic lighting conditions
Carlevaris-Bianco, N., & Eustice, R. M. (2014) · 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2014.6942941 · Cited by 75 · see citing works
Automatic Curation of Sports Highlights Using Multimodal Excitement Features
Merler, M., Mac, K.-N. C., Joshi, D., Nguyen, Q.-B., Hammer, S., Kent, J., Xiong, J., Do, M. N., Smith, J. R., & Feris, R. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2018.2876046 · Cited by 75 · see citing works
Learning Joint Gait Representation via Quintuplet Loss Minimization
Zhang, K., Luo, W., Ma, L., Liu, W., & Li, H. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00483 · Cited by 75 · see citing works
Chen, S., Wang, J., & Gong, P. (2023) · Remote Sensing of Environment · doi:10.1016/j.rse.2023.113616 · Cited by 72 · see citing works
Self-supervised Learning for Spinal MRIs
Jamaludin, A., Kadir, T., & Zisserman, A. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-67558-9_34 · Cited by 70 · see citing works
Wang, P., Wen, J., Si, C., Qian, Y., & Wang, L. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3207577 · Cited by 69 · see citing works
Unsupervised Action Segmentation by Joint Representation Learning and Online Clustering
Kumar, S., Haresh, S., Ahmed, A., Konin, A., Zia, M. Z., & Tran, Q.-H. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01954 · Cited by 72 · see citing works
Dropout Rademacher complexity of deep neural networks
Gao, W., & Zhou, Z. (2016) · Science China Information Sciences · doi:10.1007/s11432-015-5470-z · Cited by 66 · see citing works
Deep Learning of Representations
Bengio, Y., & Courville, A. C. (2013) · Intelligent systems reference library · doi:10.1007/978-3-642-36657-4_1 · Cited by 66 · see citing works
Survey of Compressed Domain Video Summarization Techniques
Basavarajaiah, M., & Sharma, P. (2019) · ACM Computing Surveys · doi:10.1145/3355398 · Cited by 64 · see citing works
Slow, Decorrelated Features for Pretraining Complex Cell-like Networks
Bengio, Y., & Bergstra, J. (2009) · neural information processing systems · Cited by 61 · see citing works
- Authors
- Mobahi, H., Collobert, R., & Weston, J.
- Affiliations
- University of Illinois Urbana-Champaign (US)
- NEC Labs America, Princeton, NJ
- Venue
- Proceedings of the 26th Annual International Conference on Machine Learning
- Publisher
- ACM
- Published
- 2009-06-14
- Pages
- 737-744
- OpenAlex
- W2145038566
- Cited by
- 328
- References
- 35
- Citations by year
- 2026: 3 · 2025: 4 · 2024: 7 · 2023: 13 · 2022: 18 · 2021: 31 · 2020: 35 · 2019: 28 · 2018: 33 · 2017: 30 · 2016: 42 · 2015: 32 · 2014: 11 · 2013: 11 · 2012: 13
- FWCI
- 6.80
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Machine Learning (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Keywords
- temporal coherence, unlabeled video, self-supervised learning, sequential data, face recognition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review