The DOI matches its Crossref record; 127 of the 127 references it cites were found in a registry or an index.
Multi-Task Learning for Dense Prediction Tasks: A Survey
Open accessAbstract
With the advent of deep learning, many dense prediction tasks, i.e., tasks that produce pixel-level predictions, have seen significant performance improvements. The typical approach is to learn these tasks in isolation, that is, a separate neural network is trained for each individual task. Yet, recent multi-task learning (MTL) techniques have shown promising results w.r.t. performance, computations and/or memory footprint, by jointly tackling multiple tasks through a learned shared representation. In this survey, we provide a well-rounded view on state-of-the-art deep learning approaches for MTL in computer vision, explicitly emphasizing on dense prediction tasks. Our contributions concern the following. First, we consider MTL from a network architecture point-of-view. We include an extensive overview and discuss the advantages/disadvantages of recent popular MTL models. Second, we examine various optimization methods to tackle the joint learning of multiple tasks. We summarize the qualitative elements of these works and explore their commonalities and differences. Finally, we provide an extensive experimental evaluation across a variety of dense prediction benchmarks to examine the pros and cons of the different methods, including both architectural and optimization based strategies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.01703 · Cited by 31,473
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.324 · Cited by 30,581
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387 · cited 1×
“Transfer learning [87] makes use of the knowledge obtained when solving one task, and applies it to tackle another task.”
BackgroundChen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018) · arXiv · doi:10.48550/arxiv.1802.02611 · Cited by 20,063
Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_49 · Cited by 20,054
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
Zhao, H., Shi, J., Qi, X., Wang, X., & Jia, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.660 · Cited by 16,438
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
The Cityscapes Dataset for Semantic Urban Scene Understanding
Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., & Schiele, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.350 · Cited by 12,433
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2389824 · Cited by 11,971
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
Deep Learning Face Attributes in the Wild
Liu, Z., Luo, P., Wang, X., & Tang, X. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.425 · Cited by 7,747
Multi-scale context aggregation by dilated convolutions
Yu, F., & Koltun, V. (2015) · arXiv · doi:10.48550/arxiv.1511.07122 · Cited by 7,738
Caruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636
How transferable are features in deep neural networks?
Yosinski, J., Clune, J., Bengio, Y., & Lipson, H. (2014) · arXiv · doi:10.48550/arxiv.1411.1792 · Cited by 6,061
Deep High-Resolution Representation Learning for Human Pose Estimation
Sun, K., Xiao, B., Liu, D., & Wang, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00584 · Cited by 5,984
Indoor segmentation and support inference from rgbd images
Silberman, N., Hoiem, D., Kohli, P., & Fergus, R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33715-4_54 · Cited by 5,760
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
Wang, A., Singh, A., Michael, J., Hill, F., Levy, O., & Bowman, S. (2018) · Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP · doi:10.18653/v1/w18-5446 · Cited by 4,222
Stereo Processing by Semiglobal Matching and Mutual Information
Hirschmuller, H. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1166 · Cited by 4,195
Neural Architecture Search with Reinforcement Learning
Zoph, B., & Le, Q. V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01578 · Cited by 3,974
Depth Map Prediction from a Single Image using a Multi-Scale Deep Network
Eigen, D., Puhrsch, C., & Fergus, R. (2014) · arXiv · doi:10.48550/arxiv.1406.2283 · Cited by 3,442
DARTS: Differentiable architecture search
Liu, H., Simonyan, K., & Yang, Y. (2018) · arXiv · doi:10.48550/arxiv.1806.09055 · Cited by 3,248
Multi-task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semantics
Cipolla, R., Gal, Y., & Kendall, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00781 · Cited by 3,151
A Survey on Multi-Task Learning
Zhang, Y., & Yang, Q. (2017) · arXiv · doi:10.48550/arxiv.1707.08114 · Cited by 2,910
A Survey on Multi-Task Learning
Zhang, Y., & Yang, Q. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3070203 · Cited by 2,878
Eigen, D., & Fergus, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.304 · Cited by 2,862
Learning to detect natural image boundaries using local brightness, color, and texture cues
Martin, D. R., Fowlkes, C. C., & Malik, J. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.1273918 · Cited by 2,420
An Overview of Multi-Task Learning in Deep Neural Networks
Ruder, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.05098 · Cited by 2,265
Progressive Neural Architecture Search
Liu, C., Zoph, B., Neumann, M., Shlens, J., Hua, W., Li, L.-J., Fei-Fei, L., Yuille, A., Huang, J., & Murphy, K. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01246-5_2 · Cited by 1,833
Neural Architecture Search: A Survey
Elsken, T., Metzen, J. H., & Hutter, F. (2018) · arXiv · doi:10.48550/arxiv.1808.05377 · Cited by 1,763
(2018) · International Conference on Learning Representations · Cited by 1,621
Convex multi-task feature learning
Argyriou, A., Evgeniou, T., & Pontil, M. (2008) · Machine Learning · doi:10.1007/s10994-007-5040-8 · Cited by 1,528
(2018) · International Conference on Machine Learning · Cited by 1,465
Regularized multi--task learning
Evgeniou, T., & Pontil, M. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014067 · Cited by 1,433
Cross-Stitch Networks for Multi-task Learning
Misra, I., Shrivastava, A., Gupta, A., & Hebert, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.433 · Cited by 1,397
A Framework for Learning Predictive Structures from Multiple Tasks and Unlabeled Data
Ando, R. K., & Zhang, T. (2005) · doi:10.5555/1046920.1194905 · Cited by 1,311
Modeling Task Relationships in Multi-task Learning with Multi-gate Mixture-of-Experts
Ma, J., Zhao, Z., Yi, X., Chen, J., Hong, L., & Chi, E. H. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3220007 · Cited by 1,233
End-To-End Multi-Task Learning With Attention
Liu, S., Johns, E., & Davison, A. J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00197 · Cited by 1,202
Deng, L., Hinton, G., & Kingsbury, B. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639344 · Cited by 1,178
Taskonomy: Disentangling Task Transfer Learning
Zamir, A. R., Sax, A., Shen, W., Guibas, L., Malik, J., & Savarese, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00391 · Cited by 1,128
Multi-Task Learning as Multi-Objective Optimization
Sener, O., & Koltun, V. (2018) · arXiv · doi:10.48550/arxiv.1810.04650 · Cited by 852
Elsken, T., Metzen, J. H., & Hutter, F. (2019) · The Springer Series on Challenges in Machine Learning · doi:10.1007/978-3-030-05318-5_3 · Cited by 785
MultiNet: Real-time Joint Semantic Reasoning for Autonomous Driving
Teichmann, M., Weber, M., Zollner, M., Cipolla, R., & Urtasun, R. (2018) · 2018 IEEE Intelligent Vehicles Symposium (IV) · doi:10.1109/ivs.2018.8500504 · Cited by 681
Kokkinos, I. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.579 · Cited by 657
Piggyback: Adapting a Single Network to Multiple Tasks by Learning to Mask Weights
Mallya, A., Davis, D., & Lazebnik, S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01225-0_5 · Cited by 613
Learning multiple visual domains with residual adapters
Rebuffi, S.-A., Bilen, H., & Vedaldi, A. (2017) · arXiv · doi:10.48550/arxiv.1705.08045 · Cited by 605 · cited 1×
“This idea was later extended to the use of residual adapters [85], [86].”
BackgroundDetect What You Can: Detecting and Representing Objects Using Holistic Models and Body Parts
Chen, X., Mottaghi, R., Liu, X., Fidler, S., Urtasun, R., & Yuille, A. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.254 · Cited by 605
Adversarial Multi-task Learning for Text Classification
Liu, P., Qiu, X., & Huang, X. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1001 · Cited by 601
Multi-task Self-Supervised Visual Learning
Doersch, C., & Zisserman, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.226 · Cited by 598
Multi-Task Learning for Multiple Language Translation
Dong, D., Wu, H., He, W., Yu, D., & Wang, H. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1166 · Cited by 565
Multi-Task Feature Learning Via Efficient l2,1-Norm Minimization
Liu, J., Ji, S., & Ye, J. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1205.2631 · Cited by 555
Xu, D., Ouyang, W., Wang, X., & Sebe, N. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00077 · Cited by 518
Multi-task learning for classification with dirichlet process priors
Xue, Y., Liao, X., Carin, L., Krishnapuram, B., & Bartlett, P. (2007) · Cited by 485
DF-Net: Unsupervised Joint Learning of Depth and Flow Using Cross-Task Consistency
Zou, Y., Luo, Z., & Huang, J.-B. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01228-1_3 · Cited by 469
OCNet: Object Context Network for Scene Parsing
Yuan, Y., Huang, L., Guo, J., Zhang, C., Chen, X., & Wang, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.00916 · Cited by 453
The Natural Language Decathlon: Multitask Learning as Question Answering
McCann, B., Keskar, N. S., Xiong, C., & Socher, R. (2018) · arXiv · doi:10.48550/arxiv.1806.08730 · Cited by 448
Clustered Multi-Task Learning: A Convex Formulation
Jacob, L., Bach, F., & Vert, J. (2008) · arXiv (Cornell University) · doi:10.48550/arxiv.0809.2085 · Cited by 400
Multiple-gradient descent algorithm (MGDA) for multiobjective optimization
Désidéri, J.-A. (2012) · Comptes Rendus. Mathématique · doi:10.1016/j.crma.2012.03.014 · Cited by 391
Learning Gaussian processes from multiple tasks
Yu, K., Tresp, V., & Schwaighofer, A. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102479 · Cited by 380
Lu, Y., Kumar, A., Zhai, S., Cheng, Y., Javidi, T., & Feris, R. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.126 · Cited by 371
A Dirty Model for Multi-task Learning
Jalali, A., Sanghavi, S., Ruan, C., & Ravikumar, P. (2010) · Cited by 368
Dynamic Task Prioritization for Multitask Learning
Guo, M., Haque, A., Huang, D.-A., Yeung, S., & Fei-Fei, L. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01270-0_17 · Cited by 356
Pareto Multi-Task LearningPreprint
Lin, X., Zhen, H.-L., Li, Z., Zhang, Q., & Kwong, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.12854 · Cited by 344
Learning an Embedding Space for Transferable Robot Skills
Hausman, K., Springenberg, J. T., Wang, Z., Heess, N., & Riedmiller, M. (2018) · International Conference on Learning Representations · Cited by 341
Pattern-Affinitive Propagation Across Depth, Surface Normal and Semantic Segmentation
Zhang, Z., Cui, Z., Xu, C., Yan, Y., Sebe, N., & Yang, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00423 · Cited by 331
Regularized Evolution for Image Classifier Architecture Search
Real, E., Aggarwal, A., Huang, Y., & Le, Q. V. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33014780 · Cited by 328
Gao, Y., Ma, J., Zhao, M., Liu, W., & Yuille, A. L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00332 · Cited by 284
GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networks
Zhao, C., Badrinarayanan, V., Lee, C., & Rabinovich, A. (2018) · International Conference on Machine Learning · Cited by 275
Multi-task reinforcement learning: a hierarchical Bayesian approach
Wilson, A., Fern, A., Ray, S., & Tadepalli, P. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273624 · Cited by 261
Clustered Multi-Task Learning Via Alternating Structure Optimization.
Zhou, J., Chen, J., & Ye, J. (2011) · PubMed · Cited by 260
Learning Task Grouping and Overlap in Multi-task Learning
Kumar, A., & Daumé, H. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.6417 · Cited by 241
Just Pick a Sign: Optimizing Deep Multitask Models with Gradient Sign DropoutPreprint
Zhao, C., Ngiam, J., Huang, Y., Luong, M.-T., Kretzschmar, H., Chai, Y., & Anguelov, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.06808 · Cited by 236
MTI-Net: Multi-scale Task Interaction Networks for Multi-task Learning
Vandenhende, S., Georgoulis, S., & Van Gool, L. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58548-8_31 · Cited by 235
Self-citationJoint Task-Recursive Learning for Semantic Segmentation and Depth Estimation
Zhang, Z., Cui, Z., Xu, C., Jie, Z., Li, X., & Yang, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01249-6_15 · Cited by 218
Which Tasks Should Be Learned Together in Multi-task Learning?
Standley, T., Zamir, A., Chen, D., Guibas, L. J., Malik, J., & Savarese, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.07553 · Cited by 210
BlitzNet: A Real-Time Deep Network for Scene Understanding
Dvornik, N., Shmelkov, K., Mairal, J., & Schmid, C. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.447 · Cited by 204
A Hierarchical Multi-Task Approach for Learning Embeddings from Semantic Tasks
Sanh, V., Wolf, T., & Ruder, S. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33016949 · Cited by 203
Branched Multi-Task Networks: Deciding what layers to share
Vandenhende, S., Georgoulis, S., van Gool, L., & Brabandere, B. D. (2019) · British Machine Vision Conference · doi:10.48550/arxiv.1904.02920 · Cited by 200
Self-citationAttentive Single-Tasking of Multiple Tasks
Maninis, K.-K., Radosavovic, I., & Kokkinos, I. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00195 · Cited by 196
A Comparison of Loss Weighting Strategies for Multi task Learning in Deep Neural Networks
Gong, T., Lee, T., Stephenson, C., Renduchintala, V., Padhy, S., Ndirango, A., Keskin, G., & Elibol, O. H. (2019) · IEEE Access · doi:10.1109/access.2019.2943604 · Cited by 193
(2000) · CrossRef Listing of Deleted DOIs · doi:10.1162/153244304322765658 · Cited by 192
A Modulation Module for Multi-task Learning with Applications in Image Retrieval
Zhao, X., Li, H., Shen, X., Liang, X., & Wu, Y. N. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01246-5_25 · Cited by 184
Representation Similarity Analysis for Efficient Task Taxonomy & Transfer Learning
Dwivedi, K., & Roig, G. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01267 · Cited by 179
Real-Time Joint Semantic Segmentation and Depth Estimation Using Asymmetric Annotations
Nekrasov, V., Dharmasiri, T., Spek, A., Drummond, T. W., Shen, C., & Reid, I. D. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8794220 · Cited by 177
Robust Learning Through Cross-Task Consistency
Zamir, A., (Sasha), A. S., Cheerla, N., Suri, R., Cao, Z., Malik, J., & Guibas, L. J. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01121 · Cited by 175
Learning Multiple Tasks with Multilinear Relationship Networks
Long, M., Cao, Z., Wang, J., & Yu, P. S. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.02117 · Cited by 173
Progressive Neural Architecture Search
Liu, C., Zoph, B., Neumann, M., Shlens, J., Hua, W., Li, L.-J., Fei-Fei, L., Yuille, A., Huang, J., & Murphy, K. (2017) · arXiv · doi:10.48550/arxiv.1712.00559 · Cited by 171 · cited 1×
“Yet, most existing NAS works are limited to task-specific models [92], [93], [94], [95], [96].”
BackgroundLearning a meta-level prior for feature relevance from multiple related tasks
Lee, S.-I., Chatalbashev, V., Vickrey, D., & Koller, D. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273558 · Cited by 161
Large Scale Holistic Video Understanding
Diba, A., Fayyaz, M., Sharma, V., Paluri, M., Gall, J., Stiefelhagen, R., & Gool, L. V. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58558-7_35 · Cited by 154
Universal representations:The missing link between faces, text, planktons, and cat breedsPreprint
Bilen, H., & Vedaldi, A. (2017) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.48550/arxiv.1701.07275 · Cited by 153
Hand, E., & Chellappa, R. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11229 · Cited by 152
Multi-Task Video Captioning with Video and Entailment Generation
Pasunuru, R., & Bansal, M. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1117 · Cited by 130
PixelNet: Representation of the pixels, by the pixels, and for the pixelsPreprint
Bansal, A., Chen, X., Russell, B. C., Gupta, A. K., & Ramanan, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.06506 · Cited by 127
Semisupervised Multitask Learning
Liu, Q., Liao, X., Li, H., Stack, J. R., & Carin, L. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.296 · Cited by 125
Evolutionary architecture search for deep multitask networks
Liang, J., Meyerson, E., & Miikkulainen, R. P. (2018) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3205455.3205489 · Cited by 122
Pattern-Structure Diffusion for Multi-Task Learning
Zhou, L., Cui, Z., Xu, C., Zhang, Z., Wang, C., Zhang, T., & Yang, J. W. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00457 · Cited by 116
Stochastic Filter Groups for Multi-Task CNNs: Learning Specialist and Generalist Convolution Kernels
Bragman, F., Tanno, R., Sebastien Ourselin, A., Alexander, D. C., & Cardoso, M. J. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00147 · Cited by 109
Bayesian Multitask Learning with Latent HierarchiesPreprint
Daumé, H. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0907.0783 · Cited by 104
Multitask Learning Strengthens Adversarial Robustness
Mao, C., Gupta, A., Nitin, V., Ray, B., Song, S., Yang, J., & Vondrick, C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58536-5_10 · Cited by 100
Walk and Learn: Facial Attribute Representation Learning from Egocentric Video and Contextual Data
Wang, J., Cheng, Y., & Feris, R. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.252 · Cited by 99
Multi-Task Active Learning for Linguistic Annotations
Reichart, R., Tomanek, K., Hahn, U., & Rappoport, A. (2008) · Cited by 95
Fast Scene Understanding for Autonomous DrivingPreprint
Neven, D., Brabandere, B. D., Georgoulis, S., Proesmans, M., & Gool, L. V. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.02550 · Cited by 93
Self-citationLeveraging Sequence Classification by Taxonomy-Based Multitask Learning
Widmer, C., Leiva, J., Altün, Y., & Rätsch, G. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-12683-3_34 · Cited by 76
Learning Multiple Tasks using Manifold Regularization
Agarwal, A. K., Gerber, S., & Daumé, H. (2010) · neural information processing systems · Cited by 76
Automated Search for Resource-Efficient Branched Multi-Task Networks
Brüggemann, D., Kanakis, M., Georgoulis, S., & Gool, L. V. (2020) · British Machine Vision Conference (BMVC) · doi:10.5244/c.34.93 · Cited by 72
Self-citationSemi-Supervised Multi-Task Regression
Zhang, Y., & Yeung, D. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-04174-7_40 · Cited by 71
Regularizing Deep Multi-Task Networks using Orthogonal GradientsPreprint
Suteu, M., & Guo, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.06844 · Cited by 69
GNAS: A Greedy Neural Architecture Search Method for Multi-Attribute Learning
Huang, S., Li, X., Cheng, Z.-Q., Zhang, Z. M., & Hauptmann, A. G. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240588 · Cited by 68
Infinite Predictor Subspace Models for Multitask Learning
Rai, P., & Daumé, H. (2010) · Cited by 64
Compositional Transfer in Hierarchical Reinforcement Learning
Wulfmeier, M., Abdolmaleki, A., Hafner, R., Springenberg, J. T., Neunert, M., Siegel, N., Hertweck, T., Lampe, T., Heess, N., & Riedmiller, M. (2020) · Robotics: Science and Systems · doi:10.15607/rss.2020.xvi.054 · Cited by 53
Direction selectivity in V1 of alert monkeys: evidence for parallel pathways for motion processing
Gur, M., & Snodderly, D. M. (2007) · The Journal of Physiology · doi:10.1113/jphysiol.2007.143040 · Cited by 44
Active Multitask Learning Using Both Latent and Supervised Shared Topics
Acharya, A., Mooney, R. J., & Ghosh, J. (2014) · SIAM International Conference on Data Mining · doi:10.1137/1.9781611973440.22 · Cited by 38
GrokNet: Unified Computer Vision Model Trunk and Embeddings For Commerce
Bell, S., Liu, Y., Alsheikh, S., Tang, Y., Pizzi, E., Henning, M., Singh, K., Parkhi, O., & Borisyuk, F. (2020) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3394486.3403311 · Cited by 36
Disjoint Multi-task Learning Between Heterogeneous Human-Centric Tasks
Kim, D.-J., Choi, J., Oh, T.-H., Yoon, Y., & Kweon, I. S. (2018) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2018.00189 · Cited by 32
Holistic Large Scale Video Understanding
Diba, A., Fayyaz, M., Sharma, V., Paluri, M., Gall, J., Stiefelhagen, R., & Gool, L. V. (2019) · Lirias · Cited by 25
Feature Partitioning for Efficient Multi-Task ArchitecturesPreprint
Newell, A., Jiang, L., Wang, C., Li, L.-J., & Deng, J. (2019) · arXiv.org · doi:10.48550/arxiv.1908.04339 · Cited by 19
Regularized Hierarchical Policies for Compositional Transfer in Robotics.Preprint
Wulfmeier, M., Abdolmaleki, A., Hafner, R., Springenberg, J. T., Neunert, M., Hertweck, T., Lampe, T., Siegel, N., Heess, N., & Riedmiller, M. (2019) · arXiv (Cornell University) · Cited by 17
Latent Multi-Task Architecture Learning
Ruder, S., Bingel, J., Augenstein, I., & Søgaard, A. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33014822 · Cited by 14
Cited by
FairMOT: On the Fairness of Detection and Re-identification in Multiple Object Tracking
Zhang, Y., Wang, C., Wang, X., Zeng, W., & Liu, W. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01513-4 · Cited by 1,861
DeFRCN: Decoupled Faster R-CNN for Few-Shot Object Detection
Qiao, L., Zhao, Y., Li, Z., Qiu, X., Wu, J., & Zhang, C. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00856 · Cited by 387
Rethinking the Competition Between Detection and ReID in Multiobject Tracking
Liang, C., Zhang, Z., Zhou, X., Li, B., Zhu, S., & Hu, W. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3165376 · Cited by 372
Generative adversarial networks (GANs) for image augmentation in agriculture: A systematic review
Lu, Y., Chen, D., Olaniyi, E., & Huang, Y. (2022) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2022.107208 · Cited by 362
A systematic review and analysis of deep learning-based underwater object detection
Xu, S., Zhang, M., Song, W., Mei, H., He, Q., & Liotta, A. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.01.056 · Cited by 319
Metadata
- Authors
- Vandenhende, S., Georgoulis, S., Van Gansbeke, W., Proesmans, M., Dai, D., & Van Gool, L.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2021
- Volume
- 44
- Issue
- 7
- Pages
- 1-1
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W3085046840
- Cited by
- 840
- References
- 127
- FWCI
- 50.35
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.