A Survey of Recent Advances in Transfer Learning
The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
The integration of transfer learning methods and other machine learning branches can bring a good improvement in speed and performance, it has become a good research topic in the recent years and it is necessary for researchers to understand the integration. This paper focuses on sorting and classifying the integrated results of the transfer learning and the other non-transfer machine learning, such as reinforcement leaning, lifelong learning, adversarial networks. Besides, this paper also organizes the latest work on the transitive transfer learning and categorizes the relevant applications for transfer learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Domain-Adversarial Training of Neural Networks
Ganin, Y., Ustinova, E., Ajakan, H., Germain, P., Larochelle, H., Laviolette, F., Marchand, M., & Lempitsky, V. (2017) · Advances in Computer Vision and Pattern Recognition · doi:10.1007/978-3-319-58347-1_10 · Cited by 8,318
Improved training of Wasserstein GANs
Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., & Courville, A. (2017) · arXiv · doi:10.48550/arxiv.1704.00028 · Cited by 6,800 · cited 1×
“The approach named RadialGAN which is a variant of the well-known generative adversarial networks (GAN [39]) namely CycleGAN [40] provides a natural solution to the two problems.”
BackgroundWeiss, K., Khoshgoftaar, T. M., & Wang, D. (2016) · Journal of Big Data · doi:10.1186/s40537-016-0043-6 · Cited by 6,260
Adversarial Discriminative Domain Adaptation
Tzeng, E., Hoffman, J., Saenko, K., & Darrell, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.316 · Cited by 5,154 · cited 1×
“[46] proposed a novel discriminatively-trained Cycle-Consistent Adversarial Domain Adaptation model (CyCADA) which combined prior feature-level [47, 48] and image-level [49, 50, 51] adversarial domain adaptation methods with cycle-consistency image-to-image translation techniques [52].”
MethodCyCADA: Cycle-Consistent Adversarial Domain Adaptation
Hoffman, J., Tzeng, E., Park, T., Zhu, J.-Y., Isola, P., Saenko, K., Efros, A. A., & Darrell, T. (2017) · arXiv · doi:10.48550/arxiv.1711.03213 · Cited by 2,656 · cited 2×
“[46] proposed a novel discriminatively-trained Cycle-Consistent Adversarial Domain Adaptation model (CyCADA) which combined prior feature-level [47, 48] and image-level [49, 50, 51] adversarial domain adaptation methods with cycle-consistency image-to-image translation techniques [52].”
BackgroundMethodUnsupervised Pixel-Level Domain Adaptation with Generative Adversarial Networks
Bousmalis, K., Silberman, N., Dohan, D., Erhan, D., & Krishnan, D. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.18 · Cited by 1,603 · cited 1×
“[46] proposed a novel discriminatively-trained Cycle-Consistent Adversarial Domain Adaptation model (CyCADA) which combined prior feature-level [47, 48] and image-level [49, 50, 51] adversarial domain adaptation methods with cycle-consistency image-to-image translation techniques [52].”
MethodSelf-direction for lifelong learning: a comprehensive guide to theory and practice
(1992) · Choice Reviews Online · doi:10.5860/choice.29-4017 · Cited by 1,191
Improving generalization for temporal difference learning: The successor representation
Dayan, P. (1993) · Neural Computation · doi:10.1162/neco.1993.5.4.613 · Cited by 693
Transfer learning from speaker verification to multispeaker text-to-speech synthesis
Jia, Y., Zhang, Y., Weiss, R. J., Wang, Q., Shen, J., Ren, F., Chen, Z., Nguyen, P., Pang, R., Moreno, I. L., et al. (2018) · arXiv · doi:10.48550/arxiv.1806.04558 · Cited by 519 · cited 1×
“used the transductive transfer learning with string kernels to classify the cross-domain text [69].”
Method
Cited by
A survey on data‐efficient algorithms in big data era
Adadi, A. (2021) · Journal of Big Data · doi:10.1186/s40537-021-00419-9 · Cited by 331
Pinto, G., Wang, Z., Roy, A., Hong, T., & Capozzoli, A. (2022) · Advances in Applied Energy · doi:10.1016/j.adapen.2022.100084 · Cited by 295
Deepfake video detection: challenges and opportunities
Kaur, A., Noori Hoshyar, A., Saikrishna, V., Firmin, S., & Xia, F. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10810-6 · Cited by 214
“In areas with lots of annotated data, transfer learning can help improve learning performance (Liang et al. 2019).”
Deep Relation Network for Hyperspectral Image Few-Shot Classification
Gao, K., Liu, B., Yu, X., Qin, J., Zhang, P., & Tan, X. (2020) · Remote Sensing · doi:10.3390/rs12060923 · Cited by 183
“Different HSI contain different types and quantities of ground objects, so it is difficult for the general transfer learning [47,48] to obtain satisfactory classification accuracy with a few labeled sample.”
BackgroundLi, J., Zi, S., Song, R., Li, Y., Hu, Y., & Du, Q. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3152587 · Cited by 64
“To be specific, when there is a significant difference in the feature distribution between the source domain and the target domain, a well-trained model cannot achieve ideal prediction results in the target domain due to its limited generalization ability [10].”
Background
Metadata
- Authors
- Liang, H., Fu, W., & Yi, F.
- Venue
- 2019 IEEE 19th International Conference on Communication Technology (ICCT)
- Publisher
- IEEE
- Published
- 2019-10
- Pages
- 1516-1523
- OpenAlex
- W2997788524
- Cited by
- 87
- References
- 10
- FWCI
- 3.41
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.