The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Transfer Learning With Adaptive Fine-Tuning
Open accessAbstract
With the utilization of deep learning approaches, the key factors for a successful application are sufficient datasets with reliable ground truth, which are generally not easy to obtain, especially in the field of medicine. In recent years, this issue has been commonly addressed with the exploitation of transfer learning via fine-tuning, which enables us to start with a model, pre-trained for a specific task, and then fine-tune (train) only certain layers of the neural network for a related but different target task. However, the selection of fine-tunable layers is one of the major problems of such an approach. Since there is no general rule on how to select layers in order to achieve the highest possible performance, we developed the Differential Evolution based Fine-Tuning (DEFT) method for the selection of fine-tunable layers for a target dataset under the given constraints. The method was evaluated against the problem of identifying the osteosarcoma from the medical imaging dataset. The performance was compared against a conventionally trained convolutional neural network, a pre-trained model, and the model trained using a fine-tuning approach with manually handpicked fine-tunable layers. In terms of classification accuracy, our proposed method outperformed the compared methods by a margin of 4.45% to 32.75%.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Storn, R., & Price, K. (1997) · Journal of Global Optimization · doi:10.1023/a:1008202821328 · Cited by 29,569
Semi-supervised classification with graph convolutional networks
Kipf, T. N., & Welling, M. (2016) · arXiv · doi:10.48550/arxiv.1609.02907 · Cited by 24,853
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Statistical Methods for Rates and Proportions
Fleiss, J. L., Levin, B., & Paik, M. C. (2003) · Wiley Series in Probability and Statistics · doi:10.1002/0471445428 · Cited by 18,646
A survey on deep learning in medical image analysis
Litjens, G., Kooi, T., Bejnordi, B. E., Setio, A. A. A., Ciompi, F., Ghafoorian, M., van der Laak, J. A. W. M., van Ginneken, B., & Sánchez, C. I. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.07.005 · Cited by 15,332
How transferable are features in deep neural networks?
Yosinski, J., Clune, J., Bengio, Y., & Lipson, H. (2014) · arXiv · doi:10.48550/arxiv.1411.1792 · Cited by 6,061
Differential Evolution: A Survey of the State-of-the-Art
Das, S., & Suganthan, P. N. (2011) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2010.2059031 · Cited by 5,307
Deep learning in agriculture: A survey
Kamilaris, A., & Prenafeta-Boldú, F. X. (2018) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2018.02.016 · Cited by 5,133
Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning
Kermany, D. S., Goldbaum, M., Cai, W., Valentim, C. C. S., Liang, H., Baxter, S. L., McKeown, A., Yang, G., Wu, X., Yan, F., et al. (2018) · Cell · doi:10.1016/j.cell.2018.02.010 · Cited by 4,842
Learning Transferable Features with Deep Adaptation Networks
Long, M., Cao, Y., Wang, J., & Jordan, M. I. (2015) · arXiv · doi:10.48550/arxiv.1502.02791 · Cited by 4,505
CNN Features Off-the-Shelf: An Astounding Baseline for Recognition
Razavian, A. S., Azizpour, H., Sullivan, J., & Carlsson, S. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2014.131 · Cited by 4,451
Semi-Supervised Learning Literature Survey
Zhu, X. (2005) · Minds at UW (University of Wisconsin) · Cited by 3,844
Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning?
Tajbakhsh, N., Shin, J. Y., Gurudu, S. R., Hurst, R. T., Kendall, C. B., Gotway, M. B., & Liang, J. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2535302 · Cited by 3,277
Deep learning for healthcare: review, opportunities and challenges
Miotto, R., Wang, F., Wang, S., Jiang, X., & Dudley, J. T. (2018) · Briefings in Bioinformatics · doi:10.1093/bib/bbx044 · Cited by 3,076
Pattern recognition and machine learning
(2007) · Choice Reviews Online · doi:10.5860/choice.44-5091 · Cited by 2,650
Opportunities and obstacles for deep learning in biology and medicine
Ching, T., Himmelstein, D. S., Beaulieu-Jones, B. K., Kalinin, A. A., Do, B. T., Way, G. P., Ferrero, E., Agapow, P.-M., Zietz, M., Hoffman, M. M., et al. (2018) · Journal of The Royal Society Interface · doi:10.1098/rsif.2017.0387 · Cited by 2,310
Deep learning for computational biology
Angermueller, C., Pärnamaa, T., Parts, L., & Stegle, O. (2016) · Molecular Systems Biology · doi:10.15252/msb.20156651 · Cited by 1,473
Inductive learning algorithms and representations for text categorization
Dumais, S., Platt, J., Heckerman, D., & Sahami, M. (1998) · Proceedings of the seventh international conference on Information and knowledge management · doi:10.1145/288627.288651 · Cited by 1,461
A Deep Learning Approach for Network Intrusion Detection System
Javaid, A., Niyaz, Q., Sun, W., & Alam, M. (2016) · Proceedings of the 9th EAI International Conference on Bio-inspired Information and Communications Technologies (formerly BIONETICS) · doi:10.4108/eai.3-12-2015.2262516 · Cited by 1,274
Deep Learning for Medical Image Processing: Overview, Challenges and the Future
Razzak, M. I., Naz, S., & Zaib, A. (2018) · Lecture Notes in Computational Vision and Biomechanics · doi:10.1007/978-3-319-65981-7_12 · Cited by 1,248
Statistical Comparisons of Classifiers over Multiple Data Sets
DemšarJanez (2006) · Journal of Machine Learning Research · doi:10.5555/1248547.1248548 · Cited by 1,074
Towards better exploiting convolutional neural networks for remote sensing scene classification
Nogueira, K., Penatti, O. A. B., & dos Santos, J. A. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2016.07.001 · Cited by 902
An experimental comparison of performance measures for classification
Ferri, C., Hernández-Orallo, J., & Modroiu, R. (2009) · Pattern Recognition Letters · doi:10.1016/j.patrec.2008.08.010 · Cited by 889
Residual networks behave like ensembles of relatively shallow networks
Veit, A., Wilber, M. J., & Belongie, S. (2016) · neural information processing systems · Cited by 851
Residual Networks Behave Like Ensembles of Relatively Shallow Networks
Veit, A., Wilber, M., & Belongie, S. (2016) · arXiv · doi:10.48550/arxiv.1605.06431 · Cited by 705
A Study on CNN Transfer Learning for Image Classification
Hussain, M., Bird, J. J., & Faria, D. R. (2019) · Advances in Intelligent Systems and Computing · doi:10.1007/978-3-319-97982-3_16 · Cited by 607
Huynh, B. Q., Li, H., & Giger, M. L. (2016) · Journal of Medical Imaging · doi:10.1117/1.jmi.3.3.034501 · Cited by 539
SpotTune: Transfer Learning Through Adaptive Fine-Tuning
Guo, Y., Shi, H., Kumar, A., Grauman, K., Rosing, T., & Feris, R. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00494 · Cited by 506
Large Scale Fine-Grained Categorization and Domain-Specific Transfer Learning
Cui, Y., Song, Y., Sun, C., Howard, A., & Belongie, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00432 · Cited by 503
Machine Learning in Seismology: Turning Data into Insights
Kong, Q., Trugman, D. T., Ross, Z. E., Bianco, M. J., Meade, B. J., & Gerstoft, P. (2019) · Seismological Research Letters · doi:10.1785/0220180259 · Cited by 498
Deep Convolutional Neural Networks for breast cancer screening
Chougrad, H., Zouaki, H., & Alheyane, O. (2018) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2018.01.011 · Cited by 470
Factors of Transferability for a Generic ConvNet Representation
Azizpour, H., Razavian, A. S., Sullivan, J., Maki, A., & Carlsson, S. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2500224 · Cited by 301
Breast cancer histology images classification: Training from scratch or transfer learning?
Shallu, & Mehra, R. (2018) · ICT Express · doi:10.1016/j.icte.2018.10.007 · Cited by 277
Gómez-Valverde, J. J., Antón, A., Fatti, G., Liefers, B., Herranz, A., Santos, A., Sánchez, C. I., & Ledesma-Carbayo, M. J. (2019) · Biomedical Optics Express · doi:10.1364/boe.10.000892 · Cited by 265
Class-dependent discretization for inductive learning from continuous and mixed-mode data
Ching, J. Y., Wong, A. K. C., & Chan, K. C. C. (1995) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.391407 · Cited by 241
Review of Differential Evolution population size
Piotrowski, A. P. (2017) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2016.05.003 · Cited by 235
Borrowing Treasures from the Wealthy: Deep Transfer Learning through Selective Joint Fine-Tuning
Ge, W., & Yu, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.9 · Cited by 221
Arunachalam, H. B., Mishra, R., Daescu, O., Cederberg, K., Rakheja, D., Sengupta, A. L., Leonard, D., Hallac, R. R., & Leavey, P. J. (2019) · PLoS ONE · doi:10.1371/journal.pone.0210706 · Cited by 169
PyCM: Multiclass confusion matrix library in Python
Haghighi, S., Jasemi, M., Hessabi, S., & Zolanvari, A. (2018) · Journal of Open Source Software · doi:10.21105/joss.00729 · Cited by 167
Classifier Ensembles with a Random Linear Oracle
Kuncheva, L. I., & Rodriguez, J. J. (2007) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2007.1016 · Cited by 160
A deep CNN based transfer learning method for false positive reduction
Shi, Z., Hao, H., Zhao, M., Feng, Y., He, L., Wang, Y., & Suzuki, K. (2018) · Multimedia Tools and Applications · doi:10.1007/s11042-018-6082-6 · Cited by 146
Using rule sets to maximize ROC performance
Fawcett, T. E. (2002) · Proceedings · doi:10.1109/icdm.2001.989510 · Cited by 145
Nakisa, B., Rastgoo, M. N., Rakotonirainy, A., Maire, F., & Chandran, V. (2018) · IEEE Access · doi:10.1109/access.2018.2868361 · Cited by 141
Convolutional Neural Network for Histopathological Analysis of Osteosarcoma
Mishra, R., Daescu, O., Leavey, P. J., Rakheja, D., & Sengupta, A. L. (2017) · Journal of Computational Biology · doi:10.1089/cmb.2017.0153 · Cited by 89
Deep transfer learning-based hologram classification for molecular diagnostics
Kim, S.-J., Wang, C., Zhao, B., Im, H., Min, J., Choi, H. J., Tadros, J., Choi, N. R., Castro, C. M., Weissleder, R., et al. (2018) · Scientific Reports · doi:10.1038/s41598-018-35274-x · Cited by 70
Test-cost sensitive classification on data with missing values
Yang, Q., Ling, C. X., Chai, X., & Pan, R. (2006) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2006.84 · Cited by 66
Evolving Deep CNN-LSTMs for Inventory Time Series Prediction
Xue, N., Triguero, I., Figueredo, G. P., & Landa-Silva, D. (2019) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2019.8789957 · Cited by 65
Xingquan Zhu, A., & Wu, X. (2006) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2006.155 · Cited by 51
Mishra, R., Daescu, O., Leavey, P. J., Rakheja, D., & Sengupta, A. L. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-59575-7_2 · Cited by 47
Vrbančič, G., & Podgorelec, V. (2018) · Elektronika ir Elektrotechnika · doi:10.5755/j01.eie.24.4.21469 · Cited by 45
Self-citationFlisar, J., & Podgorelec, V. (2019) · IEEE Access · doi:10.1109/access.2019.2933318 · Cited by 32
Self-citationVrbančič, G., Zorman, M., & Podgorelec, V. (2019) · doi:10.26493/978-961-7055-82-5.61-66 · Cited by 26
Self-citationVrbančič, G., Fister, I., & Podgorelec, V. (2019) · International Journal of Artificial Intelligence Tools · doi:10.1142/s021821301960008x · Cited by 20
Self-citationA novel self-adaptive differential evolution for feature selection using threshold mechanism
Fister, D., Fister, I., Jagrič, T., Fister, I., & Brest, J. (2018) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci.2018.8628715 · Cited by 18
Automatic Detection of Heartbeats in Heart Sound Signals Using Deep Convolutional Neural Networks
Vrbančič, G., Fister, I., & Podgorelec, V. (2019) · Elektronika ir Elektrotechnika · doi:10.5755/j01.eie.25.3.23680 · Cited by 14
Self-citationLearning to Transfer Learn: Reinforcement Learning-Based Selection for Adaptive Transfer Learning
Zhu, L., Arık, S. Ö., Yang, Y., & Pfister, T. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58583-9_21 · Cited by 12
Chen, T., Wang, Z., Li, L., Li, D., Li, Z., Chang, X., Bian, P., Liang, G., Wang, Q., & Xie, T. (2025) · Schloss Dagstuhl – Leibniz-Zentrum für Informatik · doi:10.4230/lipics.ecoop.2025.6
Cited by
A Comprehensive Review of Deep Learning: Architectures, Recent Advances, and Applications
Mienye, I. D., & Swart, T. G. (2024) · Information · doi:10.3390/info15120755 · Cited by 330
Lamaakal, I., Maleh, Y., El Makkaoui, K., Ouahbi, I., Pławiak, P., Alfarraj, O., Almousa, M., & Abd El-Latif, A. A. (2025) · Sensors · doi:10.3390/s25051318 · Cited by 60
Privacy-Preserving Federated Transfer Learning for Driver Drowsiness Detection
Zhang, L., Saito, H., Yang, L., & Wu, J. (2022) · IEEE Access · doi:10.1109/access.2022.3192454 · Cited by 54
Lee, J. H., & You, S. J. (2024) · IEEE Access · doi:10.1109/access.2024.3352146 · Cited by 29
Metadata
- Authors
- Vrbancic, G., & Podgorelec, V.
- Venue
- IEEE Access
- Published
- 2020
- Volume
- 8
- Pages
- 196197-196211
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W3096015486
- Cited by
- 254
- References
- 62
- FWCI
- 8.71
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.