The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
The Development of a Skin Cancer Classification System for Pigmented Skin Lesions Using Deep Learning
Open accessAbstract
Recent studies have demonstrated the usefulness of convolutional neural networks (CNNs) to classify images of melanoma, with accuracies comparable to those achieved by dermatologists. However, the performance of a CNN trained with only clinical images of a pigmented skin lesion in a clinical image classification task, in competition with dermatologists, has not been reported to date. In this study, we extracted 5846 clinical images of pigmented skin lesions from 3551 patients. Pigmented skin lesions included malignant tumors (malignant melanoma and basal cell carcinoma) and benign tumors (nevus, seborrhoeic keratosis, senile lentigo, and hematoma/hemangioma). We created the test dataset by randomly selecting 666 patients out of them and picking one image per patient, and created the training dataset by giving bounding-box annotations to the rest of the images (4732 images, 2885 patients). Subsequently, we trained a faster, region-based CNN (FRCNN) with the training dataset and checked the performance of the model on the test dataset. In addition, ten board-certified dermatologists (BCDs) and ten dermatologic trainees (TRNs) took the same tests, and we compared their diagnostic accuracy with FRCNN. For six-class classification, the accuracy of FRCNN was 86.2%, and that of the BCDs and TRNs was 79.5% (p = 0.0081) and 75.1% (p < 0.00001), respectively. For two-class classification (benign or malignant), the accuracy, sensitivity, and specificity were 91.5%, 83.3%, and 94.5% by FRCNN; 86.6%, 86.3%, and 86.6% by BCD; and 85.3%, 83.5%, and 85.9% by TRN, respectively. False positive rates and positive predictive values were 5.5% and 84.7% by FRCNN, 13.4% and 70.5% by BCD, and 14.1% and 68.5% by TRN, respectively. We compared the classification performance of FRCNN with 20 dermatologists. As a result, the classification accuracy of FRCNN was better than that of the dermatologists. In the future, we plan to implement this system in society and have it used by the general public, in order to improve the prognosis of skin cancer.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
(2016) · Cited by 31,590
SSD: Single Shot MultiBox Detector
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., & Berg, A. C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_2 · Cited by 22,128
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
A survey of deep neural network architectures and their applications
Liu, W., Wang, Z., Liu, X., Zeng, N., Liu, Y., & Alsaadi, F. E. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.12.038 · Cited by 3,239 · cited 1×
“Lastly, although we used the FRCNN architecture in the present study, we need to carefully choose the best method for achieving our goal, because deep learning technologies have recently been progressing massively [51].”
MethodOn the momentum term in gradient descent learning algorithms
Qian, N. (1999) · Neural Networks · doi:10.1016/s0893-6080(98)00116-6 · Cited by 2,312
Haenssle, H. A., Fink, C., Schneiderbauer, R., Toberer, F., Buhl, T., Blum, A., Kalloo, A., Hassen, A. B. H., Thomas, L., Enk, A., et al. (2018) · Annals of Oncology · doi:10.1093/annonc/mdy166 · Cited by 1,571
Schadendorf, D., van Akkooi, A. C. J., Berking, C., Griewank, K. G., Gutzmer, R., Hauschild, A., Stang, A., Roesch, A., & Ugurel, S. (2018) · The Lancet · doi:10.1016/s0140-6736(18)31559-9 · Cited by 1,488
Diagnostic Inaccuracy of Smartphone Applications for Melanoma Detection
Wolf, J. A., Moreau, J. F., Akilov, O., Patton, T., English, J. C., Ho, J., & Ferris, L. K. (2013) · JAMA Dermatology · doi:10.1001/jamadermatol.2013.2382 · Cited by 393 · cited 1×
“However, usage of such applications for the self-assessment of skin cancer has been problematic, due to the lack of evidence on the applications’ diagnostic accuracy [38,39].”
BackgroundMelanoma detection by analysis of clinical images using convolutional neural network
Nasr-Esfahani, E., Samavi, S., Karimi, N., Soroushmehr, S. M. R., Jafari, M. H., Ward, K., & Najarian, K. (2016) · 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2016.7590963 · Cited by 373
Fujisawa, Y., Otomo, Y., Ogata, Y., Nakamura, Y., Fujita, R., Ishitsuka, Y., Watanabe, R., Okiyama, N., Ohara, K., & Fujimoto, M. (2019) · British Journal of Dermatology · doi:10.1111/bjd.16924 · Cited by 317
Brinker, T. J., Hekler, A., Enk, A. H., Klode, J., Hauschild, A., Berking, C., Schilling, B., Haferkamp, S., Schadendorf, D., Fröhling, S., et al. (2019) · European Journal of Cancer · doi:10.1016/j.ejca.2019.02.005 · Cited by 302
Yamada, M., Saito, Y., Imaoka, H., Saiko, M., Yamada, S., Kondo, H., Takamaru, H., Sakamoto, T., Sese, J., Kuchiba, A., et al. (2019) · Scientific Reports · doi:10.1038/s41598-019-50567-5 · Cited by 265
Self-citationAn Improved Faster R-CNN for Small Object Detection
Cao, C., Wang, B., Zhang, W., Zeng, X., Yan, X., Feng, Z., Liu, Y., & Wu, Z. (2019) · IEEE Access · doi:10.1109/access.2019.2932731 · Cited by 257
Robust Methods for Real-Time Diabetic Foot Ulcer Detection and Localization on Mobile Devices
Goyal, M., Reeves, N. D., Rajbhandari, S., & Yap, M. H. (2019) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2018.2868656 · Cited by 220
An improved deep learning approach for detection of thyroid papillary cancer in ultrasound images
Li, H., Weng, J., Shi, Y., Gu, W., Mao, Y., Wang, Y., Liu, W., & Zhang, J. (2018) · Scientific Reports · doi:10.1038/s41598-018-25005-7 · Cited by 171
Delays in diagnosis and melanoma prognosis (I): The role of patients
Richard, M. A., Grob, J. J., Avril, M. F., Delaunay, M., Gouvernet, J., Wolkenstein, P., Souteyrand, P., Dreno, B., Bonerandi, J. J., Dalac, S., et al. (2000) · International Journal of Cancer · doi:10.1002/1097-0215(20000520)89:3<271::aid-ijc10>3.0.co;2-7 · Cited by 164
Kassianos, A. P., Emery, J. D., Murchie, P., & Walter, F. M. (2015) · British Journal of Dermatology · doi:10.1111/bjd.13665 · Cited by 151 · cited 2×
“However, usage of such applications for the self-assessment of skin cancer has been problematic, due to the lack of evidence on the applications’ diagnostic accuracy [38,39].”
BackgroundFace Detection With Different Scales Based on Faster R-CNN
Wu, W., Yin, Y., Wang, X., & Xu, D. (2018) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2859482 · Cited by 145
Hamamoto, R., Komatsu, M., Takasawa, K., Asada, K., & Kaneko, S. (2019) · Biomolecules · doi:10.3390/biom10010062 · Cited by 140
Self-citationOptimized YOLOv3 Algorithm and Its Application in Traffic Flow Detections
Huang, Y., Zheng, J., Sun, S., Yang, C., & Liu, J. (2020) · Applied Sciences · doi:10.3390/app10093079 · Cited by 127
Fujisawa, Y., Yoshikawa, S., Minagawa, A., Takenouchi, T., Yokota, K., Uchi, H., Noma, N., Nakamura, Y., Asai, J., Kato, J., et al. (2019) · Cancer Medicine · doi:10.1002/cam4.2110 · Cited by 122
Electrocardiogram Classification Based on Faster Regions with Convolutional Neural Network
Ji, Y., Zhang, S., & Xiao, W. (2019) · Sensors · doi:10.3390/s19112558 · Cited by 102
Accuracy of a smartphone application for triage of skin lesions based on machine learning algorithms
Udrea, A., Mitra, G. D., Costea, D., Noels, E. C., Wakkee, M., Siegel, D. M., de Carvalho, T. M., & Nijsten, T. E. C. (2020) · Journal of the European Academy of Dermatology and Venereology · doi:10.1111/jdv.15935 · Cited by 96
Shao, F., Wang, X., Meng, F., Zhu, J., Wang, D., & Dai, J. (2019) · Sensors · doi:10.3390/s19102288 · Cited by 72
Cognitive function in children with leukemia. Effect of radiation dose and time since irradiation
Moore, I. M., Kramer, J. H., Wara, W. M., Halberg, F. E., & Ablin, A. R. (1991) · Cancer · doi:10.1002/1097-0142(19911101)68:9<2064::aid-cncr2820680937>3.0.co;2-3 · Cited by 71
Uncovering Prognosis-Related Genes and Pathways by Multi-Omics Analysis in Lung Cancer
Asada, K., Kobayashi, K., Joutard, S., Tubaki, M., Takahashi, S., Takasawa, K., Komatsu, M., Kaneko, S., Sese, J., & Hamamoto, R. (2020) · Biomolecules · doi:10.3390/biom10040524 · Cited by 67
Self-citationFaster R-CNN for Robust Pedestrian Detection Using Semantic Segmentation Network
Liu, T., & Stathaki, T. (2018) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2018.00064 · Cited by 65
Efficacy of smartphone applications in high-risk pigmented lesions
Ngoo, A., Finnane, A., McMeniman, E., Tan, J., Janda, M., & Soyer, H. P. (2018) · Australasian Journal of Dermatology · doi:10.1111/ajd.12599 · Cited by 55
Assessing the effectiveness of artificial intelligence methods for melanoma: A retrospective review
Cui, X., Wei, R., Gong, L., Qi, R., Zhao, Z., Chen, H., Song, K., Abdulrahman, A. A., Wang, Y., Chen, J. Z. S., et al. (2019) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2019.06.042 · Cited by 52
Buechi, R., Faes, L., Bachmann, L. M., Thiel, M. A., Bodmer, N. S., Schmid, M. K., Job, O., & Lienhard, K. R. (2017) · BMJ Open · doi:10.1136/bmjopen-2017-018280 · Cited by 50
Transductive Learning for Multi-Label Protein Subchloroplast Localization Prediction
Wan, S., Mak, M., & Kung, S. (2016) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2016.2527657 · Cited by 46
ChainerCV: a Library for Deep Learning in Computer Vision
Niitani, Y., Ogawa, T., Saito, S., & Saito, M. (2017) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3123266.3129395 · Cited by 42
Kuok, C., Horng, M., Liao, Y., Chow, N., & Sun, Y. (2019) · Microscopy Research and Technique · doi:10.1002/jemt.23217 · Cited by 41
Faster R-CNN approach for detection and quantification of DNA damage in comet assay images
Rosati, R., Romeo, L., Silvestri, S., Marcheggiani, F., Tiano, L., & Frontoni, E. (2020) · Comput. Biol. Medicine · doi:10.1016/j.compbiomed.2020.103912 · Cited by 41
Economic Evaluation of Systemic Treatments for Advanced Melanoma: A Systematic Review
Gorry, C., McCullagh, L., & Barry, M. G. (2019) · Value in Health · doi:10.1016/j.jval.2019.07.003 · Cited by 40
Dermoscopy in differential diagnosis of inflammatory dermatoses and mycosis fungoides
Bilgiç, S., Çiçek, D., & Demir, B. (2020) · International Journal of Dermatology · doi:10.1111/ijd.14925 · Cited by 30
Melanoma detection in British Columbia, Canada
Tyler, I. V., Rivers, J. K., Shoveller, J., & Blum, A. (2004) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2004.04.031 · Cited by 27
Fujisawa, Y., Yoshikawa, S., Minagawa, A., Takenouchi, T., Yokota, K., Uchi, H., Noma, N., Nakamura, Y., Asai, J., Kato, J., et al. (2019) · Journal of Dermatological Science · doi:10.1016/j.jdermsci.2019.04.003 · Cited by 26
Singh, N., & Gupta, S. K. (2018) · Skin Research and Technology · doi:10.1111/srt.12622 · Cited by 23
ChainerCV: a Library for Deep Learning in Computer VisionPreprint
Niitani, Y., Ogawa, T., Saito, S., & Saito, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.08169 · Cited by 18
Interactive segmentation in multimodal brain imagery using a Bayesian transductive learning approach
Lee, N., Caban, J. J., Ebadollahi, S., & Laine, A. F. (2009) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.811675 · Cited by 14
Optimized Convolutional Neural Network-Based Object Recognition for Humanoid Robot
Ming, X., Nanfeng, X., Mengjun, Z., et al. (2020) · Journal of Robotics and Automation · doi:10.36959/673/363 · Cited by 4
Cited by
Daneshjou, R., Smith, M. P., Sun, M. D., Rotemberg, V., & Zou, J. (2021) · JAMA Dermatology · doi:10.1001/jamadermatol.2021.3129 · Cited by 403
Takahashi, S., Sakaguchi, Y., Kouno, N., Takasawa, K., Ishizu, K., Akagi, Y., Aoyama, R., Teraya, N., Bolatkan, A., Shinkai, N., et al. (2024) · Journal of Medical Systems · doi:10.1007/s10916-024-02105-8 · Cited by 343
Self-citationAnalysis of the ISIC image datasets: Usage, benchmarks and recommendations
Cassidy, B., Kendrick, C., Brodzicki, A., Jaworek-Korjakowska, J., & Yap, M. H. (2022) · Medical Image Analysis · doi:10.1016/j.media.2021.102305 · Cited by 307
Haggenmüller, S., Maron, R. C., Hekler, A., Utikal, J. S., Barata, C., Barnhill, R. L., Beltraminelli, H., Berking, C., Betz-Stablein, B., Blum, A., et al. (2021) · European Journal of Cancer · doi:10.1016/j.ejca.2021.06.049 · Cited by 267
Hamamoto, R., Suvarna, K., Yamada, M., Kobayashi, K., Shinkai, N., Miyake, M., Takahashi, M., Jinnai, S., Shimoyama, R., Sakai, A., et al. (2020) · Cancers · doi:10.3390/cancers12123532 · Cited by 207
Self-citation
Metadata
- Authors
- Jinnai, S., Yamazaki, N., Hirano, Y., Sugawara, Y., Ohe, Y., & Hamamoto, R.
- Venue
- Biomolecules
- Publisher
- MDPI AG
- Published
- 2020-07-29
- Volume
- 10
- Issue
- 8
- Pages
- 1123
- ISSN
- 2218-273X (ISSN-L)
- OpenAlex
- W3045827876
- Cited by
- 266
- References
- 45
- FWCI
- 10.83
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.