The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Deep‐learning‐based, computer‐aided classifier developed with a small dataset of clinical images surpasses board‐certified dermatologists in skin tumour diagnosis
Abstract
BACKGROUND: Application of deep-learning technology to skin cancer classification can potentially improve the sensitivity and specificity of skin cancer screening, but the number of training images required for such a system is thought to be extremely large. OBJECTIVES: To determine whether deep-learning technology could be used to develop an efficient skin cancer classification system with a relatively small dataset of clinical images. METHODS: A deep convolutional neural network (DCNN) was trained using a dataset of 4867 clinical images obtained from 1842 patients diagnosed with skin tumours at the University of Tsukuba Hospital from 2003 to 2016. The images consisted of 14 diagnoses, including both malignant and benign conditions. Its performance was tested against 13 board-certified dermatologists and nine dermatology trainees. RESULTS: The overall classification accuracy of the trained DCNN was 76·5%. The DCNN achieved 96·3% sensitivity (correctly classified malignant as malignant) and 89·5% specificity (correctly classified benign as benign). Although the accuracy of malignant or benign classification by the board-certified dermatologists was statistically higher than that of the dermatology trainees (85·3% ± 3·7% and 74·4% ± 6·8%, P < 0·01), the DCNN achieved even greater accuracy, as high as 92·4% ± 2·1% (P < 0·001). CONCLUSIONS: We have developed an efficient skin tumour classifier using a DCNN trained on a relatively small dataset. The DCNN classified images of skin tumours more accurately than board-certified dermatologists. Collectively, the current system may have capabilities for screening purposes in general medical practice, particularly because it requires only a single clinical image for classification.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
(2008) · Journal of Machine Learning Research · Cited by 33,051
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
A systematic review of worldwide incidence of nonmelanoma skin cancer
Lomas, A., Leonardi‐Bee, J., & Bath‐Hextall, F. (2012) · British Journal of Dermatology · doi:10.1111/j.1365-2133.2012.10830.x · Cited by 1,937
Incidence Estimate of Nonmelanoma Skin Cancer (Keratinocyte Carcinomas) in the US Population, 2012
Rogers, H. W., Weinstock, M. A., Feldman, S. R., & Coldiron, B. M. (2015) · JAMA Dermatology · doi:10.1001/jamadermatol.2015.1187 · Cited by 1,815
The Epidemiology of Skin Cancer
GLOSTER, H. M., & BRODLAND, D. G. (1996) · Dermatologic Surgery · doi:10.1111/j.1524-4725.1996.tb00312.x · Cited by 1,259
Incidence Estimate of Nonmelanoma Skin Cancer in the United States, 2006
Rogers, H. W., Weinstock, M. A., Harris, A. R., Hinckley, M. R., Feldman, S. R., Fleischer, A. B., & Coldiron, B. M. (2010) · Archives of Dermatology · doi:10.1001/archdermatol.2010.19 · Cited by 1,185
The epidemiology of skin cancer
Diepgen, T. L., & Mahler, V. (2002) · British Journal of Dermatology · doi:10.1046/j.1365-2133.146.s61.2.x · Cited by 1,100
Optical coherence tomography in dermatology: a review
Welzel, J. (2001) · Skin Research and Technology · doi:10.1034/j.1600-0846.2001.007001001.x · Cited by 621
Incidence of Basal Cell and Squamous Cell Carcinomas in a Population Younger Than 40 Years
Christenson, L. J. (2005) · JAMA · doi:10.1001/jama.294.6.681 · Cited by 577
Diagnostic Inaccuracy of Smartphone Applications for Melanoma Detection
Wolf, J. A., Moreau, J. F., Akilov, O., Patton, T., English, J. C., Ho, J., & Ferris, L. K. (2013) · JAMA Dermatology · doi:10.1001/jamadermatol.2013.2382 · Cited by 393
Computer Aided Diagnostic Support System for Skin Cancer: A Review of Techniques and Algorithms
Masood, A., & Ali Al-Jumaily, A. (2013) · International Journal of Biomedical Imaging · doi:10.1155/2013/323268 · Cited by 347
Dermoscopic Image Segmentation via Multistage Fully Convolutional Networks
Bi, L., Kim, J., Ahn, E., Kumar, A., Fulham, M., & Feng, D. (2017) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2017.2712771 · Cited by 338
Marchetti, M. A., Codella, N. C. F., Dusza, S. W., Gutman, D. A., Helba, B., Kalloo, A., Mishra, N., Carrera, C., Celebi, M. E., DeFazio, J. L., et al. (2018) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2017.08.016 · Cited by 330
Non-Melanoma Skin Cancer Incidence and Impact of Skin Cancer Screening on Incidence
Eisemann, N., Waldmann, A., Geller, A. C., Weinstock, M. A., Volkmer, B., Greinert, R., Breitbart, E. W., & Katalinic, A. (2014) · Journal of Investigative Dermatology · doi:10.1038/jid.2013.304 · Cited by 299
Incidence and prevalence of non‐melanoma skin cancer in Australia: A systematic review
Perera, E., Gnaneswaran, N., Staines, C., Win, A. K., & Sinclair, R. (2015) · Australasian Journal of Dermatology · doi:10.1111/ajd.12282 · Cited by 210
Malvehy, J., Hauschild, A., Curiel‐Lewandrowski, C., Mohr, P., Hofmann‐Wellenhof, R., Motley, R., Berking, C., Grossman, D., Paoli, J., Loquai, C., et al. (2014) · British Journal of Dermatology · doi:10.1111/bjd.13121 · Cited by 210
Premaladha, J., & Ravichandran, K. S. (2016) · Journal of Medical Systems · doi:10.1007/s10916-016-0460-2 · Cited by 208
Brunssen, A., Waldmann, A., Eisemann, N., & Katalinic, A. (2017) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2016.07.045 · Cited by 191
A Novel Approach to Segment Skin Lesions in Dermoscopic Images Based on a Deformable Model
Ma, Z., & Tavares, J. M. R. S. (2016) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2015.2390032 · Cited by 189
A Mobile Automated Skin Lesion Classification System
Ramlakhan, K., & Shang, Y. (2011) · Proceedings - International Conference on Tools with Artificial Intelligence, TAI · doi:10.1109/ictai.2011.29 · Cited by 124
Computer-aided classification of melanocytic lesions using dermoscopic images
Ferris, L. K., Harkes, J., Gilbert, B., Winger, D. G., Golubets, K., Akilov, O. E., & Satyanarayanan, M. (2015) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2015.07.028 · Cited by 104
Maier, T., Kulichova, D., Schotten, K., Astrid, R., Ruzicka, T., Berking, C., & Udrea, A. (2015) · Journal of the European Academy of Dermatology and Venereology · doi:10.1111/jdv.12648 · Cited by 103
Chang, W.-Y., Huang, A., Yang, C.-Y., Lee, C., Chen, Y.-C., Wu, T.-Y., & Chen, G. (2013) · PLoS ONE · doi:10.1371/journal.pone.0076212 · Cited by 95
Worldwide Increasing Incidences of Cutaneous Malignant Melanoma
Godar, D. E. (2011) · Journal of Skin Cancer · doi:10.1155/2011/858425 · Cited by 94
Dermatology in general practice
Julian, J. (1999) · British Journal of Dermatology · doi:10.1046/j.1365-2133.1999.03048.x · Cited by 88
Reflectance Confocal Microscopy—State-of-Art and Research Overview
Hofmann‐Wellenhof, R., Wurm, E. M. T., Ahlgrimm‐Siess, V., Richtig, E., Koller, S. H., Smolle, J., & Gerger, A. (2009) · Seminars in Cutaneous Medicine and Surgery · doi:10.1016/j.sder.2009.06.004 · Cited by 80
Skin diseases in family medicine: prevalence and health care use.
Verhoeven, E. W. M., Kraaimaat, F. W., van Weel, C., van de Kerkhof, P. C. M., Duller, P., van der Valk, P. G. M., van den Hoogen, H. J. M., Bor, J. H. J., Schers, H. J., & Evers, A. W. M. (2008) · The Annals of Family Medicine · doi:10.1370/afm.861 · Cited by 80
Implementation of the 7-point checklist for melanoma detection on smart handheld devices
Wadhawan, T., Situ, N., Rui, H., Lancaster, K., Yuan, X., & Zouridakis, G. (2011) · 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society · doi:10.1109/iembs.2011.6090866 · Cited by 72
Gutkowicz–Krusin, D., Elbaum, M., Jacobs, A., et al. (2000) · Melanoma Research · doi:10.1097/00008390-200012000-00008 · Cited by 70
Melanoma recognition framework based on expert definition of ABCD for dermoscopic images
Abbas, Q., Celebi, M. E., Fondón, I., & Ahmad, W. (2012) · Skin Research and Technology · doi:10.1111/j.1600-0846.2012.00614.x · Cited by 70
Carrara, M., Bono, A. V., Bartoli, C., Colombo, A., Lualdi, M., Moglia, D., Santoro, N., Tolomio, E., Tomatis, S., Tragni, G., et al. (2007) · Physics in Medicine and Biology · doi:10.1088/0031-9155/52/9/018 · Cited by 69
Learning to play Go from scratch
Singh, S. P., Okun, A., & Jackson, A. (2017) · Nature · doi:10.1038/550336a · Cited by 66
Computer-Aided Diagnosis of Micro-Malignant Melanoma Lesions Applying Support Vector Machines
Jaworek-Korjakowska, J. (2016) · BioMed Research International · doi:10.1155/2016/4381972 · Cited by 58
Efficacy of smartphone applications in high-risk pigmented lesions
Ngoo, A., Finnane, A., McMeniman, E., Tan, J., Janda, M., & Soyer, H. P. (2018) · Australasian Journal of Dermatology · doi:10.1111/ajd.12599 · Cited by 55
Computer-aided diagnosis of melanocytic lesions.
Stanganelli, I., Brucale, A., Calori, L., Gori, R., Lovato, A., Magi, S., Kopf, B., Bacchilega, R., Rapisarda, V., Testori, A., et al. (2005) · PubMed · Cited by 52
Buechi, R., Faes, L., Bachmann, L. M., Thiel, M. A., Bodmer, N. S., Schmid, M. K., Job, O., & Lienhard, K. R. (2017) · BMJ Open · doi:10.1136/bmjopen-2017-018280 · Cited by 50
On the Comparison of Diagnosis and Management of Melanoma Between Dermatologists and MelaFind
Cukras, A. R. (2013) · JAMA Dermatology · doi:10.1001/jamadermatol.2013.3405 · Cited by 35
Precision Diagnosis Of Melanoma And Other Skin Lesions From Digital Images.
Bhattacharya, A., Young, A. T., Wong, A., Stalling, S., Wei, M. L., & Hadley, D. (2017) · PubMed Central · Cited by 33
Skin image illumination modeling and chromophore identification for melanoma diagnosis
Liu, Z., & Zerubia, J. B. (2015) · Physics in Medicine and Biology · doi:10.1088/0031-9155/60/9/3415 · Cited by 28
Christensen, J. H., Soerensen, M. B. T., Zhong, L., et al. (2009) · Skin Research and Technology · doi:10.1111/j.1600-0846.2009.00408.x · Cited by 24
Møllersen, K., Kirchesch, H., Zortea, M., Schopf, T. R., Hindberg, K., & Godtliebsen, F. (2015) · BioMed Research International · doi:10.1155/2015/579282 · Cited by 21
Mobile Medical Applications for Melanoma Risk Assessment: False Assurance or Valuable Tool?
Chadwick, X., Loescher, L. J., Janda, M., & Soyer, H. P. (2014) · 2014 47th Hawaii International Conference on System Sciences · doi:10.1109/hicss.2014.337 · Cited by 17
Introduction and Historical Bibliography
BURNS, D. A., & Cox, N. H. (2010) · doi:10.1002/9781444317633.ch1 · Cited by 10
Cited by
Liu, X., Faes, L., Kale, A. U., Wagner, S. K., Fu, D. J., Bruynseels, A., Mahendiran, T., Moraes, G., Shamdas, M., Kern, C., et al. (2019) · The Lancet Digital Health · doi:10.1016/s2589-7500(19)30123-2 · Cited by 1,883
Goyal, M., Knackstedt, T., Yan, S., & Hassanpour, S. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.104065 · Cited by 428
Daneshjou, R., Smith, M. P., Sun, M. D., Rotemberg, V., & Zou, J. (2021) · JAMA Dermatology · doi:10.1001/jamadermatol.2021.3129 · Cited by 403
Detection of Skin Cancer Based on Skin Lesion Images Using Deep Learning
Gouda, W., Sama, N. U., Al-Waakid, G., Humayun, M., & Jhanjhi, N. Z. (2022) · Healthcare · doi:10.3390/healthcare10071183 · Cited by 393
What is AI? Applications of artificial intelligence to dermatology
Du‐Harpur, X., Watt, F. M., Luscombe, N. M., & Lynch, M. D. (2020) · British Journal of Dermatology · doi:10.1111/bjd.18880 · Cited by 355
Metadata
- Authors
- Fujisawa, Y., Otomo, Y., Ogata, Y., Nakamura, Y., Fujita, R., Ishitsuka, Y., Watanabe, R., Okiyama, N., Ohara, K., & Fujimoto, M.
- Venue
- British Journal of Dermatology
- Publisher
- Oxford University Press (OUP)
- Published
- 2018-09-19
- Volume
- 180
- Issue
- 2
- Pages
- 373-381
- ISSN
- 0007-0963 (ISSN-L)
- 1365-2133
- OpenAlex
- W2891858760
- Cited by
- 317
- References
- 47
- FWCI
- 12.55
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.