The DOI matches its Crossref record; 43 of the 44 references it cites were found in a registry or an index.
Deep learning and radiomics: the utility of Google TensorFlow™ Inception in classifying clear cell renal cell carcinoma and oncocytoma on multiphasic CT
Abstract
Purpose Currently, all solid enhancing renal masses without microscopic fat are considered malignant until proven otherwise and there is substantial overlap in the imaging findings of benign and malignant renal masses, particularly between clear cell RCC (ccRCC) and benign oncocytoma (ONC). Radiomics has attracted increased attention for its utility in pre-operative work-up on routine clinical images. Radiomics based approaches have converted medical images into mineable data and identified prognostic imaging signatures that machine learning algorithms can use to construct predictive models by learning the decision boundaries of the underlying data distribution. The TensorFlow™ framework from Google is a state-of-the-art open-source software library that can be used for training deep learning neural networks for performing machine learning tasks. The purpose of this study was to investigate the diagnostic value and feasibility of a deep learning-based renal lesion classifier using open-source Google TensorFlow™ Inception in differentiating ccRCC from ONC on routine four-phase MDCT in patients with pathologically confirmed renal masses.Methods With institutional review board approval for this 1996 Health Insurance Portability and Accountability Act compliant retrospective study and a waiver of informed consent, we queried our institution's pathology, clinical, and radiology databases for histologically proven cases of ccRCC and ONC obtained between January 2000 and January 2016 scanned with a an intravenous contrast-enhanced four-phase renal mass protocol (unenhanced (UN), corticomedullary (CM), nephrographic (NP), and excretory (EX) phases). To extract features to be used for the machine learning model, the entire renal mass was contoured in the axial plane in each of the four phases, resulting in a 3D volume of interest (VOI) representative of the entire renal mass. We investigated thirteen different approaches to convert the acquired VOI data into a set of images that adequately represented each tumor which was used to train the final layer of the neural network model. Training was performed over 4000 iterations. In each iteration, 90% of the data were designated as training data and the remaining 10% served as validation data and a leave-one-out cross-validation scheme was implemented. Accuracy, sensitivity, specificity, positive (PPV) and negative predictive (NPV) values, and CIs were calculated for the classification of the thirteen processing modes.Results We analyzed 179 consecutive patients with 179 lesions (128 ccRCC and 51 ONC). The ccRCC cohort had a mean size of 3.8 cm (range 0.8-14.6 cm) and the ONC cohort had a mean lesion size of 3.9 cm (range 1.0-13.1 cm). The highest specificity and PPV (52.9% and 80.3%, respectively) were achieved in the EX phase when we analyzed the single mid-slice of the tumor in the axial, coronal and sagittal plane, and when we increased the number of mid-slices of the tumor to three, with an accuracy of 75.4%, which also increased the sensitivity to 88.3% and the PPV to 79.6%. Using the entire tumor volume also showed that classification performance was best in the EX phase with an accuracy of 74.4%, a sensitivity of 85.8% and a PPV of 80.1%. When the entire tumor volume, plus mid-slices from all phases and all planes presented as tiled images, were submitted to the final layer of the neural network we achieved a PPV of 82.5%.Conclusions The best classification result was obtained in the EX phase among the thirteen classification methods tested. Our proof of concept study is the first step towards understanding the utility of machine learning in the differentiation of ccRCC from ONC on routine CT images. We hope this could lead to future investigation into the development of a multivariate machine learning model which may augment our ability to accurately predict renal lesion histology on imaging.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Inception/GoogLeNet: Multi-scale convolutional filters for extracting features at different resolutions [62].”
From Artificial Intelligence in Dermatopathology: An Update and Review of the Current Literature (2026) · cites this paper as [62]
Citations
Cites
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
Radiomics: Images Are More than Pictures, They Are Data
Gillies, R. J., Kinahan, P. E., & Hricak, H. (2016) · Radiology · doi:10.1148/radiol.2015151169 · Cited by 8,421
Intratumor Heterogeneity and Branched Evolution Revealed by Multiregion Sequencing
Gerlinger, M., Rowan, A. J., Horswell, S., Larkin, J., Endesfelder, D., Gronroos, E., Martinez, P., Matthews, N., Stewart, A., Tarpey, P., et al. (2012) · New England Journal of Medicine · doi:10.1056/nejmoa1113205 · Cited by 7,774
Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach
Aerts, H. J. W. L., Velazquez, E. R., Leijenaar, R. T. H., Parmar, C., Grossmann, P., Carvalho, S., Bussink, J., Monshouwer, R., Haibe-Kains, B., Rietveld, D., et al. (2014) · Nature Communications · doi:10.1038/ncomms5006 · Cited by 5,132
AUC: A misleading measure of the performance of predictive distribution models
Lobo, J. M., Jiménez‐Valverde, A., & Real, R. (2008) · Global Ecology and Biogeography · doi:10.1111/j.1466-8238.2007.00358.x · Cited by 3,499
The Global Burden of Cancer 2013
Fitzmaurice, C., Dicker, D., Pain, A. W., Hamavid, H., Moradi‐Lakeh, M., MacIntyre, M. F., Allen, C., Hansen, G. M., Woodbrook, R., Wolfe, C. D. A., et al. (2015) · JAMA Oncology · doi:10.1001/jamaoncol.2015.0735 · Cited by 2,763
Radiomics: the process and the challenges
Kumar, V., Gu, Y., Basu, S., Berglund, A., Eschrich, S. A., Schabath, M. B., Forster, K., Aerts, H. J. W. L., Dekker, A., Fenstermacher, D., et al. (2012) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2012.06.010 · Cited by 2,258
Applications and limitations of radiomics
Yip, S. S. F., & Aerts, H. J. W. L. (2016) · Physics in Medicine and Biology · doi:10.1088/0031-9155/61/13/r150 · Cited by 1,210
Solid Renal Tumors: An Analysis of Pathological Features Related to Tumor Size
Frank, I., Blute, M. L., Cheville, J. C., Lohse, C. M., Weaver, A. L., & Zincke, H. (2003) · The Journal of Urology · doi:10.1097/01.ju.0000095475.12515.5e · Cited by 1,082
Machine Learning methods for Quantitative Radiomic Biomarkers
Parmar, C., Großmann, P., Bussink, J., Lambin, P., & Aerts, H. J. W. L. (2015) · Scientific Reports · doi:10.1038/srep13087 · Cited by 1,062
Vallières, M., Freeman, C. R., Skamene, S., & Naqa, I. E. (2015) · Physics in Medicine and Biology · doi:10.1088/0031-9155/60/14/5471 · Cited by 892
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2014) · arXiv · doi:10.48550/arxiv.1409.0575 · Cited by 567
Characterization of PET/CT images using texture analysis: the past, the present… any future?
Hatt, M., Tixier, F., Pierce, L. A., Kinahan, P. E., Rest, C. C. L., & Visvikis, D. (2016) · European Journal of Nuclear Medicine and Molecular Imaging · doi:10.1007/s00259-016-3427-0 · Cited by 494
Kickingereder, P., Burth, S., Wick, A., GOETZ, M. A., Eidel, O., Schlemmer, H.-P., Maier-Hein, K. H., Wick, W., Bendszus, M., Radbruch, A., et al. (2016) · Radiology · doi:10.1148/radiol.2016160845 · Cited by 449
Management of the Incidental Renal Mass
Silverman, S. G., Israel, G. M., Herts, B. R., & Richie, J. P. (2008) · Radiology · doi:10.1148/radiol.2491070783 · Cited by 434
Solid Renal Cortical Tumors: Differentiation with CT
Zhang, J., Lefkowitz, R. A., Ishill, N. M., Wang, L., Moskowitz, C. S., Russo, P., Eisenberg, H. F., & Hricak, H. (2007) · Radiology · doi:10.1148/radiol.2442060927 · Cited by 315
Young, J. R., Margolis, D., Sauk, S., Pantuck, A. J., Sayre, J. W., & Raman, S. S. (2013) · Radiology · doi:10.1148/radiol.13112617 · Cited by 308
Self-citationKarlo, C. A., Paolo, P. L. D., Chaim, J. L., Hakimi, A. A., Ostrovnaya, I., Russo, P., Hricak, H., Motzer, R. J., Hsieh, J. J.-D., & Akın, O. (2013) · Radiology · doi:10.1148/radiol.13130663 · Cited by 270
CT Texture Analysis of Renal Masses
Raman, S. P., Chen, Y., Schroeder, J., Huang, P., & Fishman, E. K. (2014) · Academic Radiology · doi:10.1016/j.acra.2014.07.023 · Cited by 168
Self-citationTexture analysis as a radiomic marker for differentiating renal tumors
Yu, H., Scalera, J. E., Khalid, M., Touret, A.-S., Bloch, B., Li, B., Qureshi, M. M., Soto, J. A., & Anderson, S. W. (2017) · Abdominal Radiology · doi:10.1007/s00261-017-1144-1 · Cited by 165
Lubner, M. G., Stabo, N. J., Abel, E. J., del Río, A. M., & Pickhardt, P. J. (2016) · American Journal of Roentgenology · doi:10.2214/ajr.15.15451 · Cited by 144
Lee‐Felker, S., Felker, E. R., Tan, N., Margolis, D., Young, J. R., Sayre, J. W., & Raman, S. S. (2014) · American Journal of Roentgenology · doi:10.2214/ajr.14.12460 · Cited by 129
Self-citationPierorazio, P. M., Hyams, E. S., Tsai, S. D., Feng, Z., Trock, B. J., Mullins, J. K., Johnson, P. T., Fishman, E. K., & Allaf, M. E. (2013) · Urology · doi:10.1016/j.urology.2012.12.049 · Cited by 123
Shinagare, A. B., Vikram, R., Jaffe, C. C., Akın, O., Kirby, J., Huang, E. P., Freymann, J., Sainani, N. I., Sadow, C. A., Bathala, T. K., et al. (2015) · Abdominal Imaging · doi:10.1007/s00261-015-0386-z · Cited by 104
CT and MR imaging for solid renal mass characterization
Sasaguri, K., & Takahashi, N. (2017) · European Journal of Radiology · doi:10.1016/j.ejrad.2017.12.008 · Cited by 100
Bird, V. G., Kanagarajah, P., Morillo, G., Caruso, D. J., Ayyathurai, R., Leveillee, R. J., & Jordà, M. (2010) · World Journal of Urology · doi:10.1007/s00345-010-0586-7 · Cited by 90
Machine Learning Interface for Medical Image Analysis
Zhang, Y. C., & Kagen, A. C. (2016) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-016-9910-0 · Cited by 67
Yin, Q., Hung, S., Wang, L., Lin, W., Fielding, J. R., Rathmell, W. K., Khandani, A. H., Woods, M. E., Milowsky, M. I., Brooks, S. A., et al. (2017) · Scientific Reports · doi:10.1038/srep43356 · Cited by 67
Convolutional Neural Network Based Breast Cancer Risk Stratification Using a Mammographic Dataset
Ha, R. S., Chang, P., Karcich, J., Mutasa, S., Sant, E. P. V., Liu, M. Z., & Jambawalikar, S. (2018) · Academic Radiology · doi:10.1016/j.acra.2018.06.020 · Cited by 65
Jamshidi, N., Jonasch, E. W., Zapala, M. A., Korn, R. L., Aganović, L., Zhao, H., Sitaram, R. T., Tibshirani, R. J., Banerjee, S., Brooks, J. D., et al. (2015) · Radiology · doi:10.1148/radiol.2015150800 · Cited by 64
Yates, E. J., Yates, L. C., & Harvey, H. (2018) · Clinical Radiology · doi:10.1016/j.crad.2018.05.015 · Cited by 63
Advanced Renal Cell Carcinoma: Role of the Radiologist in the Era of Precision Medicine
Shinagare, A. B., Krajewski, K. M., Braschi‐Amirfarzan, M., & Ramaiya, N. H. (2017) · Radiology · doi:10.1148/radiol.2017160343 · Cited by 61
Lee, H. S., Hong, H., Jung, D. C., Park, S., & Kim, J. (2017) · Medical Physics · doi:10.1002/mp.12258 · Cited by 60
Jagga, Z., & Gupta, D. K. (2014) · BMC Proceedings · doi:10.1186/1753-6561-8-s6-s2 · Cited by 57
Imaging spectrum of renal oncocytomas: a pictorial review with pathologic correlation
Ishigami, K., Jones, A. R., Dahmoush, L., Leite, L. V., Pakalniskis, M. G., & Barloon, T. J. (2014) · Insights into Imaging · doi:10.1007/s13244-014-0373-x · Cited by 54
Varghese, B. A., Chen, F., Hwang, D., Cen, S., Desai, B., Gill, I. S., & Duddalwar, V. A. (2018) · American Journal of Roentgenology · doi:10.2214/ajr.18.19551 · Cited by 52
Song, J., Liu, Z., Zhong, W., Huang, Y., Ma, Z., Dong, D., Liang, C., & Tian, J. (2016) · Scientific Reports · doi:10.1038/srep38282 · Cited by 46
Liu, N., Huang, D., Cheng, X., Chong, Y., Wang, W., Gan, W., & Guo, H. (2017) · Urologic Oncology Seminars and Original Investigations · doi:10.1016/j.urolonc.2017.03.014 · Cited by 42
Coy, H., Young, J. R., Douek, M. L., Brown, M. S., Sayre, J. W., & Raman, S. S. (2017) · Abdominal Radiology · doi:10.1007/s00261-017-1095-6 · Cited by 38
Self-citationPaño, B., Macías, N., Salvador, R., Torres, F., Buñesch, L., Sebastià, C., & Nicolau, C. (2016) · American Journal of Roentgenology · doi:10.2214/ajr.15.14815 · Cited by 33
Yap, F. Y., Hwang, D., Cen, S., Varghese, B. A., Desai, B., Quinn, B. D., Gupta, M. N., Rajarubendra, N., Desai, M. M., Aron, M., et al. (2018) · Urology · doi:10.1016/j.urology.2017.12.018 · Cited by 33
Chen, F., Gulati, M., Hwang, D., Cen, S., Yap, F. Y., Ugwueze, C., Varghese, B. A., Desai, M. M., Aron, M., Gill, I. S., et al. (2016) · Abdominal Radiology · doi:10.1007/s00261-016-0891-8 · Cited by 24
Research works printed but not linked: 3
- Guyon I, Elisseeff A. An Introduction to Variable and Feature Selection. J. Mach. Learn. 2003; 3(3): 1157–1182
- Aerts HJ, Velazquez ER, Leijenaar RT, et al. Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat Commun 2014; 5: 4006. https://doi.org/10.1038/ncomms5006 · DOI · Paper page
- American Cancer Society (2018) Cancer facts & figures 2016. Atlanta: American Cancer Society
Cited by
Sorted by citations
Jiang, H., Diao, Z., Shi, T., Zhou, Y., Wang, F., Hu, W., Zhu, X., Luo, S., Tong, G., & Yao, Y. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.106726 · Cited by 244
Suarez-Ibarrola, R., Hein, S., Reis, G., Gratzke, C., & Miernik, A. J. (2019) · World Journal of Urology · doi:10.1007/s00345-019-03000-5 · Cited by 185
Deep Learning: A Review for the Radiation Oncologist
Boldrini, L., Bibault, J., Masciocchi, C., Shen, Y., & Bittner, M.-I. (2019) · Frontiers in Oncology · doi:10.3389/fonc.2019.00977 · Cited by 142
Artificial intelligence (AI) in urology-Current use and future directions: An iTRUE study
Shah, M., Naik, N., Somani, B. K., & Hameed, B. M. Z. (2020) · Urology Research and Practice · doi:10.5152/tud.2020.20117 · Cited by 137
Radiogenomics in Renal Cancer Management—Current Evidence and Future Prospects
Ferro, M., Musi, G., Marchioni, M., Maggi, M., Veccia, A., Giudice, F. D., Barone, B., Crocetto, F., Lasorsa, F. M., Antonelli, A., et al. (2023) · International Journal of Molecular Sciences · doi:10.3390/ijms24054615 · Cited by 96
Metadata
- Authors
- Coy, H., Hsieh, K., Wu, W., Nagarajan, M. B., Young, J. R., Douek, M. L., Brown, M. S., Scalzo, F., & Raman, S. S.
- Affiliations
- University of California, Los Angeles (US)
- City Of Hope National Medical Center (US)
- Corresponding author
- Coy, Heidi
- ORCID
- Venue
- Abdominal Radiology
- Published
- 2019-02-18
- Volume
- 44
- Issue
- 6
- Pages
- 2009-2020
- ISSN
- 2366-004X (ISSN-L)
- 2366-0058
- OpenAlex
- W2917694231
- Cited by
- 110
- References
- 44
- Citations by year
- 2026: 9 · 2025: 12 · 2024: 12 · 2023: 22 · 2022: 15 · 2021: 17 · 2020: 17 · 2019: 6
- FWCI
- 9.15
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Abdominal Radiology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Health Sciences › Medicine › Oncology › Renal cell carcinoma treatment
- Keywords
- clear cell renal cell carcinoma, renal oncocytoma, multiphase CT, radiomics, deep learning, InceptionV3, TensorFlow, computer-aided diagnosis, benign versus malignant renal tumors, corticomedullary phase, nephrographic phase, excretory phase
- MeSH terms
- Deep Learning, Adult, Aged, Aged, 80 and over, Algorithms, Carcinoma, Renal Cell, Contrast Media, Diagnosis, Differential, Female, Humans, Iohexol, Kidney Neoplasms, Male, Middle Aged, Radiographic Image Interpretation, Computer-Assisted, Retrospective Studies, Sensitivity and Specificity, Software, Adenoma, Oxyphilic, Multidetector Computed Tomography
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
