The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
AnatomyNet: Deep learning for fast and fully automated whole‐volume segmentation of head and neck anatomy
Open accessAbstract
Purpose: Radiation therapy (RT) is a common treatment option for head and neck (HaN) cancer. An important step involved in RT planning is the delineation of organs‐at‐risks (OARs) based on HaN computed tomography (CT). However, manually delineating OARs is time‐consuming as each slice of CT images needs to be individually examined and a typical CT consists of hundreds of slices. Automating OARs segmentation has the benefit of both reducing the time and improving the quality of RT planning. Existing anatomy autosegmentation algorithms use primarily atlas‐based methods, which require sophisticated atlas creation and cannot adequately account for anatomy variations among patients. In this work, we propose an end‐to‐end, atlas‐free three‐dimensional (3D) convolutional deep learning framework for fast and fully automated whole‐volume HaN anatomy segmentation. Methods: Our deep learning model, called AnatomyNet, segments OARs from head and neck CT images in an end‐to‐end fashion, receiving whole‐volume HaN CT images as input and generating masks of all OARs of interest in one shot. AnatomyNet is built upon the popular 3D U‐net architecture, but extends it in three important ways: (a) a new encoding scheme to allow autosegmentation on whole‐volume CT images instead of local patches or subsets of slices, (b) incorporating 3D squeeze‐and‐excitation residual blocks in encoding layers for better feature representation, and (c) a new loss function combining Dice scores and focal loss to facilitate the training of the neural model. These features are designed to address two main challenges in deep learning‐based HaN segmentation: (a) segmenting small anatomies (i.e., optic chiasm and optic nerves) occupying only a few slices, and (b) training with inconsistent data annotations with missing ground truth for some anatomical structures. Results: We collected 261 HaN CT images to train AnatomyNet and used MICCAI Head and Neck Auto Segmentation Challenge 2015 as a benchmark dataset to evaluate the performance of AnatomyNet. The objective is to segment nine anatomies: brain stem, chiasm, mandible, optic nerve left, optic nerve right, parotid gland left, parotid gland right, submandibular gland left, and submandibular gland right. Compared to previous state‐of‐the‐art results from the MICCAI 2015 competition, AnatomyNet increases Dice similarity coefficient by 3.3% on average. AnatomyNet takes about 0.12 s to fully segment a head and neck CT image of dimension 178 × 302 × 225, significantly faster than previous methods. In addition, the model is able to process whole‐volume CT images and delineate all OARs in one pass, requiring little pre‐ or postprocessing. Conclusion: Deep learning models offer a feasible solution to the problem of delineating OARs from CT images. We demonstrate that our proposed model can improve segmentation accuracy and simplify the autosegmentation pipeline. With this method, it is possible to delineate OARs of a head and neck CT within a fraction of a second.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.324 · Cited by 30,581
Global cancer statistics, 2012
Torre, L. A., Bray, F., Siegel, R. L., Ferlay, J., Lortet‐Tieulent, J., & Jemal, A. (2015) · CA: A Cancer Journal for Clinicians · doi:10.3322/caac.21262 · Cited by 26,850
Squeeze-and-Excitation Networks
Hu, J., Shen, L., Albanie, S., Sun, G., & Wu, E. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2913372 · Cited by 12,157
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2858826 · Cited by 9,556
The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository
Clark, K., Vendt, B., Smith, K., Freymann, J., Kirby, J., Koppel, P., Moore, S., Phillips, S., Maffitt, D., Pringle, M., et al. (2013) · Journal of Digital Imaging · doi:10.1007/s10278-013-9622-7 · Cited by 4,599
Generalised Dice Overlap as a Deep Learning Loss Function for Highly Unbalanced Segmentations
Sudre, C. H., Li, W., Vercauteren, T., Ourselin, S., & Jorge Cardoso, M. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-67558-9_28 · Cited by 2,829
Squeeze-and-Excitation Networks
Hu, J., Shen, L., Albanie, S., Sun, G. Z., & Wu, E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.01507 · Cited by 1,908
Tversky Loss Function for Image Segmentation Using 3D Fully Convolutional Deep Networks
Salehi, S. S. M., Erdogmus, D., & Gholipour, A. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-67389-9_44 · Cited by 1,086
Generalized Overlap Measures for Evaluation and Validation in Medical Image Analysis
Crum, W. R., Camara, O., & Hill, D. L. G. (2006) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2006.880587 · Cited by 776
Radiomics strategies for risk assessment of tumour failure in head-and-neck cancer
Vallières, M., Kay-Rivest, E., Perrin, L. J., Liem, X., Furstoss, C., Aerts, H. J. W. L., Khaouam, N., Nguyen-Tan, P. F., Wang, C.-S., Sultanem, K., et al. (2017) · Scientific Reports · doi:10.1038/s41598-017-10371-5 · Cited by 542
Segmentation of organs‐at‐risks in head and neck CT images using convolutional neural networks
Ibragimov, B., & Xing, L. (2017) · Medical Physics · doi:10.1002/mp.12045 · Cited by 502
DeepLung: Deep 3D Dual Path Nets for Automated Pulmonary Nodule Detection and Classification
Zhu, W., Liu, C., Fan, W., & Xie, X. (2018) · 2018 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2018.00079 · Cited by 449
Self-citationVision 20/20: Perspectives on automated image segmentation for radiotherapy
Sharp, G., Fritscher, K. D., Pekar, V., Peroni, M., Shusharina, N., Veeraraghavan, H., & Yang, J. (2014) · Medical Physics · doi:10.1118/1.4871620 · Cited by 375
Evaluation of segmentation methods on head and neck CT: Auto‐segmentation challenge 2015
Raudaschl, P. F., Zaffino, P., Sharp, G. C., Spadea, M. F., Chen, A., Dawant, B. M., Albrecht, T., Gass, T., Langguth, C., Lüthi, M., et al. (2017) · Medical Physics · doi:10.1002/mp.12197 · Cited by 259
Nikolov, S., Blackwell, S., Zverovitch, A., Mendes, R. L., Livne, M., Fauw, J. D., Patel, Y., Meyer, C., Askham, H., Romera‐Paredes, B., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.04430 · Cited by 235
Deep Multi-instance Networks with Sparse Label Assignment for Whole Mammogram Classification
Zhu, W., Lou, Q., Vang, Y. S., & Xie, X. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66179-7_69 · Cited by 214
Self-citationAtlas-Based Auto-segmentation of Head and Neck CT Images
Han, X., Hoogeman, M. S., Levendag, P. C., Hibbard, L. S., Teguh, D. N., Voet, P., Cowen, A. C., & Wolf, T. K. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-85990-1_52 · Cited by 195
Zhang, T., Chi, Y., Meldolesi, E., & Yan, D. (2007) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2007.01.038 · Cited by 177
Isambert, A., Dhermain, F. G., Bidault, F., Commowick, O., Bondiau, P., Malandain, G., & Lefkopoulos, D. (2008) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2007.11.030 · Cited by 161
Interleaved 3D‐ CNN s for joint segmentation of small‐volume structures in head and neck CT images
Ren, X., Xiang, L., Nie, D., Shao, Y., Zhang, H., Shen, D. G., & Wang, Q. (2018) · Medical Physics · doi:10.1002/mp.12837 · Cited by 149
Adversarial deep structured nets for mass segmentation from mammograms
Zhu, W., Xiang, X., Tran, T. D., Hager, G. D., & Xie, X. S. (2018) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2018.8363704 · Cited by 139
Self-citationQazi, A. A., Pekar, V., Kim, J., Xie, J., Breen, S. L., & Jaffray, D. A. (2011) · Medical Physics · doi:10.1118/1.3654160 · Cited by 124
Fritscher, K. D., Peroni, M., Zaffino, P., Spadea, M. F., Schubert, R., & Sharp, G. C. (2014) · Medical Physics · doi:10.1118/1.4871623 · Cited by 121
Voet, P. W. J., Dirkx, M. L. P., Teguh, D. N., Hoogeman, M. S., Levendag, P. C., & Heijmen, B. J. M. (2011) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2010.11.017 · Cited by 115
Fortunati, V., Verhaart, R. F., van der Lijn, F., Niessen, W. J., Veenland, J. F., Paulides, M. M., & van Walsum, T. (2013) · Medical Physics · doi:10.1118/1.4810971 · Cited by 104
Atlas-based delineation of lymph node levels in head and neck computed tomography images
Commowick, O., Grégoire, V., & Malandain, G. (2008) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2008.01.018 · Cited by 100
Deep Neural Networks for Fast Segmentation of 3D Medical Images
Fritscher, K. D., Raudaschl, P., Zaffino, P., Spadea, M. F., Sharp, G. C., & Schubert, R. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46723-8_19 · Cited by 99
A pre-clinical assessment of an atlas-based automatic segmentation tool for the head and neck
Sims, R., Isambert, A., Grégoire, V., et al. (2009) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2009.08.013 · Cited by 92
Duc, A. K. H., Eminowicz, G., Mendes, R. L., Wong, S., McClelland, J. R., Marc Modat, A., Cardoso, M. J., Mendelson, A., Veiga, C., Kadir, T., et al. (2015) · Medical Physics · doi:10.1118/1.4927567 · Cited by 73
Wang, Z., Wei, L., Wang, L., Gao, Y., Chen, W., & Shen, D. G. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2768621 · Cited by 66
Chen, A., Deeley, M. A., Niermann, K. J., et al. (2010) · Medical Physics · doi:10.1118/1.3515459 · Cited by 45
DeepEM: Deep 3D ConvNets with EM for Weakly Supervised Pulmonary Nodule Detection
Zhu, W., Vang, Y. S., Huang, Y., & Xie, X. S. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00934-2_90 · Cited by 42
Self-citationContour-Driven Atlas-Based Segmentation
Wachinger, C., Fritscher, K. D., Sharp, G. C., et al. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2442753 · Cited by 41
Automatic tissue segmentation of head and neck MR images for hyperthermia treatment planning
Fortunati, V., Verhaart, R. F., Niessen, W. J., Veenland, J. F., Paulides, M. M., & van Walsum, T. (2015) · Physics in Medicine and Biology · doi:10.1088/0031-9155/60/16/6547 · Cited by 27
Verhaart, R. F., Fortunati, V., Verduijn, G. M., et al. (2014) · Medical Physics · doi:10.1118/1.4901270 · Cited by 26
Tam, C., Tian, S., Beitler, J. J., et al. (2018) · SPIE Medical Imaging: Biomedical Applications in Molecular, Structural, and Functional Imaging · doi:10.1117/12.2292556 · Cited by 26
Comparison of different deep learning approaches for parotid gland segmentation from CT images
Gerken, A., Schwier, M., Morgaś, T., Klein, J., Hahn, H. K., Gass, T., & Haas, B. (2018) · SPIE Medical Imaging: Computer-Aided Diagnosis · doi:10.1117/12.2292962 · Cited by 19
Leavens, C., Vik, T., Schulz, H., et al. (2008) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.769710 · Cited by 13
Cited by
A Deep Learning System to Screen Novel Coronavirus Disease 2019 Pneumonia
Xu, X., Jiang, X., Ma, C., Du, P., Li, X., Lv, S., Yu, L., Ni, Q., Chen, Y., Su, J., et al. (2020) · Engineering · doi:10.1016/j.eng.2020.04.010 · Cited by 1,209
Yeung, M., Sala, E., Schönlieb, C.-B., & Rundo, L. (2022) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2021.102026 · Cited by 733
CPFNet: Context Pyramid Fusion Network for Medical Image Segmentation
Feng, S., Zhao, H., Shi, F., Cheng, X., Wang, M., Ma, Y., Xiang, D., Zhu, W., & Chen, X. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.2983721 · Cited by 687
Self-citationLoss odyssey in medical image segmentation
Ma, J., Chen, J., Ng, M., Huang, R., Li, Y., Li, C., Yang, X., & Martel, A. L. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102035 · Cited by 662
Artificial Intelligence and COVID-19: Deep Learning Approaches for Diagnosis and Treatment
Jamshidi, M., Lalbakhsh, A., Talla, J., Peroutka, Z., Hadjilooei, F., Lalbakhsh, P., Jamshidi, M., Spada, L. L., Mirmozafari, M., Dehghani, M., et al. (2020) · IEEE Access · doi:10.1109/access.2020.3001973 · Cited by 551
Metadata
- Authors
- Zhu, W., Huang, Y., Zeng, L., Chen, X., Liu, Y., Qian, Z., Du, N., Fan, W., & Xie, X.
- Venue
- Medical Physics
- Publisher
- Wiley
- Published
- 2018-12-17
- Volume
- 46
- Issue
- 2
- Pages
- 576-589
- ISSN
- 0094-2405 (ISSN-L)
- 2473-4209
- OpenAlex
- W2900237898
- Cited by
- 510
- References
- 41
- FWCI
- 27.29
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.