The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
An application of cascaded 3D fully convolutional networks for medical image segmentation
Open accessAbstract
Recent advances in 3D fully convolutional networks (FCN) have made it feasible to produce dense voxel-wise predictions of volumetric images. In this work, we show that a multi-class 3D FCN trained on manually labeled CT scans of several anatomical structures (ranging from the large organs to thin vessels) can achieve competitive segmentation results, while avoiding the need for handcrafting features or training class-specific models. To this end, we propose a two-stage, coarse-to-fine approach that will first use a 3D FCN to roughly define a candidate region, which will then be used as input to a second 3D FCN. This reduces the number of voxels the second FCN has to classify to ∼10% and allows it to focus on more detailed segmentation of the organs and vessels. We utilize training and validation sets consisting of 331 clinical CT images and test our models on a completely unseen data collection acquired at a different hospital that includes 150 CT scans, targeting three anatomical organs (liver, spleen, and pancreas). In challenging organs such as the pancreas, our cascaded approach improves the mean Dice score from 68.5 to 82.2%, achieving the highest reported average score on this dataset. We compare with a 2D FCN method on a separate dataset of 240 CT scans with 18 classes and achieve a significantly higher performance in small organs and vessels. Furthermore, we explore fine-tuning our models to different datasets. Our experiments illustrate the promise and robustness of current 3D FCN based semantic segmentation of medical images, achieving state-of-the-art results.1.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
Robust Real-Time Face Detection
Viola, P., & Jones, M. J. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000013087.49260.fb · Cited by 14,097
V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation
Milletari, F., Navab, N., & Ahmadi, S.-A. (2016) · 2016 Fourth International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2016.79 · Cited by 11,931 · cited 4×
“…Roth et al. (2016b); Zhou et al. (2016b); Christ et al. (2016); Zhou et al. (2016a), 2D convolutions on orthogonal (2.5D) cross-sections (Roth et al., 2015; Prasoon et al., 2013), and 3D convolutional layers (Milletari et al., 2016; Chen et al., 2016; Dou et al., 2017; Kamnitsas et al., 2017).”
BackgroundMethodInfluentialCaffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation
Çiçek, Ö., Abdulkadir, A., Lienkamp, S. S., Brox, T., & Ronneberger, O. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46723-8_49 · Cited by 7,945
Shin, H.-C., Roth, H. R., Gao, M., Lu, L., Xu, Z., Nogues, I., Yao, J., Mollura, D., & Summers, R. M. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2528162 · Cited by 5,759
Self-citationThe Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository
Clark, K., Vendt, B., Smith, K., Freymann, J., Kirby, J., Koppel, P., Moore, S., Phillips, S., Maffitt, D., Pringle, M., et al. (2013) · Journal of Digital Imaging · doi:10.1007/s10278-013-9622-7 · Cited by 4,599
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1408.5093 · Cited by 3,752
Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation
Kamnitsas, K., Ledig, C., Newcombe, V. F. J., Simpson, J. P., Kane, A. D., Menon, D. K., Rueckert, D., & Glocker, B. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.10.004 · Cited by 3,498 · cited 1×
“, 2013), and 3D convolutional layers (Milletari et al., 2016; Chen et al., 2016; Dou et al., 2017; Kamnitsas et al., 2017).”
Fully Convolutional Networks for Semantic Segmentation
Long, J., Shelhamer, E., & Darrell, T. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.4038 · Cited by 2,489
DeepOrgan: Multi-level Deep Convolutional Networks for Automated Pancreas Segmentation
Roth, H. R., Lu, L., Farag, A., Shin, H.-C., Liu, J., Turkbey, E. B., & Summers, R. M. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-24553-9_68 · Cited by 784
Self-citationOktay, O., Ferrante, E., Kamnitsas, K., Heinrich, M., Bai, W., Caballero, J., Cook, S. A., de Marvao, A., Dawes, T., O'Regan, D. P., et al. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2743464 · Cited by 751 · cited 1×
“Furthermore, additional anatomical constraints could be included in order to guarantee topologically correct segmentation results (BenTaieb and Hamarneh, 2016; Oktay et al., 2017).”
BackgroundProceedings of the 22nd ACM international conference on Multimedia
(2014) · doi:10.1145/2647868 · Cited by 725
Multi-atlas segmentation of biomedical images: A survey
Iglesias, J. E., & Sabuncu, M. R. (2015) · Medical Image Analysis · doi:10.1016/j.media.2015.06.012 · Cited by 667
Christ, P. F., Elshaer, M. E. A., Ettlinger, F., Tatavarty, S., Bickel, M., Bilic, P., Rempfler, M., Armbruster, M., Hofmann, F., D’Anastasi, M., et al. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46723-8_48 · Cited by 625
3D deeply supervised network for automated segmentation of volumetric medical images
Dou, Q., Yu, L., Chen, H., Jin, Y., Yang, X., Qin, J., & Heng, P.-A. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.05.001 · Cited by 613
Deep Feature Learning for Knee Cartilage Segmentation Using a Triplanar Convolutional Neural Network
Prasoon, A., Petersen, K., Igel, C., Lauze, F., Dam, E., & Nielsen, M. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40763-5_31 · Cited by 582
Rohlfing, T., Brandt, R., Menzel, R., & Maurer, C. R. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.11.010 · Cited by 573
Li, W., Wang, G., Fidon, L., Ourselin, S., Cardoso, M. J., & Vercauteren, T. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-59050-9_28 · Cited by 336
Roth, H. R., Lu, L., Lay, N., Harrison, A. P., Farag, A., Sohn, A., & Summers, R. M. (2018) · Medical Image Analysis · doi:10.1016/j.media.2018.01.006 · Cited by 325
Self-citationA Fixed-Point Model for Pancreas Segmentation in Abdominal CT Scans
Zhou, Y., Xie, L., Shen, W., Wang, Y., Fishman, E. K., & Yuille, A. L. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66182-7_79 · Cited by 275
Automated Abdominal Multi-Organ Segmentation With Subject-Specific Atlas Generation
Wolz, R., Chu, C., Misawa, K., Fujiwara, M., Mori, K., & Rueckert, D. (2013) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2013.2265805 · Cited by 273
Self-citationHu, P., Wu, F., Peng, J., Bao, Y., Chen, F., & Kong, D. (2017) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-016-1501-5 · Cited by 194
Zhou, X., Takayama, R., Wang, S., Hara, T., & Fujita, H. (2017) · Medical Physics · doi:10.1002/mp.12480 · Cited by 173
Self-citationTopology Aware Fully Convolutional Networks for Histology Gland Segmentation
BenTaieb, A., & Hamarneh, G. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46723-8_53 · Cited by 163
Jimenez-del-Toro, O., Muller, H., Krenn, M., Gruenberg, K., Taha, A. A., Winterstein, M., Eggel, I., Foncubierta-Rodriguez, A., Goksel, O., Jakab, A., et al. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2578680 · Cited by 162
DeepOrgan: Multi-level Deep Convolutional Networks for Automated Pancreas SegmentationPreprint
Roth, H. R., Lü, L., Farag, A. A., Shin, H.-C., Liu, J., Turkbey, E. B., & Summers, R. M. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.06448 · Cited by 158
Self-citationOkada, T., Linguraru, M. G., Hori, M., Summers, R. M., Tomiyama, N., & Sato, Y. (2015) · Medical Image Analysis · doi:10.1016/j.media.2015.06.009 · Cited by 155
VoxResNet: Deep Voxelwise Residual Networks for Volumetric Brain SegmentationPreprint
Chen, H., Dou, Q., Yu, L., & Heng, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1608.05895 · Cited by 153
Iterative Instance Segmentation
Li, K., Hariharan, B., & Malik, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.398 · Cited by 152
Discriminative dictionary learning for abdominal multi-organ segmentation
Tong, T., Wolz, R., Wang, Z., Gao, Q., Misawa, K., Fujiwara, M., Mori, K., Hajnal, J. V., & Rueckert, D. (2015) · Medical Image Analysis · doi:10.1016/j.media.2015.04.015 · Cited by 150
Self-citationSpatial Aggregation of Holistically-Nested Networks for Automated Pancreas Segmentation
Roth, H. R., Lü, L., Farag, A. A., Sohn, A., & Summers, R. M. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46723-8_52 · Cited by 144
Self-citationZhou, X., Ito, T., Takayama, R., Wang, S., Hara, T., & Fujita, H. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46976-8_12 · Cited by 101
Self-citationGeodesic Patch-Based Segmentation
Wang, Z., Bhatia, K. K., Glocker, B., de Marvao, A., Dawes, T. J. W., Misawa, K., Mori, K., & Rueckert, D. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10404-1_83 · Cited by 60
Self-citationGibson, E., Giganti, F., Hu, Y., Bonmati, E., Bandula, S., Gurusamy, K. S., Davidson, B. R., Pereira, S. P., Clarkson, M. J., & Barratt, D. C. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-66182-7_83 · Cited by 60
Automatic multi-resolution shape modeling of multi-organ structures
Cerrolaza, J. J., Reyes, M., Summers, R. M., Ballester, M. Á. G., & Linguraru, M. G. (2015) · Medical Image Analysis · doi:10.1016/j.media.2015.04.003 · Cited by 50
Multi-atlas Segmentation with Robust Label Transfer and Label Fusion
Wang, H., Pouch, A. M., Takabe, M., Jackson, B. M., Gorman, J., Gorman, R. C., & Yushkevich, P. A. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-38868-2_46 · Cited by 43
Pancreas Segmentation in Abdominal CT Scan: A Coarse-to-Fine Approach.Preprint
Zhou, Y., Xie, L., Shen, W., Fishman, E. K., & Yuille, A. (2016) · arXiv (Cornell University) · Cited by 27
Cited by
Deep Learning Techniques for Medical Image Segmentation: Achievements and Challenges
Hesamian, M. H., Jia, W., He, X., & Kennedy, P. (2019) · Journal of Digital Imaging · doi:10.1007/s10278-019-00227-x · Cited by 1,631
Zhou, S. K., Greenspan, H., Davatzikos, C., Duncan, J. S., Van Ginneken, B., Madabhushi, A., Prince, J. L., Rueckert, D., & Summers, R. M. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3054390 · Cited by 1,118
Automatic Multi-Organ Segmentation on Abdominal CT With Dense V-Networks
Gibson, E., Giganti, F., Hu, Y., Bonmati, E., Bandula, S., Gurusamy, K., Davidson, B., Pereira, S. P., Clarkson, M. J., & Barratt, D. C. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2806309 · Cited by 697
AbdomenCT-1K: Is Abdominal Organ Segmentation a Solved Problem?
Ma, J., Zhang, Y., Gu, S., Zhu, C., Ge, C., Zhang, Y., An, X., Wang, C., Wang, Q., Liu, X., et al. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3100536 · Cited by 426
Cardenas, C. E., Yang, J., Anderson, B. M., Court, L. E., & Brock, K. B. (2019) · Seminars in Radiation Oncology · doi:10.1016/j.semradonc.2019.02.001 · Cited by 407
Metadata
- Authors
- Roth, H. R., Oda, H., Zhou, X., Shimizu, N., Yang, Y., Hayashi, Y., Oda, M., Fujiwara, M., Misawa, K., & Mori, K.
- Venue
- Computerized Medical Imaging and Graphics
- Publisher
- Elsevier BV
- Published
- 2018-06
- Volume
- 66
- Pages
- 90-99
- ISSN
- 0730-4862 (ISSN-L)
- 0895-6111
- OpenAlex
- W2792124446
- Cited by
- 322
- References
- 43
- FWCI
- 19.69
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.