Automated Muscle Segmentation from Clinical CT Using Bayesian U-Net for Personalized Musculoskeletal Modeling
Open accessThe DOI matches its Crossref record; 43 of the 45 references it cites were found in a registry or an index.
Abstract
We propose a method for automatic segmentation of individual muscles from a clinical CT. The method uses Bayesian convolutional neural networks with the U-Net architecture, using Monte Carlo dropout that infers an uncertainty metric in addition to the segmentation label. We evaluated the performance of the proposed method using two data sets: 20 fully annotated CTs of the hip and thigh regions and 18 partially annotated CTs that are publicly available from The Cancer Imaging Archive (TCIA) database. The experiments showed a Dice coefficient (DC) of 0.891±0.016 (mean±std) and an average symmetric surface distance (ASD) of 0.994±0.230 mm over 19 muscles in the set of 20 CTs. These results were statistically significant improvements compared to the state-of-the-art hierarchical multi-atlas method which resulted in 0.845 ± 0.031 DC and 1.556 ± 0.444 mm ASD. We evaluated validity of the uncertainty metric in the multi-class organ segmentation problem and demonstrated a correlation between the pixels with high uncertainty and the segmentation failure. One application of the uncertainty metric in active-learning is demonstrated, and the proposed query pixel selection method considerably reduced the manual annotation cost for expanding the training data set. The proposed method allows an accurate patient-specific analysis of individual muscle shapes in a clinical routine. This would open up various applications including personalization of biomechanical simulation and quantitative evaluation of muscle atrophy.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Xue al. [685] | et | 2019 | BNN and U-Net | Classification | Gigapixel phase im- ages | 1 | MC dropout and ensembles”
From A review of uncertainty quantification in deep learning: Techniques, applications and challenges (2021) · cites this paper as [685]
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · cited 4×
“the weights in the same way as in [9], and then trained the networks using adaptive moment estimation (Adam) [16] for 1×105 iterations at the learning rate of 0.”
MethodInfluentialFully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
(2014) · Cited by 33,419
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741 · cited 1×
“We initialized the weights in the same way as in [9], and then trained the networks using adaptive moment estimation (Adam) [16] for 1 × 10 5 iterations at the learning rate of 0.0001.”
MethodInfluentialMeasures of the Amount of Ecologic Association Between Species
Dice, L. R. (1945) · Ecology · doi:10.2307/1932409 · Cited by 11,874 · cited 1×
“We used the Dice coefficient (DC) [5] and the average symmetric surface distance (ASD) [31] as the error metrics.”
MethodDropout as a bayesian approximation: Representing model uncertainty in deep learning
Gal, Y., & Ghahramani, Z. (2015) · arXiv · doi:10.48550/arxiv.1506.02142 · Cited by 6,471 · cited 6×
“Below, we briefly summarize the theoretical background described in [7], formulate the specific metric that we employed in this paper, and propose a new structure-wise”
BackgroundMethodInfluential(2009) · Minds at UW (University of Wisconsin) · Cited by 4,791
What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?
Kendall, A., & Gal, Y. (2017) · arXiv · doi:10.48550/arxiv.1703.04977 · Cited by 3,088 · cited 1×
“It measures the degree of difference of each test sample from the training data set, originated from the deficiency of training data, namely epistemic uncertainty [15].”
BackgroundSeth, A., Hicks, J. L., Uchida, T. K., Habib, A., Dembia, C. L., Dunne, J. J., Ong, C. F., DeMers, M. S., Rajagopal, A., Millard, M., et al. (2018) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006223 · Cited by 1,322 · cited 1×
“The computational simulation of human motion using musculoskeletal modeling has been performed in a number of studies to investigate musculo-tendon forces and joint contact forces, which cannot be easily achieved by physical measurements [25], [27], [29].”
BackgroundFull-Body Musculoskeletal Model for Muscle-Driven Simulation of Human Gait
Rajagopal, A., Dembia, C. L., DeMers, M. S., Delp, D. D., Hicks, J. L., & Delp, S. L. (2016) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2016.2586891 · Cited by 1,053
Research works printed but not linked: 2
- hiasa, 2018, Surgical tools segmentation in laparoscopic images using convolutional neural networks with uncertainty estimation and semi-supervised learning, Proc Int Conf CARS, 14
- hiasa, 2018, Cross-modality image synthesis from unpaired data using CycleGAN, Proc Int Workshop SASHIMI, 31
Cited by
A review of uncertainty quantification in deep learning: Techniques, applications and challenges
Abdar, M., Pourpanah, F., Hussain, S., Rezazadegan, D., Liu, L., Ghavamzadeh, M., Fieguth, P., Cao, X., Khosravi, A., Acharya, U. R., et al. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.05.008 · Cited by 3,111
U-Net and Its Variants for Medical Image Segmentation: A Review of Theory and Applications
Siddique, N., Paheding, S., Elkin, C. P., & Devabhaktuni, V. (2021) · IEEE Access · doi:10.1109/access.2021.3086020 · Cited by 1,960
Lambert, B., Forbes, F., Doyle, S., Dehaene, H., & Dojat, M. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102830 · Cited by 269
Modality specific U-Net variants for biomedical image segmentation: a survey
Punn, N. S., & Agarwal, S. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10152-1 · Cited by 246
“(2018) Improved U-Net CT - X X - BU Mini-residual connections within encoder-decoder phases Janssens et al. (2018) Two stage U-Net model CT - X X - EU 3D FCN LocalizationNet followed by SegmentationNet Kumar et al. (2018) U-SegNet MRI X - X - BU Integration of skip connections with SegNet Kermi et al. (2018) Residual…”
MethodInfluentialSeoni, S., Jahmunah, V., Salvi, M., Barua, P. D., Molinari, F., & Acharya, U. R. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107441 · Cited by 239
Metadata
- Authors
- Hiasa, Y., Otake, Y., Takao, M., Ogawa, T., Sugano, N., & Sato, Y.
- Affiliations
- Nara Institute of Science and Technology (JP)
- The University of Osaka (JP)
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2020-04
- Volume
- 39
- Issue
- 4
- Pages
- 1030-1040
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W2972629588
- Cited by
- 157
- References
- 45
- Citations by year
- 2026: 16 · 2025: 27 · 2024: 26 · 2023: 24 · 2022: 26 · 2021: 22 · 2020: 16
- FWCI
- 7.16
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Medical Imaging (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Ministry of Education, Culture, Sports, Science and Technology (19H01176, 26108004)
- Japan Society for the Promotion of Science (20407)
- AMED/ETH Strategic Japanese-Swiss Cooperative Program
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Physical Sciences › Engineering › Biomedical Engineering › Medical Imaging and Analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- muscle segmentation, Monte Carlo dropout, uncertainty estimation, musculoskeletal modeling, active learning (machine learning), muscle atrophy, biomechanical simulation, multi-atlas segmentation
- MeSH terms
- Deep Learning, Bayes Theorem, Female, Hip, Humans, Image Processing, Computer-Assisted, Male, Thigh, Tomography, X-Ray Computed, Neural Networks, Computer, Muscle, Skeletal, Arthroplasty, Replacement, Hip, Patient-Specific Modeling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Automated Muscle Segmentation from Clinical CT Using Bayesian U-Net for Personalized Musculoskeletal Modeling. https://app.cochat.ai/papers/10.1109/tmi.2019.2940555
- The paper
- Hiasa, Y., Otake, Y., Takao, M., Ogawa, T., Sugano, N., & Sato, Y. (2020). Automated Muscle Segmentation from Clinical CT Using Bayesian U-Net for Personalized Musculoskeletal Modeling. IEEE Transactions on Medical Imaging. https://doi.org/10.1109/tmi.2019.2940555
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.