Cited by 428Medical Image Segmentation TechniquesAdvanced Neural Network ApplicationsDomain Adaptation and Few-Shot Learning

The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.

Confidence Calibration and Predictive Uncertainty Estimation for Deep Medical Image Segmentation

Open access

Mehrtash, Alireza, Wells, William M., Tempany, Clare M., Abolmaesumi, Purang, Kapur, Tina·2020·IEEE Transactions on Medical Imaging

DOI 10.1109/tmi.2020.3006437PMC PMC7704933

Open this paper in CoChat — free account

Abstract

Fully convolutional neural networks (FCNs), and in particular U-Nets, have achieved state-of-the-art results in semantic segmentation for numerous medical imaging applications. Moreover, batch normalization and Dice loss have been used successfully to stabilize and accelerate training. However, these networks are poorly calibrated i.e. they tend to produce overconfident predictions for both correct and erroneous classifications, making them unreliable and hard to interpret. In this paper, we study predictive uncertainty estimation in FCNs for medical image segmentation. We make the following contributions: 1) We systematically compare cross-entropy loss with Dice loss in terms of segmentation quality and uncertainty estimation of FCNs; 2) We propose model ensembling for confidence calibration of the FCNs trained with batch normalization and Dice loss; 3) We assess the ability of calibrated FCNs to predict segmentation quality of structures and detect out-of-distribution test examples. We conduct extensive experiments across three medical image segmentation applications of the brain, the heart, and the prostate to evaluate our contributions. The results of this study offer considerable insight into the predictive uncertainty estimation and out-of-distribution detection in medical image segmentation and provide practical recipes for confidence calibration. Moreover, we consistently demonstrate that model ensembling improves confidence calibration.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1109/tmi.2020.3006437

Cites

56 of 56 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Untitled work
(2014) · Cited by 33,419
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
A survey on deep learning in medical image analysis
Litjens, G., Kooi, T., Bejnordi, B. E., Setio, A. A. A., Ciompi, F., Ghafoorian, M., van der Laak, J. A. W. M., van Ginneken, B., & Sánchez, C. I. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.07.005 · Cited by 15,332
V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation
Milletari, F., Navab, N., & Ahmadi, S.-A. (2016) · 2016 Fourth International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2016.79 · Cited by 11,931
Fully convolutional networks for semantic segmentation
Shelhamer, E., Long, J., & Darrell, T. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2572683 · Cited by 11,898
Ensemble methods in machine learning
Dietterich, T. G. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45014-9_1 · Cited by 8,408

Show all 55 references

Research works printed but not linked: 10

2018, Tgs Salt Identification Challenge
2018, Grand Challenge on MR Brain Segmentation at MICCAI 2018
10.5555/3045118.3045167 · DOI
10.21236/ADA459827 · DOI
10.5555/3045390.3045502 · DOI
Liao, 2019, On modelling label uncertainty in deep neural networks: Automatic estimation of intra-observer variability in 2D echocardiography quality assessment, arXiv:1911.00674 · arXiv
10.1109/CVPR.2018.00464 · DOI
10.1201/9781420002690 · DOI
10.5555/3295222.3295309 · DOI
10.1007/978-3-030-32251-9_73 · DOI

Sorted by citations

A review of uncertainty quantification in deep learning: Techniques, applications and challenges
Abdar, M., Pourpanah, F., Hussain, S., Rezazadegan, D., Liu, L., Ghavamzadeh, M., Fieguth, P., Cao, X., Khosravi, A., Acharya, U. R., et al. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.05.008 · Cited by 3,111
U-Net and Its Variants for Medical Image Segmentation: A Review of Theory and Applications
Siddique, N. A., Paheding, S., Elkin, C. P., & Devabhaktuni, V. (2021) · IEEE Access · doi:10.1109/access.2021.3086020 · Cited by 2,185
A survey of uncertainty in deep neural networks
Gawlikowski, J., Tassi, C. R. N., Ali, M., Lee, J., Humt, M., Feng, J., Kruspe, A., Triebel, R., Jung, P., Roscher, R., et al. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10562-9 · Cited by 1,670
Recent advances and clinical applications of deep learning in medical image analysis
Chen, X., Wang, X., Zhang, K., Fung, K.-M. A., Thai, T., Moore, K. N., Mannel, R. S., Liu, H., Zheng, B., & Qiu, Y. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102444 · Cited by 1,180
TransMorph: Transformer for unsupervised medical image registration
Chen, J., Frey, E. C., He, Y., Segars, W. P., Li, Y., & Du, Y. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102615 · Cited by 883
Overview of artificial intelligence-based applications in radiotherapy: Recommendations for implementation and quality assurance
Vandewinckele, L., Claessens, M., Dinkla, A. M., Brouwer, C. L., Crijns, W., Verellen, D., & van Elmpt, W. (2020) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2020.09.008 · Cited by 341
Seasonal Arctic sea ice forecasting with probabilistic deep learning
Andersson, T. R., Hosking, J. S., Pérez‐Ortiz, M., Paige, B., Elliott, A. J., Russell, C., Law, S., Jones, D. C., Wilkinson, J., Phillips, T., et al. (2021) · Nature Communications · doi:10.1038/s41467-021-25257-4 · Cited by 330
Trustworthy clinical AI solutions: A unified review of uncertainty quantification in Deep Learning models for medical image analysis
Lambert, B., Forbes, F., Doyle, S., Dehaene, H., & Michel Dojat, D. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102830 · Cited by 353
Application of uncertainty quantification to artificial intelligence in healthcare: A review of last decade (2013–2023)
Seoni, S., Jahmunah, V., Salvi, M., Barua, P. D., Molinari, F., & Acharya, U. R. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107441 · Cited by 239
CKD-TransBTS: Clinical Knowledge-Driven Hybrid Transformer With Modality-Correlated Cross-Attention for Brain Tumor Segmentation
Lin, J.-W., Lin, J., Lu, C., Chen, H., Lin, H., Zhao, B.-C., Shi, Z.-W., Qiu, B., Pan, X., Xu, Z.-Y., et al. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3250474 · Cited by 200
Local contrastive loss with pseudo-label based self-training for semi-supervised medical image segmentation
Chaitanya, K., Erdil, E., Karani, N., & Konukoğlu, E. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102792 · Cited by 234
A review of uncertainty estimation and its application in medical imaging
Zou, K., Chen, Z., Yuan, X., Shen, X., Wang, M., & Fu, H. (2023) · Meta-Radiology · doi:10.1016/j.metrad.2023.100003 · Cited by 199
Entropy Maximization and Meta Classification for Out-of-Distribution Detection in Semantic Segmentation
Chan, R., Rottmann, M., & Gottschalk, H. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00508 · Cited by 147
A comprehensive survey on deep active learning in medical image analysis
Wang, H., Jin, Q., Li, S., Liu, S., Wang, M., & Song, Z. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103201 · Cited by 157
A review of uncertainty quantification in medical image analysis: Probabilistic and non-probabilistic methods
Huang, L., Ruan, S., Xing, Y., & Feng, M. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103223 · Cited by 152
Medical Image Segmentation With Limited Supervision: A Review of Deep Network Models
Peng, J., & Wang, Y. (2021) · IEEE Access · doi:10.1109/access.2021.3062380 · Cited by 115
TBraTS: Trusted Brain Tumor Segmentation
Zou, K., Yuan, X., Shen, X., Wang, M., & Fu, H. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-16452-1_48 · Cited by 89
An Effective Deep Neural Network for Lung Lesions Segmentation From COVID-19 CT Images
Chen, C., Zhou, K., Zha, M., Qu, X., Guo, X., Chen, H., Wang, Z., & Xiao, R. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3059023 · Cited by 87
Local Temperature Scaling for Probability Calibration
Ding, Z., Han, X., Liu, P., & Niethammer, M. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00681 · Cited by 88
SegmentMeIfYouCan: A Benchmark for Anomaly SegmentationPreprint
Chan, R., Lis, K., Uhlemeyer, S., Blum, H., Honari, S., Siegwart, R., Fua, P., Salzmann, M., & Rottmann, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.14812 · Cited by 124
Calibrating the Dice Loss to Handle Neural Network Overconfidence for Biomedical Image Segmentation
Yeung, M., Rundo, L., Nan, Y., Sala, E., Schönlieb, C., & Yang, G. (2022) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-022-00735-3 · Cited by 93
SoftSeg: Advantages of soft versus binary training for image segmentation
Gros, C., Lemay, A., & Cohen‐Adad, J. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102038 · Cited by 92
Deep learning prediction models based on EHR trajectories: A systematic review
Amirahmadi, A., Ohlsson, M., & Etminani, K. (2023) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2023.104430 · Cited by 99
MOOD 2020: A Public Benchmark for Out-of-Distribution Detection and Localization on Medical Images
Zimmerer, D., Full, P. M., Isensee, F., Jäger, P. F., Adler, T. J., Petersen, J., Koehler, G., Roß, T., Reinke, A., Kascenas, A., et al. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3170077 · Cited by 68
Estimating Uncertainty in Neural Networks for Cardiac MRI Segmentation: A Benchmark Study
NG, M. M., Guo, F., Biswas, L., Petersen, S. E., Piechnik, S. K., Neubauer, S., & Wright, G. A. (2022) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2022.3232730 · Cited by 73
Region-based evidential deep learning to quantify uncertainty and improve robustness of brain tumor segmentation
Li, H., Yang, N., Ser, J. D., & Yang, G. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-08016-4 · Cited by 72
End-to-end automated body composition analyses with integrated quality control for opportunistic assessment of sarcopenia in CT
Nowak, S., Theis, M., Wichtmann, B. D., Faron, A., Froelich, M. F., Tollens, F., Geißler, H. L., Block, W., Luetkens, J. A., Attenberger, U. I., et al. (2021) · European Radiology · doi:10.1007/s00330-021-08313-x · Cited by 68
Improving Calibration and Out-of-Distribution Detection in Deep Models for Medical Image Segmentation
Karimi, D., & Gholipour, A. (2022) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2022.3159510 · Cited by 79
On the usability of synthetic data for improving the robustness of deep learning-based segmentation of cardiac magnetic resonance images
Khalil, Y. A., Amirrajab, S., Cristian Lorenz, A., Weese, J., Pluim, J. P. W., & Breeuwer, M. M. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102688 · Cited by 68
Assessing the generalizability of artificial intelligence in radiology: a systematic review of performance across different clinical settings
Suleman, M. U., Mursaleen, M., Khalil, U., Saboor, A., Bilal, M., Khan, S. A., Subhani, M. A., Hussnain, M. A., Tabassum, S. N., & Tahir, M. R. (2025) · Annals of Medicine and Surgery · doi:10.1097/ms9.0000000000004166 · Cited by 75
Distance-based detection of out-of-distribution silent failures for Covid-19 lung lesion segmentation
González, C., Gotkowski, K., Fuchs, M., Bucher, A. M., Dadras, A. A., Fischbach, R., Kaltenborn, I., & Mukhopadhyay, A. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102596 · Cited by 59
Diabetic foot ulcers segmentation challenge report: Benchmark and analysis
Yap, M. H., Cassidy, B., Byra, M., Liao, T.-Y., Yi, H., Galdrán, A., Chen, Y.-H., Brüngel, R., Koitka, S., Friedrich, C. M., et al. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103153 · Cited by 61
Evidence-based uncertainty-aware semi-supervised medical image segmentation
Chen, Y., Yang, Z., Shen, C., Wang, Z., Zhang, Z., Qin, Y., Wei, X., Lu, J., Liu, Y., & Zhang, Y. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108004 · Cited by 52
Application of belief functions to medical image segmentation: A review
Huang, L., Ruan, S., & Denœux, T. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.11.008 · Cited by 51
The Application of Radiomics and AI to Molecular Imaging for Prostate Cancer
Tapper, W., Carneiro, G., Mikropoulos, C., Thomas, S. A., Evans, P., & Boussios, S. (2024) · Journal of Personalized Medicine · doi:10.3390/jpm14030287 · Cited by 45
Quantitative Comparison of Monte-Carlo Dropout Uncertainty Measures for Multi-class Segmentation
Camarasa, R., Bos, D., Hendrikse, J., Nederkoorn, P. J., Kooi, M. E., van der Lugt, A., & de Bruijne, M. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-60365-6_4 · Cited by 45
D-LEMA: Deep Learning Ensembles from Multiple Annotations - Application to Skin Lesion Segmentation
Mirikharaji, Z., Abhishek, K., Izadi, S., & Hamarneh, G. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00203 · Cited by 46
Translation Consistent Semi-Supervised Segmentation for 3D Medical Images
Liu, Y., Tian, Y., Wang, C., Chen, Y., Liu, F., Belagiannis, V., & Carneiro, G. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3468896 · Cited by 44
Confidence-Based Out-of-Distribution Detection: A Comparative Study and Analysis
Berger, C., Paschali, M., Glocker, B., & Kamnitsas, K. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87735-4_12 · Cited by 42
Understanding Calibration of Deep Neural Networks for Medical Image Classification
Sambyal, A., Niyaz, U., Krishnan, N. C., & Bathula, D. R. (2023) · Comput. Methods Programs Biomed. · doi:10.1016/j.cmpb.2023.107816 · Cited by 45
Variance‐aware attention U‐Net for multi‐organ segmentation
Lin, H., Li, Z., Yang, Z., & Wang, Y. (2021) · Medical Physics · doi:10.1002/mp.15322 · Cited by 40
Seamless Lightning Nowcasting with Recurrent-Convolutional Deep Learning
Leinonen, J., Hamann, U., & Germann, U. (2022) · Artificial Intelligence for the Earth Systems · doi:10.1175/aies-d-22-0043.1 · Cited by 38
Uncertainty aware training to improve deep learning model calibration for classification of cardiac MR images
Dawood, T., Chen, C., Sidhu, B. S., Ruijsink, B., Gould, J., Porter, B., Elliott, M. K., Mehta, V. S., Rinaldi, C. A., Anton, E. P., et al. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102861 · Cited by 45
MWG-UNet++: Hybrid Transformer U-Net Model for Brain Tumor Segmentation in MRI Scans
Lyu, Y., & Tian, X. (2025) · Bioengineering · doi:10.3390/bioengineering12020140 · Cited by 38
Propagating Uncertainty Across Cascaded Medical Imaging Tasks for Improved Deep Learning Inference
Mehta, R., Christinck, T., Nair, T., Bussy, A., Premasiri, S., Costantino, M., Chakravarthy, M. M., Arnold, D. L., Gal, Y., & Arbel, T. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2021.3114097 · Cited by 40
A Radiology-focused Review of Predictive Uncertainty for AI Interpretability in Computer-assisted Segmentation
McCrindle, B. W., Zukotynski, K., Doyle, T. E., & Noseworthy, M. D. (2021) · Radiology Artificial Intelligence · doi:10.1148/ryai.2021210031 · Cited by 42
On the Optimal Combination of Cross-Entropy and Soft Dice Losses for Lesion Segmentation with Out-of-Distribution Robustness
Galdrán, A., Carneiro, G., & Ballester, M. Á. G. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-26354-5_4 · Cited by 36
Measurement Guidance in Diffusion Models: Insight from Medical Image Synthesis
Luo, Y., Yang, Q., Fan, Y., Qi, H., & Xia, M. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3399098 · Cited by 38
A Survey of Computer Vision Technologies in Urban and Controlled-environment Agriculture
Luo, J., Li, B., & Leung, C. (2023) · ACM Computing Surveys · doi:10.1145/3626186 · Cited by 38
Uncertainty-driven trustworthy defect detection for high-resolution powder bed images in selective laser melting
Zhao, Z., Liu, W., Ren, J., Wang, C., He, Y., Zhang, X., & Chen, X. (2023) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2023.11.006 · Cited by 34
Boundary-wise loss for medical image segmentation based on fuzzy rough sets
Qiao, L., Chen, X., Chen, C., & Garibaldi, J. M. (2024) · Information Sciences · doi:10.1016/j.ins.2024.120183 · Cited by 34
Ensemble of deep convolutional neural networks is more accurate and reliable than board-certified ophthalmologists at detecting multiple diseases in retinal fundus photographs
Pandey, P. U., Ballios, B. G., Christakis, P. G., Kaplan, A., Mathew, D. J., Tone, S. O., Wan, M. J., Micieli, J. A., & Wong, J. C. Y. (2023) · British Journal of Ophthalmology · doi:10.1136/bjo-2022-322183 · Cited by 36
Artificial intelligence uncertainty quantification in radiotherapy applications − A scoping review
Wahid, K. A., Kaffey, Z. Y., Farris, D. P., Humbert‐Vidan, L., Moreno, A. C., Rasmussen, M. E., Ren, J., Naser, M. A., Netherton, T., Korreman, S., et al. (2024) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2024.110542 · Cited by 42
A Novel Quality Control Algorithm for Medical Image Segmentation Based on Fuzzy Uncertainty
Qiao, L., Chen, X., Chen, C., & Garibaldi, J. M. (2022) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2022.3228332 · Cited by 36
Calibrating segmentation networks with margin-based label smoothing
Murugesan, B., Liu, B., Galdrán, A., Ayed, I. B., & Dolz, J. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102826 · Cited by 33
Efficient Bayesian Uncertainty Estimation for nnU-Net
Zhao, Y., Yang, C., Schweidtmann, A. M., & Tao, Q. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-16452-1_51 · Cited by 31
Accurate Prediction Using Triangular Type-2 Fuzzy Linear Regression: Simplifying Complex T2F Calculations
Zare, A., Shoeibi, A., Bajestani, N. S., Moridian, P., Alizadehsani, R., Hallaji, M., & Khosravi, A. (2022) · IEEE Systems Man and Cybernetics Magazine · doi:10.1109/msmc.2022.3148569 · Cited by 30
Detecting When Pre-trained nnU-Net Models Fail Silently for Covid-19 Lung Lesion Segmentation
González, C., Gotkowski, K., Bucher, A. M., Fischbach, R., Kaltenborn, I., & Mukhopadhyay, A. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87234-2_29 · Cited by 30
ADNet++: A few-shot learning framework for multi-class medical image volume segmentation with uncertainty-guided feature refinement
Hansen, S., Gautam, S., Salahuddin, S. A., Kampffmeyer, M., & Jenssen, R. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102870 · Cited by 29
Uncertainty Co-Estimator for Improving Semi-Supervised Medical Image Segmentation
Zeng, X. J., Xiong, S., Xu, J., Du, G., & Rong, Y. (2025) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2025.3570310 · Cited by 29
Calibrating Uncertainty for Semi-Supervised Crowd Counting
Chen, L., Hu, X., Abousamra, S., & Chen, C. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01534 · Cited by 28
Effective Semi-Supervised Medical Image Segmentation With Probabilistic Representations and Prototype Learning
Yuan, Y., Wang, X., Yang, X., & Heng, P. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3484166 · Cited by 29
Improving cross-domain generalizability of medical image segmentation using uncertainty and shape-aware continual test-time domain adaptation
Zhu, J., Bolsterlee, B., Song, Y., & Meijering, E. H. W. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103422 · Cited by 32
Explainable vision transformer for automatic visual sleep staging on multimodal PSG signals
Lee, H., Choi, Y. R., Lee, H. K., Jeong, J., Hong, J., Shin, H., & Kim, H. (2025) · npj Digital Medicine · doi:10.1038/s41746-024-01378-0 · Cited by 27
Automated Ensemble for Deep Learning Inference on Edge Computing Platforms
Bai, Y., Chen, L., Abdel-Mottaleb, M. S., & Xu, J. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3102945 · Cited by 27
On Calibrating Semantic Segmentation Models: Analyses and An Algorithm
Wang, D., Gong, B., & Wang, L. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02265 · Cited by 32
Semi-Supervised CT Lesion Segmentation Using Uncertainty-Based Data Pairing and SwapMix
Qiao, P., Li, H., Song, G., Han, H., Gao, Z., Tian, Y., Liang, Y., Li, X., Zhou, S. K., & Chen, J. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3232572 · Cited by 27
Neuroinfinity: A Lightweight Prompt-Driven Vision–Language Framework for Alzheimer’s Disease Stage Classification Using Magnetic Resonance Imaging
Kaushik, P., Kukreja, V., Jain, E., Ati, M., & Hariharan, S. (2025) · IEEE Access · doi:10.1109/access.2025.3630141 · Cited by 25
Post Training Uncertainty Calibration Of Deep Networks For Medical Image Segmentation
Rousseau, A.-J., Becker, T., Bertels, J., Blaschko, M. B., & Valkenborg, D. (2021) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi48211.2021.9434131 · Cited by 25
Mixture of calibrated networks for domain generalization in brain tumor segmentation
Hu, J., Gu, X., Wang, Z., & Gu, X. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110520 · Cited by 25
ACLS: Adaptive and Conditional Label Smoothing for Network Calibration
Park, H.-K., Noh, J., Oh, Y., Baek, D., & Ham, B. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00364 · Cited by 26
MECardNet: A novel multi-scale convolutional ensemble model with adaptive deep supervision for precise cardiac MRI segmentation
Aghapanah, H., Rasti, R., Tabesh, F., Pouraliakbar, H., Sanei, H., & Kermani, S. (2024) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2024.106919 · Cited by 26
A generalizable brain extraction net (BEN) for multimodal MRI data from rodents, nonhuman primates, and humans
Yu, Z., Han, X., Xu, W., Zhang, J., Marr, C., Shen, D. G., Peng, T., Zhang, X., & Feng, J. (2022) · eLife · doi:10.7554/elife.81217 · Cited by 24
Hybrid dual mean-teacher network with double-uncertainty guidance for semi-supervised segmentation of magnetic resonance images
Zhu, J., Bolsterlee, B., Chow, B. V. Y., Song, Y., & Meijering, E. H. W. (2024) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2024.102383 · Cited by 28
Detection and Retrieval of Out-of-Distribution Objects in Semantic Segmentation
Oberdiek, P., Rottmann, M., & Fink, G. A. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00172 · Cited by 25
Application of simultaneous uncertainty quantification and segmentation for oropharyngeal cancer use-case with Bayesian deep learning
Sahlsten, J., Jaskari, J., Wahid, K. A., Ahmed, S., Glerean, E., He, R., Kann, B. H., Mäkitie, A. A., Fuller, C. D., Naser, M. A., et al. (2024) · Communications Medicine · doi:10.1038/s43856-024-00528-5 · Cited by 21
Uncertainty-aware temporal self-learning (UATS): Semi-supervised learning for segmentation of prostate zones and beyond
Meyer, A., Ghosh, S., Schindele, D., Schostak, M., Stober, S., Hansen, C., & Rak, M. (2021) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2021.102073 · Cited by 21
Orthogonal Ensemble Networks for Biomedical Image Segmentation
Larrazabal, A. J., Mart'inez, C., Dolz, J., & Ferrante, E. (2021) · International Conference on Medical Image Computing and Computer-Assisted Intervention · doi:10.1007/978-3-030-87199-4_56 · Cited by 26
Comparative benchmarking of failure detection methods in medical image segmentation: Unveiling the role of confidence aggregation
Zenk, M., Zimmerer, D., Isensee, F., Traub, J., Norajitra, T., Jäger, P. F., & Maier-Hein, K. H. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103392 · Cited by 22
Uncertainty-Aware Medical Diagnostic Phrase Identification and Grounding
Zou, K., Bai, Y., Liu, B., Chen, Y., Chen, Z., Zhou, Y., Yuan, X., Wang, M., Shen, X., Cao, X., et al. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3596878 · Cited by 36
Medical image segmentation using scalable functional variational Bayesian neural networks with Gaussian processes
Xu, C. G., Zhao, Y., & Liu, C. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.05.055 · Cited by 20
Uncertainty Estimation for Heatmap-Based Landmark Localization
Schobs, L., Swift, A. J., & Lu, H. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3222730 · Cited by 20
TMS-Net: A segmentation network coupled with a run-time quality control method for robust cardiac image segmentation
Uslu, F., & Bharath, A. A. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.106422 · Cited by 20
Semi-supervised segmentation of coronary DSA using mixed networks and multi-strategies
Pu, Y., Zhang, Q., Qian, C., Zeng, Q., Li, N., Zhang, L., Zhou, S., & Zhao, G. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.106493 · Cited by 20
Uncertainty-guided transformer for brain tumor segmentation
Chen, Z., Peng, C., Guo, W., Xie, L., Wang, S., Zhuge, Q., Wen, C., & Feng, Y. (2023) · Medical & Biological Engineering & Computing · doi:10.1007/s11517-023-02899-8 · Cited by 20
Automatic uncertainty-based quality controlled T1 mapping and ECV analysis from native and post-contrast cardiac T1 mapping images using Bayesian vision transformer
Arega, T. W., Bricq, S., Legrand, F., Jacquier, A., Lalande, A., & Mériaudeau, F. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102773 · Cited by 23
Boosting knowledge diversity, accuracy, and stability via tri-enhanced distillation for domain continual medical image segmentation
Zhu, Z., Ma, X., Wang, W., Dong, S., Wang, K., Wu, L., Luo, G., Wang, G., & Li, S. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103112 · Cited by 20
VSR-Net: Vessel-Like Structure Rehabilitation Network With Graph Clustering
Ye, H., Zhang, X., Hu, Y., Fu, H., & Liu, J. (2025) · IEEE Transactions on Image Processing · doi:10.1109/tip.2025.3526061 · Cited by 19
Uncertainty-aware ensemble of foundation models differentiates glioblastoma from its mimics
Zhao, J., Lin, S.-Y., Attias, R., Mathews, L., Engel, C., Larghero, G., Vremenko, D., Kao, T., Lee, T.-H., Wang, Y.-H., et al. (2025) · Nature Communications · doi:10.1038/s41467-025-64249-6 · Cited by 21
Domain adaptation for segmentation of critical structures for prostate cancer therapy
Meyer, A., Mehrtash, A., Rak, M., Bashkanov, O., Langbein, B. J., Ziaei, A., Kibel, A. S., Tempany, C. M., Hansen, C., & Tokuda, J. (2021) · Scientific Reports · doi:10.1038/s41598-021-90294-4 · Cited by 18
Self-citation
Graph Node Based Interpretability Guided Sample Selection for Active Learning
Mahapatra, D., Poellinger, A., & Reyes, M. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3215017 · Cited by 18
Uncertainty estimation for deep learning-based pectoral muscle segmentation via Monte Carlo dropout
Klaneček, Ž., Wagner, T., Wang, Y., Cockmartin, L., Marshall, N., Schott, B., Deatsch, A. E., Studen, A., Hertl, K., Jarm, K., et al. (2023) · Physics in Medicine and Biology · doi:10.1088/1361-6560/acd221 · Cited by 20
Latent Transformer Models for out-of-distribution detection
Graham, M. S., Tudosiu, P.-D., Wright, P. K., Pinaya, W. H. L., Teikari, P., Patel, A. S., U-King-Im, J.-M., Mah, Y., Teo, J., Jäger, H. R., et al. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102967 · Cited by 22
Performance Drift in Machine Learning Models for Cardiac Surgery Risk Prediction: Retrospective Analysis
Dong, T., Sinha, S., Zhai, B., Fudulu, D. P., Chan, J., Narayan, P., Judge, A., Caputo, M., Dimagli, A., Benedetto, U., et al. (2024) · JMIRx Med · doi:10.2196/45973 · Cited by 27
EvidenceCap: Towards trustworthy medical image segmentation via evidential identity capPreprint
Zou, K., Yuan, X., Shen, X., Chen, Y., Wang, M., Goh, R. S. M., Liu, Y., & Fu, H. (2023) · Research Square · doi:10.21203/rs.3.rs-2558155/v1 · Cited by 18
Confidence Calibration for Object Detection and Segmentation
Küppers, F., Haselhoff, A., Kronenberger, J., & Schneider, J. (2022) · Springer eBooks · doi:10.1007/978-3-031-01233-4_8 · Cited by 19
Model Ensemble With Dropout for Uncertainty Estimation in Sea Ice Segmentation Using Sentinel-1 SAR
de Lima, R. P., & Karimzadeh, M. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3331276 · Cited by 17
Enhancing the reliability of deep learning-based head and neck tumour segmentation using uncertainty estimation with multi-modal images
Ren, J., Teuwen, J., Nijkamp, J. A., Rasmussen, M. E., Gouw, Z. A. R., Eriksen, J. G., Sonke, J., & Korreman, S. S. (2024) · Physics in Medicine and Biology · doi:10.1088/1361-6560/ad682d · Cited by 18
The Centerline-Cross Entropy Loss for Vessel-Like Structure Segmentation: Better Topology Consistency Without Sacrificing Accuracy
Acebes, C., Moustafa, A.-H., Cámara, Ó., & Galdrán, A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72111-3_67 · Cited by 17
Validation of musculoskeletal segmentation model with uncertainty estimation for bone and muscle assessment in hip-to-knee clinical CT images
Soufi, M., Otake, Y., Iwasa, M., Uemura, K., Hakotani, T., Hashimoto, M., Yamada, Y., Yamada, M., Yokoyama, Y., Jinzaki, M., et al. (2025) · Scientific Reports · doi:10.1038/s41598-024-83793-7 · Cited by 16

Authors: Mehrtash, A., Wells, W. M., Tempany, C. M., Abolmaesumi, P., & Kapur, T.
Affiliations: Brigham and Women's Hospital (US)
University of British Columbia (CA)
ORCID: Mehrtash, Alireza
Wells, William M.
Abolmaesumi, Purang
Kapur, Tina
Venue: IEEE Transactions on Medical Imaging
Publisher: Institute of Electrical and Electronics Engineers (IEEE)
Published: 2020-12
Volume: 39
Issue: 12
Pages: 3868-3878
ISSN: 0278-0062 (ISSN-L)
1558-254X
DOI: 10.1109/tmi.2020.3006437
PMC: PMC7704933
OpenAlex: W2991523350
Cited by: 428
References: 55
Citations by year: 2026: 91 · 2025: 92 · 2024: 71 · 2023: 71 · 2022: 56 · 2021: 41 · 2020: 6
FWCI: 16.91
Type: journal article
Language: en
Open access: green
www.ncbi.nlm.nih.gov
Licence: ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html (vor)
doi.org/10.15223/policy-029 (stm-asf)
doi.org/10.15223/policy-037 (stm-asf)
Locations: IEEE Transactions on Medical Imaging (publishedVersion)
PubMed (publishedVersion)
PubMed Central (acceptedVersion)
arXiv (Cornell University) (submittedVersion)
arXiv (Cornell University)
Funders: U.S. National Institutes of Health (P41EB015898)
Natural Sciences and Engineering Research Council (NSERC) of Canada
Canadian Institutes of Health Research
Topics: Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
Keywords: confidence calibration, predictive uncertainty estimation, medical image segmentation, fully convolutional network, U-Net, Dice loss, cross-entropy loss, model ensembling, out-of-distribution detection, batch normalization, brain segmentation, cardiac image segmentation, prostate segmentation
MeSH terms: Brain, Calibration, Humans, Image Processing, Computer-Assisted, Male, Neural Networks, Computer, Uncertainty

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Confidence Calibration and Predictive Uncertainty Estimation for Deep Medical Image Segmentation

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks