The DOI matches its Crossref record; 53 of the 56 references it cites were found in a registry or an index.
Evaluation of prostate segmentation algorithms for MRI: The PROMISE12 challenge
Open accessAbstract
Prostate MRI image segmentation has been an area of intense research due to the increased use of MRI as a modality for the clinical workup of prostate cancer. Segmentation is useful for various tasks, e.g. to accurately localize prostate boundaries for radiotherapy or to initialize multi-modal registration algorithms. In the past, it has been difficult for research groups to evaluate prostate segmentation algorithms on multi-center, multi-vendor and multi-protocol data. Especially because we are dealing with MR images, image appearance, resolution and the presence of artifacts are affected by differences in scanners and/or protocols, which in turn can have a large influence on algorithm accuracy. The Prostate MR Image Segmentation (PROMISE12) challenge was setup to allow a fair and meaningful comparison of segmentation methods on the basis of performance and robustness. In this work we will discuss the initial results of the online PROMISE12 challenge, and the results obtained in the live challenge workshop hosted by the MICCAI2012 conference. In the challenge, 100 prostate MR cases from 4 different centers were included, with differences in scanner manufacturer, field strength and protocol. A total of 11 teams from academic research groups and industry participated. Algorithms showed a wide variety in methods and implementation, including active appearance models, atlas registration and level sets. Evaluation was performed using boundary and volume based metrics which were combined into a single score relating the metrics to human expert performance. The winners of the challenge where the algorithms by teams Imorphics and ScrAutoProstate, with scores of 85.72 and 84.29 overall. Both algorithms where significantly better than all other algorithms in the challenge (p<0.05) and had an efficient implementation with a run time of 8min and 3s per case respectively. Overall, active appearance model based approaches seemed to outperform other approaches like multi-atlas registration, both on accuracy and computation time. Although average algorithm performance was good to excellent and the Imorphics algorithm outperformed the second observer on average, we showed that algorithm combination might lead to further improvement, indicating that optimal performance for prostate segmentation is not yet obtained. All results are available online at http://promise12.grand-challenge.org/.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“PROMISE12 as the example in the prostate dataset is the dataset made for MICCAI prostate segmentation challenge, which was used by 11 academic teams for various segmentation algorithms and showed promising results”
From A review of deep learning-based deformable medical image registration (2022) · cites this paper as [55]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Robust Real-Time Face Detection
Viola, P., & Jones, M. J. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000013087.49260.fb · Cited by 14,097
Marching cubes: A high resolution 3D surface construction algorithm
Lorensen, W. E., & Cline, H. E. (1987) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/37401.37422 · Cited by 10,320
Marching cubes: A high resolution 3D surface construction algorithm
Lorensen, W. E., & Cline, H. E. (1987) · ACM SIGGRAPH Computer Graphics · doi:10.1145/37402.37422 · Cited by 8,928
Cootes, T. F., Edwards, G. J., & Taylor, C. J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.927467 · Cited by 5,409
ESUR prostate MR guidelines 2012
Barentsz, J. O., Richenberg, J., Clements, R., Choyke, P. L., Verma, S., Villeirs, G. M., Rouvière, O., Løgager, V., & Fütterer, J. J. (2012) · European Radiology · doi:10.1007/s00330-011-2377-y · Cited by 2,444
Robust real-time object detection.
Viola, P. A. (2001) · Cited by 2,340
Warfield, S. K., Zou, K. H., & Wells, W. M. (2004) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2004.828354 · Cited by 2,072
Pérez, P., Gangnet, M., & Blake, A. (2003) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1201775.882269 · Cited by 2,041
Pérez, P., Gangnet, M., & Blake, A. (2003) · ACM Transactions on Graphics · doi:10.1145/882262.882269 · Cited by 1,769
Comparison and evaluation of methods for liver segmentation from CT datasets
Heimann, T., van Ginneken, B., Styner, M. A., Arzhaeva, Y., Aurich, V., Bauer, C., Beck, A., Becker, C., Beichel, R., Bekes, G., et al. (2009) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2009.2013851 · Cited by 1,135
Research works printed but not linked: 8
- Birkbeck, N., Zhang, J., Requardt, M., Kiefer, B., Gall, P., Kevin Zhou, S., 2012. Region-specific hierarchical segmentation of MR prostate using discriminative learning. MICCAI Grand Challenge: Prostate MR Image Segmentation 2012.
- Gao, Q., Rueckert, D., Edwards, P., 2012. An automatic multi-atlas based prostate segmentation using local appearance-specific atlases and patch-based voxel weighting. MICCAI Grand Challenge: Prostate MR Image Segmentation 2012.
- Ghose, S., Mitra, J., Oliver, A., Martí, R., Lladó, X., Freixenet, J., Vilanova, J.C., Sidibé, D., Meriaudeau, F., 2012. A random forest based classification approach to prostate segmentation in MRI. MICCAI Grand Challenge: Prostate MR Image Segmentation 2012.
- Kirschner, M., Jung, F., Wesarg, S., 2012. Automatic prostate segmentation in MR images with a probabilistic active shape model. MICCAI Grand Challenge: Prostate MR Image Segmentation 2012.
- Litjens, G.J.S., Karssemeijer, N., Huisman, H.J., 2012. A multi-atlas approach for prostate segmentation in MR images. MICCAI Grand Challenge: Prostate MR Image Segmentation 2012.
- Toth, 2012, Multifeature landmark-free active appearance models: application to prostate MRI segmentation, IEEE Trans. Med. Imaging, 31, 1638, 10.1109/TMI.2012.2201498 · DOI
- Vincent, G., Guillard, G., Bowes, M., 2012. Fully automatic segmentation of the prostate using active appearance models. MICCAI Grand Challenge: Prostate MR Image Segmentation 2012.
- Yuan, J., Qiu, W., Ukwatta, E., Rajchl, M., Sun, Y., Fenster, A., 2012. An efficient convex optimization approach to 3D prostate MRI segmentation with generic star shape prior. MICCAI Grand Challenge: Prostate MR Image Segmentation 2012.
Cited by
Sorted by citations
Items 801–856 of 856
Zhou, Y., Cui, G., Lyu, S., Cheng, G., Chen, L., Bai, W., & Zhao, Q. (2026) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi61048.2026.11515955
From Specialist to Generalist: Unlocking Sam's Learning Potential on Unlabeled Medical Images
Vu, V., Nguyen, T.-H., Nguyen, T.-T., Lam, B.-T., Nguyen, H.-T., Wang, T., Li, X., & Xu, M. (2026) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi61048.2026.11515917
LIDSS: A Latent Information-Driven Dynamic Framework for Semi-Supervised Medical Image Segmentation
Yuan, Y., Zhang, D., Luo, B., Luo, Y., Liu, S., & Lu, X. (2026) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi61048.2026.11515810
Ye, S., & Liu, R. (2026) · International Conference on Intelligent Computing and Signal Processing (ICSP) · doi:10.1109/icsp69961.2026.11540956
Amodal segmentation for occlusion-aware instance recovery of juvenile abalone
Ruan, J., Wu, F., (90241), F. Z., & Cheng, D. (2026) · Machine Vision and Applications · doi:10.1007/s00138-026-01853-6
Diff-MedSeg: Diffusion Model Based Medical Image Segmentation With Multi-Channel Attention
Liu, D., Ma, M., Fang, H., & Wang, H. (2026) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2026.3702543
Semi-supervised medical image segmentation with Mamba-based semantic-structural scans
Xu, H., Song, J., & Qin, T. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.133280
An adaptive consistency co-optimization network for semi-supervised medical image segmentation
Liu, R., Liu, Y., Liao, J., Liu, X., Xie, T., Zou, Y., & Chen, Y. (2026) · Biomedical Engineering Letters · doi:10.1007/s13534-026-00590-z
Diffusion-based controllable time-step consistency for semi-supervised medical image segmentation
Li, S., Zhao, J., Hao, Y., Zhang, C., & Song, Z. (2026) · Pattern Recognition · doi:10.1016/j.patcog.2026.114203
Chung, V., Chai, R., Swan, H. A., Diaz, M., Bynum, S., Hindman, A., Albrecht, J. W., Mangul, S., Varma, S., Hodgson, J., et al. (2026) · Patterns · doi:10.1016/j.patter.2026.101595
Chen, Z., Fu, Y., Xiong, W., Shen, H., Wang, Y., & Liu, H. (2026) · Optics & Laser Technology · doi:10.1016/j.optlastec.2026.115819
Ko, H., Seo, S. H., Sung, S., Cho, W., & Kim, J. S. (2026) · Progress in Medical Physics · doi:10.14316/pmp.2026.37.2.39
Fan, X., Deng, L., Hou, J., Li, T. Y., Ling, Z., & Li, S. (2026) · Frontiers in Oncology · doi:10.3389/fonc.2026.1875891
Liu, R., Deng, S., Liao, J., Liu, Y., Han, J., Zhao, H., Zou, Y., & Chen, Y. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.134439
Beyond Random Sampling: Distribution-Aware Alignment for Semi-supervised Medical Image Segmentation
Yan, W., Qian, Y., Dong, Y. H., & Yang, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37132-4_21 · Cited by 1
Cross-Domain Adaptation of Vision Transformer for Semi-supervised Medical Image Segmentation
Zhu, J., Wang, Y., Fang, Y., & Zheng, D. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-3429-5_5
Fang, J., Luo, H., Zeng, H., Jin, J., Guo, W., Zhang, S., Ji, W., Fu, Y., Liu, H., & Wang, G. (2026) · Complex & Intelligent Systems · doi:10.1007/s40747-026-02406-0
CNN–ViT–UNet: A Hybrid Deep Learning Framework for Automatic Prostate Gland Segmentation in MRI
Mokhneche, A. S., & Belkhiat, D. E. C. (2026) · International Conference on Pattern Analysis and Intelligent Systems (PAIS) · doi:10.1109/pais69842.2026.11605359
VSS-SAM++: Visual State Space-Aware SAM for 3-D Medical Image Segmentation
Lyu, J., Zhang, B., Wang, Y., Liu, S., Li, W., Cui, Z., Wang, H., Liang, D., Hu, Y., & Zhou, Y. (2026) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2026.3716353
Wan, Y., Chen, Z., Xu, Y., Xu, Y., Li, M., & Wang, Y. (2026) · Medical Image Analysis · doi:10.1016/j.media.2026.104236
A comprehensive review of benchmark datasets for deep learning-based medical image segmentation
Wang, A., Yang, C., Zhang, X., Yang, X., & Ou, W. (2026) · Artificial Intelligence Review · doi:10.1007/s10462-026-11662-y
Wang, Y., Xu, X., Shi, G., Zhang, Y., Wang, S., Wang, S., Zhao, Y., & Xu, M. (2026) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2026.111173
PBDN-Net: Probabilistic Boundary Disentanglement Network for Prostate MRI Segmentation
Lei, X., Li, Y., Huang, J., Pang, Y., & Wang, Q. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-31397-3_28
Wei, X., Liao, Y., Gao, F., Li, R., Chen, H., Li, P., Lai, X., Zhu, J., & Huang, Y. (2026) · International Journal of Imaging Systems and Technology · doi:10.1002/ima.70427
Ko, B., Anisimov, A., Ke, K., Bharthepude, S., & Lee, J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-35393-1_9
FedDPF: Layer fusion for balancing personalization and generalization in federated learning
Su, K., Chen, H., Shi, M., Ma, D., & Li, Y. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.134038
FFG-Unet: A medical image segmentation model with frequency feature guidance
Lin, S., Hu, R., Li, Z., Zeng, K., & Li, Y. (2026) · Pattern Recognition · doi:10.1016/j.patcog.2026.114695
Kinalioğlu, İ. H. (2026) · Pattern Recognition Letters · doi:10.1016/j.patrec.2026.08.026
CPNet: Channel partitioning with completion for medical image segmentation
Wang, Q., Wang, X., Wang, Y., Mai, Z., Liu, W., Shi, C., & Zhang, C. (2026) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2026.111351
Wang, P., Jing, 刘. L., & Dawei, 仇. Q. (2026) · Laser & Optoelectronics Progress · doi:10.3788/lop260504
Anatomy‐aware fusion attention network for high‐precision prostate MRI segmentation
Wang, Y., Huang, H., Ma, Y., Zhu, H., Wen, C., Yuan, F., & Huang, B. (2026) · Medical Physics · doi:10.1002/mp.70669
Zhao, Y., Zhao, H., Chen, L., Li, H., Wang, X., & Li, Y. (2026) · The Journal of Supercomputing · doi:10.1007/s11227-026-08736-7
An Unsupervised Transformer-based Clustering Network for Medical Image Segmentation
Bharati, S., Ahmad, M. O., & Swamy, M. N. S. (2026) · IEEE International Midwest Symposium on Circuits and Systems (MWSCAS) · doi:10.1109/mwscas67364.2026.11680872
Bhupathi, L., & Ma, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38401-0_7
ModINSeg: Modality-Informed Universal Medical Image Segmentation
Yadav, M., Palli, R., Bhandari, A., & Ma, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38401-0_8
Allaoui, M. L., & Allili, M. S. (2026) · Information Fusion · doi:10.1016/j.inffus.2026.104797
HDBU-Net: A hybrid dual-branch U-Net for super-resolution reconstruction of prostate MRI
Ge, X., Wang, Y., Cheng, J., & Luo, T. (2026) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2026.110802
Consistency-Guided Uncertainty Estimation for Source-Free Medical Image Segmentation
Yuan, L., Ma, Y., Gu, Y., Ma, S., & Zhao, Y. (2026) · IEEE Transactions on Image Processing · doi:10.1109/tip.2026.3732294
Sui, F., Hu, Y., Chi, M., & Du, Y. (2026) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2026.111508
Yang, Z., Ma, L., Gao, Z., Zhang, Y., & Ma, J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38082-1_50
Dual-space Cold-Start Active Learning Guided by SAM3 for Medical Image Segmentation
Ye, P., Zhu, N., Fu, J., Zhou, X., Luo, Z., Wang, L., Li, H., & Wang, G. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38085-2_16
Lightweight Deep Learning for Processing 3D Medical Images: A Systematic ReviewPreprint
ullah, R., Abbas, H., Ali, H., & Nabi, S. W. (2026) · Research Square · doi:10.21203/rs.3.rs-10948128/v1
Hizam, D. A., Saad, M. B., Ung, N. M., Muaadz, A., Salleh, F. M., & Tan, L. K. (2026) · Physical and Engineering Sciences in Medicine · doi:10.1007/s13246-026-01815-2
Han, J., Qiu, Y., Liu, H., & Wen, J. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1897681
Ji, J., Cheng, Z., Zhao, J., Ma, B., Chen, H., Gao, Y., Zhang, L., Ying, Z., & Wang, S. (2026) · doi:10.1109/cvprf71909.2026.00749
O'Neill, A. G. M., O’Keeffe, R., Winter, S., Dorrian, J., Gaunt, T. R., Guönason, V., Travis, R. C., Martin, R. M., Allott, E. H., & Leech, M. (2026) · The Prostate · doi:10.1002/pros.70226
Anatomy-Aware Adaptive Feature Perturbation Framework for Semi-Supervised Mri Segmentation
Lin, J., Peng, B., Li, S., & Zhang, Q. (2026) · doi:10.1109/cvprf71909.2026.00540
Zhou, Z., Zhang, Y., He, A., Wang, P., & Li, T. (2026) · Information Sciences · doi:10.1016/j.ins.2026.124299
Azamat, S., Singh, A., Midya, A., Zhang, Z., Gilkey, M., Hajibonabi, F., Sompalle, P., Rastinehad, A. R., Verma, S., Kikano, E. G., et al. (2026) · medRxiv · doi:10.64898/2026.01.19.26344376
Self-citationCascadeMambaSeg: Mamba-based Medical Image Segmentation for Prostate with Cascaded Decoding
Kim, H., & Ma, M. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11728986
SDRF-Net: Synergistic Dual-Resolution Fusion for Semi-Supervised Medical Image Segmentation
Tang, X., Zhou, S., sun, D., & Zhao, H. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11728656
Xiao, L., Liao, K., Zhou, B., & Fan, C. (2026) · Cognitive Computation · doi:10.1007/s12559-026-10667-7
Zhang, Y., Ding, P., Che, M., Li, Z., & Shao, Y. (2026) · IEEE Access · doi:10.1109/access.2026.3747003
Federated learning in cancer imaging: a comprehensive review and future outlook
Shi, Y., Li, W., & Cai, J. (2026) · Frontiers in Radiology · doi:10.3389/fradi.2026.1976540
HybPromptSeg: Spatial-frequency hybrid prompting for unified multi-task medical image segmentation
Niu, Y., Pei, S., Li, Y., Zhou, H., & Guoyan Zheng, A. (2026) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2026.102837
Metadata
- Authors
- Litjens, G., Toth, R., van de Ven, W., Hoeks, C., Kerkstra, S., van Ginneken, B., Vincent, G., Guillard, G., Birbeck, N., Zhang, J., Strand, R., Malmberg, F., Ou, Y., Davatzikos, C., Kirschner, M., Jung, F., Yuan, J., Qiu, W., Gao, Q., Edwards, P. “., Maan, B., van der Heijden, F., Ghose, S., Mitra, J., Dowling, J., Barratt, D., Huisman, H., & Madabhushi, A.
- Affiliations
- Radboud University Medical Center (NL)
- Siemens (United States) (US)
- Uppsala University (SE)
- University of Pennsylvania (US)
- Technische Universität Darmstadt (DE)
- Robarts Research Institute (CA)
- Imperial College London (GB)
- University of Twente (NL)
- Commonwealth Scientific and Industrial Research Organisation (AU)
- University College London (GB)
- Case Western Reserve University (US)
- Corresponding author
- Litjens, Geert
- ORCID
- Venue
- Medical Image Analysis
- Publisher
- Elsevier BV
- Published
- 2014-02
- Volume
- 18
- Issue
- 2
- Pages
- 359-373
- ISSN
- 1361-8415 (ISSN-L)
- PMC
- PMC4137968
- OpenAlex
- W2106033751
- Cited by
- 857
- References
- 56
- Citations by year
- 2026: 107 · 2025: 127 · 2024: 95 · 2023: 106 · 2022: 92 · 2021: 87 · 2020: 71 · 2019: 60 · 2018: 35 · 2017: 25 · 2016: 26 · 2015: 16 · 2014: 10
- FWCI
- 19.49
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Medical Image Analysis (publishedVersion)
- PubMed (publishedVersion)
- University of Twente Research Information (publishedVersion)
- PubMed Central (acceptedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Publikationsdatenbank der Fraunhofer-Gesellschaft (Fraunhofer-Gesellschaft) (submittedVersion)
- Fraunhofer-Publica (Fraunhofer-Gesellschaft) (submittedVersion)
- Radboud Repository (Radboud University) (submittedVersion)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- University of Twente Research Information (submittedVersion)
- Funders
- Dutch Cancer Society (KUN2007-3971)
- National Cancer Institute of the National Institutes of Health
- National Institute of Biomedical Imaging and Bioengineering of the National Institutes of Health
- National Science Foundation
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Brain Tumor Detection and Classification
- Physical Sciences › Engineering › Biomedical Engineering › Medical Imaging and Analysis
- Keywords
- prostate segmentation, prostate MRI, active appearance models, multi-atlas registration, level sets, segmentation algorithm comparison, prostate cancer, algorithm combination
- MeSH terms
- Algorithms, Humans, Image Enhancement, Image Interpretation, Computer-Assisted, Magnetic Resonance Imaging, Male, Prostatic Neoplasms, Reference Standards, Sensitivity and Specificity, Reproducibility of Results, Artifacts, Imaging, Three-Dimensional
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
