CoChat

VerSe: A Vertebrae labelling and segmentation benchmark for multi-detector CT images

Open access
Sekuboyina, Anjany, Husseini, Malek E., Bayat, Amirhossein, Löffler, Maximilian, Liebl, Hans, Li, Hongwei, Tetteh, Giles, Kukačka, Jan, Payer, Christian, Štern, Darko, Urschler, Martin, Chen, Maodong, Cheng, Dalong, Lessmann, Nikolas, Hu, Yujin, Wang, Tianfu, Yang, Dong, Xu, Daguang, Ambellan, Felix, Amiranashvili, Tamaz, Ehlke, Moritz, Lamecker, Hans, Lehnert, Sebastian, Lirio, Marilia, Olaguer, Nicolás Pérez de, Ramm, Heiko, Sahu, Manish, Tack, Alexander, Zachow, Stefan, Jiang, Tao, Ma, Xinjun, Angerman, Christoph, Wang, Xin, Brown, Kevin, Kirszenberg, Alexandre, Puybareau, Élodie, Chen, Di, Bai, Yiwei, Rapazzo, Brandon H., Yeah, Timyoas, Zhang, Amber, Xu, Shangliang, Hou, Feng, He, Zhiqiang, Zeng, Chan, Xiangshang, Zheng, Liming, Xu, Netherton, Tucker J., Mumme, Raymond P., Court, Laurence E., Huang, Zixun, He, Chenhang, Wang, Li-Wen, Ling, Sai Ho, Huỳnh, Lê Duy, Boutry, Nicolas, Jakubicek, Roman, Chmelik, Jiri, Mulay, Supriti, Sivaprakasam, Mohanasankar, Paetzold, Johannes C., Shit, Suprosanna, Ezhov, Ivan, Wiestler, Benedikt, Glocker, Ben, Valentinitsch, Alexander, Rempfler, Markus, Menze, Björn H., Kirschke, Jan S. · 2021 · Medical Image Analysis
Cited by 372

The DOI matches its Crossref record; 95 of the 95 references it cites were found in a registry or an index.

Abstract

Vertebral labelling and segmentation are two fundamental tasks in an automated spine processing pipeline. Reliable and accurate processing of spine images is expected to benefit clinical decision support systems for diagnosis, surgery planning, and population-based analysis of spine and bone health. However, designing automated algorithms for spine processing is challenging predominantly due to considerable variations in anatomy and acquisition protocols and due to a severe shortage of publicly available data. Addressing these limitations, the Large Scale Vertebrae Segmentation Challenge (VerSe) was organised in conjunction with the International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI) in 2019 and 2020, with a call for algorithms tackling the labelling and segmentation of vertebrae. Two datasets containing a total of 374 multi-detector CT scans from 355 patients were prepared and 4505 vertebrae have individually been annotated at voxel level by a human-machine hybrid algorithm (https://osf.io/nqjyw/, https://osf.io/t98fz/). A total of 25 algorithms were benchmarked on these datasets. In this work, we present the results of this evaluation and further investigate the performance variation at the vertebra level, scan level, and different fields of view. We also evaluate the generalisability of the approaches to an implicit domain shift in data by evaluating the top-performing algorithms of one challenge iteration on data from the other iteration. The principal takeaway from VerSe: the performance of an algorithm in labelling and segmenting a spine scan hinges on its ability to correctly identify vertebrae in cases of rare anatomical variations. The VerSe content and code can be accessed at: https://github.com/anjany/verse.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.media.2021.102166

Cites

95 of 95 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Cited by

See all 372

Metadata

Authors
Sekuboyina, A., Husseini, M. E., Bayat, A., Löffler, M., Liebl, H., Li, H., Tetteh, G., Kukačka, J., Payer, C., Štern, D., Urschler, M., Chen, M., Cheng, D., Lessmann, N., Hu, Y., Wang, T., Yang, D., Xu, D., Ambellan, F., Amiranashvili, T., Ehlke, M., Lamecker, H., Lehnert, S., Lirio, M., Olaguer, N. P. D., Ramm, H., Sahu, M., Tack, A., Zachow, S., Jiang, T., Ma, X., Angerman, C., Wang, X., Brown, K., Kirszenberg, A., Puybareau, É., Chen, D., Bai, Y., Rapazzo, B. H., Yeah, T., Zhang, A., Xu, S., Hou, F., He, Z., Zeng, C., Xiangshang, Z., Liming, X., Netherton, T. J., Mumme, R. P., Court, L. E., Huang, Z., He, C., Wang, L.-W., Ling, S. H., Huỳnh, L. D., Boutry, N., Jakubicek, R., Chmelik, J., Mulay, S., Sivaprakasam, M., Paetzold, J. C., Shit, S., Ezhov, I., Wiestler, B., Glocker, B., Valentinitsch, A., Rempfler, M., Menze, B. H., & Kirschke, J. S.
Venue
Medical Image Analysis
Publisher
Elsevier BV
Published
2021-10
Volume
73
Pages
102166
ISSN
1361-8415 (ISSN-L)
OpenAlex
W3112346810
Cited by
372
References
95
FWCI
14.28
Type
journal article
Language
en
Open access
bronze

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.