TractSeg - Fast and accurate white matter tract segmentation
Open accessAbstract
The individual course of white matter fiber tracts is an important factor for analysis of white matter characteristics in healthy and diseased brains. Diffusion-weighted MRI tractography in combination with region-based or clustering-based selection of streamlines is a unique combination of tools which enables the in-vivo delineation and analysis of anatomically well-known tracts. This, however, currently requires complex, computationally intensive processing pipelines which take a lot of time to set up. TractSeg is a novel convolutional neural network-based approach that directly segments tracts in the field of fiber orientation distribution function (fODF) peaks without using tractography, image registration or parcellation. We demonstrate that the proposed approach is much faster than existing methods while providing unprecedented accuracy, using a population of 105 subjects from the Human Connectome Project. We also show initial evidence that TractSeg is able to generalize to differently acquired data sets for most of the bundles. The code and data are openly available at https://github.com/MIC-DKFZ/TractSeg/ and https://doi.org/10.5281/zenodo.1088277, respectively.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Manual streamline selection is considered the gold standard for delineating anatomical fiber tracts in tractography, for validating other tract identification techniques, and for benchmarked comparisons and algorithm training.
“Manual streamline selection is considered to be the gold standard to delineate anatomical fiber tracts in tractography and has been widely used to validate other anatomical tract identification techniques (Poulin et al., 2019; Pujol et al., 2015; Xie et al., 2020).”
From Quantitative mapping of the brain’s structural connectivity using diffusion MRI tractography: A review (2022) · cites this paper as Wasserthal et al., 2018
The Introduction describes manual virtual dissection as the most commonly employed way to segment white matter tracts, and §3.3 compares manual dissections with TractSeg and other methods. But §4.2 says the paper’s reference tracts are not real ground truth. The paper supports manual delineation and its use in comparisons, not the unqualified description of manual selection as a gold standard. (LLM, conf=0.84)
Experimental — accuracy not yet measuredThe tremendous amounts of high-impact publications in top journals dealing with deep learning in medical imaging illustrate the value of the methods.
“This is illustrated by the tremendous amounts of high-impact publications in top-journals dealing with deep learning in medical imaging (for example [17, 21, 30, 32, 40, 90, 162, 137, 140, 273, 285], all published in 2018).”
From An overview of deep learning in medical imaging focusing on MRI (2019) · cites this paper as [273]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404 · see citing works
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · see citing works
Individual Comparisons by Ranking Methods
Wilcoxon, F. (1945) · Biometrics Bulletin · doi:10.2307/3001968 · Cited by 15,354 · see citing works
Dipy, a library for the analysis of diffusion MRI data
Garyfallidis, E., Brett, M., Amirbekian, B., Rokem, A., van der Walt, S., Descoteaux, M., Nimmo-Smith, I., & Contributors, D. (2014) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2014.00008 · Cited by 1,371 · see citing works
Tractography-based connectomes are dominated by false-positive connections
Maier-Hein, K. H., Neher, P., Houde, J.-C., Côté, M.-A., Garyfallidis, E., Zhong, J., Chamberland, M., Yeh, F.-C., Lin, Y.-C., Ji, Q., et al. (2016) · doi:10.1101/084137 · Cited by 1,361 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 37
- Avants, B.B., Epstein, C.L., Grossman, M., Gee, J.C., 2008. Symmetric diffeomorphic image registration with cross-correlation: evaluating automated labeling of elderly and neurodegenerative brain. Med. Image Anal. 12, 26-41. https://doi.org/10.1016/ j.media.2007.06.004. · DOI
- Bazin, P.-L., Ye, C., Bogovic, J.A., Shiee, N., Reich, D.S., Prince, J.L., Pham, D.L., 2011. Direct segmentation of the major white matter tracts in diffusion tensor images. Neuroimage 58, 458-468. https://doi.org/10.1016/j.neuroimage.2011.06.020. · DOI
- Bells, S., Cercignani, M., Deoni, S., Assaf, Y., Pasternak, O., Evans, C., Leemans, A., Jones, D., 2011. Tractometry-comprehensive multi-modal quantitative assessment of white matter along specific tracts. In: Proc. ISMRM, vol. 678.
- Bustillo, J., et al., 2016. Glutamatergic and Neuronal Dysfunction in gray and white Matter: a Spectroscopic Imaging Study in a Large Schizophrenia Sample Schizophr Bull. PubMed PMID: 27550776.
- Çetin, M.S., Christensen, F., Abbott, C.C., Stephen, J.M., Mayer, A.R., Cañive, J.M., Bustillo, J.R., Pearlson, G.D., Calhoun, V.D., 2014. Thalamus and posterior temporal lobe show greater inter-network connectivity at rest and across sensory paradigms in schizophrenia. Neuroimage 97, 117-126. https://doi.org/10.1016/j.neuroimage. 2014.04.009. · DOI · Paper page
- Çiçek, € O., Abdulkadir, A., Lienkamp, S.S., Brox, T., Ronneberger, O., 2016. 3D U-Net: learning dense volumetric segmentation from sparse annotation. In: Medical Image Computing and Computer-assisted Intervention -MICCAI 2016, Lecture Notes in Computer Science. Presented at the International Conference on Medical Image Computing and Computer-assisted Intervention. Springer, Cham, pp. 424-432. https://doi.org/10.1007/978-3-319-46723-8_49. · DOI · Paper page
- Clayden, J.D., Storkey, A.J., Bastin, M.E., 2007. A probabilistic model-based approach to consistent white matter tract segmentation. IEEE Trans. Med. Imag. 26, 1555-1561. https://doi.org/10.1109/TMI.2007.905826. · DOI
- Clayden, J.D., Storkey, A.J., Maniega, S.M., Bastin, M.E., 2009. Reproducibility of tract segmentation between sessions using an unsupervised modelling-based approach. Neuroimage 45, 377-385. https://doi.org/10.1016/j.neuroimage.2008.12.010. · DOI
- Cook, P.A., Zhang, H., Avants, B.B., Yushkevich, P., Alexander, D.C., Gee, J.C., Ciccarelli, O., Thompson, A.J., 2005. An automated approach to connectivity-based partitioning of brain structures. In: Medical Image Computing and Computer-assisted Intervention -MICCAI 2005, Lecture Notes in Computer Science. Presented at the International Conference on Medical Image Computing and Computer-assisted Intervention. Springer, Berlin, Heidelberg, pp. 164-171. https://doi.org/10.1007/ 11566465_21. · DOI
- Dayan, M., Monohan, E., Pandya, S., Kuceyeski, A., Nguyen, T.D., Raj, A., Gauthier, S.A., 2016. Profilometry: a new statistical framework for the characterization of white matter pathways, with application to multiple sclerosis. Hum. Brain Mapp. 37 (3), 989-1004.
- Descoteaux, M., Deriche, R., 2009. High angular resolution diffusion MRI segmentation using region-based statistical surface evolution. J. Math. Imag. Vis. 33, 239-252. https://doi.org/10.1007/s10851-008-0071-8. · DOI
- Eckstein, I., Shattuck, D.W., Stein, J.L., McMahon, K.L., de Zubicaray, G., Wright, M.J., Thompson, P.M., Toga, A.W., 2009. Active fibers: matching deformable tract templates to diffusion tensor images. Neuroimage 47 (Suppl. 2), T82-T89. https:// doi.org/10.1016/j.neuroimage.2009.01.065. · DOI
- Garyfallidis, E., Brett, M., Correia, M.M., Williams, G.B., Nimmo-Smith, I., 2012. QuickBundles, a method for tractography simplification. Front. Neurosci. 6. https:// doi.org/10.3389/fnins.2012.00175. · DOI
- Garyfallidis, E., Côt e, M.-A., Rheault, F., Sidhu, J., Hau, J., Petit, L., Fortin, D., Cunanne, S., Descoteaux, M., 2017. Recognition of white matter bundles using local and global streamline-based registration and clustering. Neuroimage. https://doi. org/10.1016/j.neuroimage.2017.07.015. · DOI · Paper page
- Glasser, M.F., Sotiropoulos, S.N., Wilson, J.A., Coalson, T.S., Fischl, B., Andersson, J.L., Xu, J., Jbabdi, S., Webster, M., Polimeni, J.R., Van Essen, D.C., Jenkinson, M., WU- Minn HCP Consortium, 2013. The minimal preprocessing pipelines for the Human Connectome Project. Neuroimage 80, 105-124. https://doi.org/10.1016/j. neuroimage.2013.04.127. · DOI · Paper page
- Guo, W., Chen, Y., Zeng, Q., 2008. A geometric flow-based approach for diffusion tensor image segmentation. Philos. Trans. A Math Phys. Eng. Sci. 366, 2279-2292. https:// doi.org/10.1098/rsta.2008.0042. · DOI
- Hern andez, M., Guerrero, G.D., Cecilia, J.M., García, J.M., Inuggi, A., Jbabdi, S., Behrens, T.E.J., Sotiropoulos, S.N., 2013. Accelerating fiber orientation estimation from diffusion weighted magnetic resonance imaging using GPUs. PLoS One 8, e61892. https://doi.org/10.1371/journal.pone.0061892. · DOI
- Hirjak, D., Thomann, P.A., Wolf, R.C., Kubera, K.M., Goch, C., Hering, J., Maier- Hein, K.H., 2017. White matter microstructure variations contribute to neurological soft signs in healthy adults. Hum. Brain Mapp. https://doi.org/10.1002/hbm.23609. · DOI
- Jeurissen, B., Tournier, J.-D., Dhollander, T., Connelly, A., Sijbers, J., 2014. Multi-tissue constrained spherical deconvolution for improved analysis of multi-shell diffusion MRI data. Neuroimage 103, 411-426. https://doi.org/10.1016/j.neuroimage.2014. 07.061. · DOI
- Jin, Y., Shi, Y., Zhan, L., Gutman, B.A., de Zubicaray, G.I., McMahon, K.L., Wright, M.J., Toga, A.W., Thompson, P.M., 2014. Automatic clustering of white matter fibers in brain diffusion MRI with an application to genetics. Neuroimage 100, 75-90. https:// doi.org/10.1016/j.neuroimage.2014.04.048. · DOI
- Jonasson, L., Bresson, X., Hagmann, P., Cuisenaire, O., Meuli, R., Thiran, J.-P., 2005. White matter fiber tract segmentation in DT-MRI using geometric flows. Med. Image Anal. 9, 223-236. https://doi.org/10.1016/j.media.2004.07.004. · DOI
- Labra, N., Guevara, P., Duclap, D., Houenou, J., Poupon, C., Mangin, J.-F., Figueroa, M., 2017. Fast automatic segmentation of white matter streamlines based on a multi- subject bundle atlas. Neuroinformatics 15, 71-86. https://doi.org/10.1007/s12021- 016-9316-7. · DOI
- Lenglet, C., Rousson, M., Deriche, R., 2006. DTI segmentation by statistical surface evolution. IEEE Trans. Med. Imag. 25, 685-700.
- Maier-Hein, K.H., Neher, P.F., Houde, J.-C., Côt e, M.-A., Garyfallidis, E., Zhong, J., Chamberland, M., Yeh, F.-C., Lin, Y.-C., Ji, Q., Reddick, W.E., Glass, J.O., Chen, D.Q., Feng, Y., Gao, C., Wu, Y., Ma, J., Renjie, H., Li, Q., Westin, C.-F., Deslauriers- Gauthier, S., Gonz alez, J.O.O., Paquette, M., St-Jean, S., Girard, G., Rheault, F., Sidhu, J., Tax, C.M.W., Guo, F., Mesri, H.Y., D avid, S., Froeling, M., Heemskerk, A.M., Leemans, A., Bor e, A., Pinsard, B., Bedetti, C., Desrosiers, M., Brambati, S., Doyon, J., Sarica, A., Vasta, R., Cerasa, A., Quattrone, A., Yeatman, J., Khan, A.R., Hodges, W., Alexander, S., Romascano, D., Barakovic, M., Auría, A., Esteban, O., Lemkaddem, A., Thiran, J.-P., Cetingul, H.E., Odry, B.L., Mailhe, B., Nadar, M.S., Pizzagalli, F., Prasad, G., Villalon-Reina, J.E., Galvis, J., Thompson, P.M., Requejo, F.D.S., Laguna, P.L., Lacerda, L.M., Barrett, R., Dell'Acqua, F., Catani, M., Petit, L., Caruyer, E., Daducci, A., Dyrby, T.B., Holland-Letz, T., Hilgetag, C.C., Stieltjes, B., Descoteaux, M., 2017. The challenge of mapping the human connectome based on diffusion tractography. Nat. Commun. 8, 1349. https://doi.org/10.1038/s41467- 017-01285-x. · DOI
- Nair, V., Hinton, G., 2010. Rectified Linear Units Improve Restricted Boltzmann Machines. ICML.
- O'Donnell, L.J., Suter, Y., Rigolo, L., Kahali, P., Zhang, F., Norton, I., Albi, A., Olubiyi, O., Meola, A., Essayed, W.I., Unadkat, P., Ciris, P.A., Wells, W.M., Rathi, Y., Westin, C.-F., Golby, A.J., 2016. Automated white matter fiber tract identification in patients with brain tumors. Neuroimage Clin. 13, 138-153. https://doi.org/10.1016/j.nicl.2016. 11.023. · DOI
- O'Donnell, L.J., Wells, W.M., Golby, A.J., Westin, C.-F., 2012. Unbiased groupwise registration of white matter tractography. In: Med. Image Comput. Comput.-Assist. Interv. MICCAI Int. Conf. Med. Image Comput. Comput.-Assist. Interv., 15, pp. 123-130.
- O'Donnell, L.J., Westin, C.-F., 2007. Automatic tractography segmentation using a high- dimensional white matter atlas. IEEE Trans. Med. Imag. 26, 1562-1575. https://doi. org/10.1109/TMI.2007.906785. · DOI
- Ratnarajah, N., Qiu, A., 2014. Multi-label segmentation of white matter structures: application to neonatal brains. Neuroimage 102 (Pt 2), 913-922. https://doi.org/10. 1016/j.neuroimage.2014.08.001. · DOI
- Siless, V., Chang, K., Fischl, B., Yendiki, A., 2018. AnatomiCuts: hierarchical clustering of tractography streamlines based on anatomical similarity. Neuroimage 166, 32-45. https://doi.org/10.1016/j.neuroimage.2017.10.058. · DOI
- Sotiropoulos, S.N., Jbabdi, S., Xu, J., Andersson, J.L., Moeller, S., Auerbach, E.J., Glasser, M.F., Hernandez, M., Sapiro, G., Jenkinson, M., Feinberg, D.A., Yacoub, E., Lenglet, C., Van Essen, D.C., Ugurbil, K., Behrens, T.E.J., 2013. Advances in diffusion MRI acquisition and processing in the human connectome project. Neuroimage, Mapp. Connectome 80, 125-143. https://doi.org/10.1016/j.neuroimage.2013.05. 057. · DOI
- Taha, A.A., Hanbury, A., 2015. Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool. BMC Med. Imag. 15. https://doi.org/10.1186/s12880- 015-0068-x. · DOI
- Thiebaut de Schotten, M., ffytche, D.H., Bizzi, A., Dell'Acqua, F., Allin, M., Walshe, M., Murray, R., Williams, S.C., Murphy, D.G.M., Catani, M., 2011. Atlasing location, asymmetry and inter-subject variability of white matter tracts in the human brain with MR diffusion tractography. Neuroimage 54, 49-59. https://doi.org/10.1016/j. neuroimage.2010.07.055. · DOI · Paper page
- Tournier, J.-D., Calamante, F., Connelly, A., 2007. Robust determination of the fiber orientation distribution in diffusion MRI: non-negativity constrained super-resolved spherical deconvolution. Neuroimage 35, 1459-1472. https://doi.org/10.1016/j. neuroimage.2007.02.016. · DOI
- Van Essen, D.C., Smith, S.M., Barch, D.M., Behrens, T.E.J., Yacoub, E., Ugurbil, K., 2013. The WU-minn human connectome project: an overview. Neuroimage, Mapp. Connectome 80, 62-79. https://doi.org/10.1016/j.neuroimage.2013.05.041. · DOI · Paper page
- Yeatman, J.D., Dougherty, R.F., Myall, N.J., Wandell, B.A., Feldman, H.M., 2012. Tract profiles of white matter properties: automating fiber-tract quantification. PLoS One 7, e49790. https://doi.org/10.1371/journal.pone.0049790. · DOI · Paper page
- Yendiki, A., Panneck, P., Srinivasan, P., Stevens, A., Z€ ollei, L., Augustinack, J., Wang, R., Salat, D., Ehrlich, S., Behrens, T., Jbabdi, S., Gollub, R., Fischl, B., 2011. Automated probabilistic reconstruction of white-matter pathways in health and disease using an atlas of the underlying anatomy. Front. Neuroinf. 5. Zhang, F., Norton, I., Cai, W., Song, Y., Wells, W.M., O'Donnell, L.J., 2017. Comparison between two white matter segmentation strategies: an investigation into white matter segmentation consistency. In: 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017), pp. 796-799. https://doi.org/10.1109/ISBI.2017. 7950638. · DOI
Cited by
Sorted by citations
An overview of deep learning in medical imaging focusing on MRI
Lundervold, A. S., & Lundervold, A. (2019) · Zeitschrift für Medizinische Physik · doi:10.1016/j.zemedi.2018.11.002 · Cited by 2,058 · see citing works
Zhang, F., Daducci, A., He, Y., Schiavi, S., Seguin, C., Smith, R. E., Yeh, C.-H., Zhao, T., & O’Donnell, L. J. (2022) · NeuroImage · doi:10.1016/j.neuroimage.2021.118870 · Cited by 302 · see citing works
“tial for future work and improvements in computational speed [353, 483, 484, 177, 246, 179, 504, 178, 533].”
InfluentialYang, J. Y.-M., Yeh, C.-H., Poupon, C., & Calamante, F. (2021) · Physics in Medicine & Biology · doi:10.1088/1361-6560/ac0d90 · Cited by 80 · see citing works
D'Mello, A. M., Frosch, I. R., Meisler, S. L., Grotzinger, H., Perrachione, T. K., & Gabrieli, J. D. E. (2023) · The Journal of Neuroscience · doi:10.1523/jneurosci.0608-22.2023 · Cited by 14 · see citing works
Klistorner, S., Barnett, M. H., Wasserthal, J., Yiannikas, C., Barton, J., Parratt, J., You, Y., Graham, S. L., & Klistorner, A. (2021) · PLOS ONE · doi:10.1371/journal.pone.0244766 · Cited by 10 · see citing works
“TractSeg algorithm was used to identify 72 anatomically well-defined tracts as described by Wasserthal and co-workers [19, 20].”
MethodSelf-citation
- Authors
- Wasserthal, J., Neher, P., & Maier-Hein, K. H.
- Affiliations
- German Cancer Research Center (DE)
- Corresponding author
- Maier-Hein, Klaus H.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2018-12
- Volume
- 183
- Pages
- 239-253
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2803890652
- Cited by
- 664
- References
- 5
- Citations by year
- 2026: 97 · 2025: 141 · 2024: 96 · 2023: 99 · 2022: 87 · 2021: 74 · 2020: 40 · 2019: 20 · 2018: 10
- FWCI
- 24.87
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- NeuroImage (publishedVersion, cc-by)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Deutsche Forschungsgemeinschaft (MA 6340/12-1, MA 6340/10-1)
- National Institute of Mental Health (R01MH084898-01A1, 1U01 MH097435)
- National Institutes of Health
- NIH Blueprint for Neuroscience Research
- McDonnell Center for Systems Neuroscience
- Topics
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Advanced Neuroimaging Techniques and Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Life Sciences › Neuroscience › Cognitive Neuroscience › Functional Brain Connectivity Studies
- Keywords
- white matter tract segmentation, fiber orientation distribution function, convolutional neural networks, diffusion-weighted imaging, white matter fiber bundles, Human Connectome Project, cross-dataset generalization
- MeSH terms
- Deep Learning, Adult, Humans, Nerve Net, Diffusion Tensor Imaging, Neuroimaging, Connectome, White Matter
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review