The DOI matches its Crossref record; 72 of the 72 references it cites were found in a registry or an index.
An automated framework for localization, segmentation and super-resolution reconstruction of fetal brain MRI
Open accessAbstract
High-resolution volume reconstruction from multiple motion-corrupted stacks of 2D slices plays an increasing role for fetal brain Magnetic Resonance Imaging (MRI) studies. Currently existing reconstruction methods are time-consuming and often require user interactions to localize and extract the brain from several stacks of 2D slices. We propose a fully automatic framework for fetal brain reconstruction that consists of four stages: 1) fetal brain localization based on a coarse segmentation by a Convolutional Neural Network (CNN), 2) fine segmentation by another CNN trained with a multi-scale loss function, 3) novel, single-parameter outlier-robust super-resolution reconstruction, and 4) fast and automatic high-resolution visualization in standard anatomical space suitable for pathological brains. We validated our framework with images from fetuses with normal brains and with variable degrees of ventriculomegaly associated with open spina bifida, a congenital malformation affecting also the brain. Experiments show that each step of our proposed pipeline outperforms state-of-the-art methods in both segmentation and reconstruction comparisons including expert-reader quality assessments. The reconstruction results of our proposed method compare favorably with those obtained by manual, labor-intensive brain segmentation, which unlocks the potential use of automatic fetal brain reconstruction studies in clinical practice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation
Milletari, F., Navab, N., & Ahmadi, S.-A. (2016) · 2016 Fourth International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2016.79 · Cited by 11,931 · cited 2×
“For example, the Dice loss function is defined as (Milletari et al., 2016; Sudre et al., 2017):”
BackgroundJenkinson, M., Bannister, P., Brady, M., & Smith, S. (2002) · NeuroImage · doi:10.1006/nimg.2002.1132 · Cited by 11,888
3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation
Çiçek, Ö., Abdulkadir, A., Lienkamp, S. S., Brox, T., & Ronneberger, O. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46723-8_49 · Cited by 7,945
Multi-scale context aggregation by dilated convolutions
Yu, F., & Koltun, V. (2015) · arXiv · doi:10.48550/arxiv.1511.07122 · Cited by 7,738 · cited 1×
“It consists of six blocks of convolution layers with dilated convolution (Yu and Koltun, 2016) to preserve resolution for dense prediction.”
Robust principal component analysis?
Candès, E. J., Li, X., Ma, Y., & Wright, J. (2011) · Journal of the ACM · doi:10.1145/1970392.1970395 · Cited by 6,921
N4ITK: Improved N3 Bias Correction
Tustison, N. J., Avants, B. B., Cook, P. A., Zheng, Y., Egan, A., Yushkevich, P. A., & Gee, J. C. (2010) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2010.2046908 · Cited by 6,073
Attention U-Net: Learning Where to Look for the Pancreas
Oktay, O., Schlemper, J., Folgoc, L. L., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, N. Y., Kainz, B., et al. (2018) · arXiv · doi:10.48550/arxiv.1804.03999 · Cited by 5,458
Parikh, N., & Boyd, S. (2014) · Foundations and Trends® in Optimization · doi:10.1561/2400000003 · Cited by 4,102
2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
(2015) · doi:10.1109/cvpr31182.2015 · Cited by 3,737
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2844175 · Cited by 3,457
2017 IEEE International Conference on Computer Vision (ICCV)
(2017) · doi:10.1109/iccv37128.2017 · Cited by 3,056
Generalised Dice Overlap as a Deep Learning Loss Function for Highly Unbalanced Segmentations
Sudre, C. H., Li, W., Vercauteren, T., Ourselin, S., & Jorge Cardoso, M. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-67558-9_28 · Cited by 2,829
Self-citation(2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-24553-9 · Cited by 2,285
2014 IEEE Conference on Computer Vision and Pattern Recognition
(2014) · doi:10.1109/cvpr20399.2014 · Cited by 1,774
Medical Image Computing and Computer-Assisted Intervention
Yang, G., Hawkes, D. J., Rueckert, D., Noble, J. A., & Taylor, C. (2009) · Research Explorer (The University of Manchester) · Cited by 1,591
2015 IEEE International Conference on Computer Vision (ICCV)
(2015) · doi:10.1109/iccv33071.2015 · Cited by 1,253
Mask R-CNNPreprint
He, K., Gkioxari, G., Dollár, P., & Girshick, R. (2017) · arXiv (Cornell University) · Cited by 1,252
Scale-space theory: a basic tool for analyzing structures at different scales
Lindeberg, T. (1994) · Journal of Applied Statistics · doi:10.1080/757582976 · Cited by 1,196
(2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-67558-9 · Cited by 1,117
2016 Fourth International Conference on 3D Vision (3DV)
(2016) · doi:10.1109/3dv40526.2016 · Cited by 855
Interactive medical image segmentation using deep learning with image-specific fine tuning
Wang, G., Li, W., Zuluaga, M. A., Pratt, R., Patel, P. A., Aertsen, M., Doel, T., David, A. L., Deprest, J., Ourselin, S., et al. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2791721 · Cited by 843
Self-citationThe L-curve and its use in the numerical treatment of inverse problems
Hansen, P. C. (2000) · Cited by 824
Principles of magnetic resonance imaging : a signal processing perspective
Liang, Z.-P., & Lauterbur, P. C. (2000) · Cited by 767
NiftyNet: a deep-learning platform for medical imaging
Gibson, E., Li, W., Sudre, C., Fidon, L., Shakir, D. I., Wang, G., Eaton-Rosen, Z., Gray, R., Doel, T., Hu, Y., et al. (2018) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2018.01.025 · Cited by 552
Self-citation(2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-32248-9 · Cited by 535
Weakly-supervised convolutional neural networks for multimodal image registration
Hu, Y., Modat, M., Gibson, E., Li, W., Ghavami, N., Bonmati, E., Wang, G., Bandula, S., Moore, C. M., Emberton, M., et al. (2018) · Medical Image Analysis · doi:10.1016/j.media.2018.07.002 · Cited by 458
Self-citationReconstruction of fetal brain MRI with intensity matching and complete outlier removal
Kuklisova-Murgasova, M., Quaghebeur, G., Rutherford, M. A., Hajnal, J. V., & Schnabel, J. A. (2012) · Medical Image Analysis · doi:10.1016/j.media.2012.07.004 · Cited by 426
He, K., Gkioxari, G., Dollár, P., & Girshick, R. (2017) · arXiv · doi:10.48550/arxiv.1703.06870 · Cited by 406
(2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66185-8 · Cited by 377
Global image registration using a symmetric block-matching approach
Modat, M., Cash, D. M., Daga, P., Winston, G. P., Duncan, J. S., & Ourselin, S. (2014) · Journal of Medical Imaging · doi:10.1117/1.jmi.1.2.024003 · Cited by 374
Self-citationGholipour, A., Rollins, C. K., Velasco-Annis, C., Ouaalam, A., Akhondi-Asl, A., Afacan, O., Ortinau, C. M., Clancy, S., Limperopoulos, C., Yang, E., et al. (2017) · Scientific Reports · doi:10.1038/s41598-017-00525-w · Cited by 363
Gholipour, A., Estroff, J. A., & Warfield, S. K. (2010) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2010.2051680 · Cited by 360
Li, W., Wang, G., Fidon, L., Ourselin, S., Cardoso, M. J., & Vercauteren, T. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-59050-9_28 · Cited by 336
Self-citation2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI)
(2015) · doi:10.1109/isbi21167.2015 · Cited by 255
Registration-Based Approach for Reconstruction of High-Resolution In Utero Fetal MR Brain Images
Rousseau, F., Glenn, O. A., Iordanova, B., Rodriguez-Carranza, C., Vigneron, D. B., Barkovich, J. A., & Studholme, C. (2006) · Academic Radiology · doi:10.1016/j.acra.2006.05.003 · Cited by 239
Fast Volume Reconstruction From Motion Corrupted Stacks of 2D Slices
Kainz, B., Steinberger, M., Wein, W., Kuklisova-Murgasova, M., Malamateniou, C., Keraudren, K., Torsney-Weir, T., Rutherford, M., Aljabar, P., Hajnal, J. V., et al. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2415453 · Cited by 200
Jiang, S., Xue, H., Glover, A., Rutherford, M., Rueckert, D., & Hajnal, J. V. (2007) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2007.895456 · Cited by 199
ISUOG Practice Guidelines: performance of fetal magnetic resonance imaging
Prayer, D., Malinger, G., Brugger, P. C., Cassady, C., De Catte, L., De Keersmaecker, B., Fernandes, G. L., Glanc, P., Gonçalves, L. F., Gruber, G. M., et al. (2017) · Ultrasound in Obstetrics & Gynecology · doi:10.1002/uog.17412 · Cited by 191
Fetal MRI: An approach to practice: A review
Saleem, S. N. (2014) · Journal of Advanced Research · doi:10.1016/j.jare.2013.06.001 · Cited by 187
Tourbier, S., Bresson, X., Hagmann, P., Thiran, J., Meuli, R. A., & Cuadra, M. B. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.06.018 · Cited by 177
Decision Forests with Long-Range Spatial Context for Organ Localization in CT Volumes
Criminisi, A., & Bucciarelli, S. (2009) · Cited by 173
Intersection Based Motion Correction of Multislice MRI for 3-D in Utero Fetal Brain Image Formation
Kim, K., Habas, P. A., Rousseau, F., Glenn, O. A., Barkovich, A. J., & Studholme, C. (2010) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2009.2030679 · Cited by 170
VERCAUTEREN, T., PERCHANT, A., MALANDAIN, G., PENNEC, X., & AYACHE, N. (2006) · Medical Image Analysis · doi:10.1016/j.media.2006.06.006 · Cited by 168
Self-citationFetal MRI: A technical update with educational aspirations
Gholipour, A., Estroff, J. A., Barnewolt, C. E., Robertson, R. L., Grant, P. E., Gagoski, B. A., Warfield, S. K., Afacan, O., Connolly, S. A., Neil, J. J., et al. (2014) · Concepts in Magnetic Resonance Part A · doi:10.1002/cmr.a.21321 · Cited by 126
Real-time automatic fetal brain extraction in fetal MRI by deep learning
Salehi, S. S. M., Hashemi, S. R., Velasco‐Annis, C., Ouaalam, A., Estroff, J. A., Deniz Erdogmus, B., Warfield, S. K., & Gholipour, A. (2018) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2018.8363675 · Cited by 120
3-D Reconstruction in Canonical Co-Ordinate Space From Arbitrarily Oriented 2-D Images
Hou, B., Khanal, B., Alansary, A., McDonagh, S., Davidson, A., Rutherford, M., Hajnal, J. V., Rueckert, D., Glocker, B., & Kainz, B. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2798801 · Cited by 103
Automated fetal brain segmentation from 2D MRI slices for motion correction
Keraudren, K., Kuklisova-Murgasova, M., Kyriakopoulou, V., Malamateniou, C., Rutherford, M. A., Kainz, B., Hajnal, J. V., & Rueckert, D. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.07.023 · Cited by 91
Multi-organ localization with cascaded global-to-local regression and shape prior
Gauriau, R., Cuingnet, R., Lesage, D., & Isabelle Bloch, A. (2015) · Medical Image Analysis · doi:10.1016/j.media.2015.04.007 · Cited by 78
GIFT-Cloud: A data sharing and collaboration platform for medical imaging research
Doel, T., Shakir, D. I., Pratt, R., Aertsen, M., Moggridge, J. C., Bellon, E., David, A. L., Deprest, J. A., Vercauteren, T. K., & Sebastien Ourselin, A. (2016) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2016.11.004 · Cited by 70
Self-citationPredicting Slice-to-Volume Transformation in Presence of Arbitrary Subject Motion
Hou, B., Alansary, A., McDonagh, S., Davidson, A., Rutherford, M., Hajnal, J. V., Rueckert, D., Glocker, B., & Kainz, B. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66185-8_34 · Cited by 68 · cited 2×
“Hou et al. (2017, 2018) utilized CNNs to predict the initial transformation parameters of SVR in the motion correction step to achieve more robust initialisations for the slice-to-volume registration step.”
MethodAutomated Brain Masking of Fetal Functional MRI with Open Data
Rutherford, S. E., Sturmfels, P., Angstadt, M., Hect, J. L., Wiens, J., van den Heuvel, M. I., Scheinost, D., Sripada, C., & Thomason, M. E. (2021) · Neuroinformatics · doi:10.1007/s12021-021-09528-5 · Cited by 53
PVR: Patch-to-Volume Reconstruction for Large Area Motion Correction of Fetal MRI
Alansary, A., Rajchl, M., McDonagh, S., Deprez, M., Damodaram, M. S., Lloyd, D. F. A., Davidson, A., Rutherford, M., Hajnal, J. V., Rueckert, D., et al. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2737081 · Cited by 52
Automated template-based brain localization and extraction for fetal brain MRI reconstruction
Tourbier, S., Velasco‐Annis, C., Taimouri, V., Hagmann, P., Meuli, R. A., Warfield, S. K., Cuadra, M. B., & Gholipour, A. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.04.004 · Cited by 51
An Automated Localization, Segmentation and Reconstruction Framework for Fetal Brain MRI
Ebner, M., Wang, G., Li, W., Aertsen, M., Patel, P. A., Aughwane, R., Melbourne, A., Doel, T., David, A. L., Deprest, J. A., et al. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00928-1_36 · Cited by 49
Self-citationAutomatic segmentation of head structures on fetal MRI
Anquez, J., Angelini, E. D., & Isabelle Bloch, A. (2009) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2009.5192995 · Cited by 47
Ovaere, C., Eggink, A., Richter, J., Cohen‐Overbeek, T. E., Calenbergh, F. V., Jansen, K., Oepkes, D., Devlieger, R., Catte, L. D., & Deprest, J. A. (2014) · Fetal Diagnosis and Therapy · doi:10.1159/000365214 · Cited by 42
Self-citationLearning under Distributed Weak SupervisionPreprint
Rajchl, M., Lee, M. C. H., Schrans, F., Davidson, A., Passerat‐Palmbach, J., Tarroni, G., Alansary, A., Oktay, O., Kainz, B., & Rueckert, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.01100 · Cited by 38
Localisation of the Brain in Fetal MRI Using Bundled SIFT Features
Keraudren, K., Kyriakopoulou, V., Rutherford, M., Hajnal, J. V., & Rueckert, D. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-40811-3_73 · Cited by 37
Fast fully automatic brain detection in fetal MRI using dense rotation invariant image descriptors
Kainz, B., Keraudren, K., Kyriakopoulou, V., Rutherford, M., Hajnal, J. V., & Rueckert, D. (2014) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2014.6868098 · Cited by 34
Aertsen, M., Verduyckt, J., Keyzer, F. D., Vercauteren, T. K., Calenbergh, F. V., Catte, L. D., Dymarkowski, S., Demaerel, P., & Deprest, J. A. (2018) · American Journal of Neuroradiology · doi:10.3174/ajnr.a5930 · Cited by 29
Self-citationConvex Optimization with Abstract Linear Operators
Diamond, S., & Boyd, S. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.84 · Cited by 22
Ebner, M., Patel, P. A., Atkinson, D., et al. (2019) · Magnetic Resonance in Medicine · doi:10.1002/mrm.27852 · Cited by 16
Self-citationAutomatic Template-based Brain Extraction in Fetal MR Images
Taleb, Y., Schweitzer, M., Studholme, C., Koob, M., Dietemann, J., & Rousseau, F. (2013) · HAL · Cited by 11
Reproducibility of Functional Connectivity Estimates in Motion Corrected Fetal fMRI
Sobotka, D., Licandro, R., Ebner, M., Schwartz, E., Vercauteren, T. K., Sebastien Ourselin, A., Kasprian, G. J., Prayer, D., & Langs, G. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-32875-7_14 · Cited by 7
Self-citationAutomated Brain Masking of Fetal Functional MRIPreprint
Rutherford, S. E., Sturmfels, P., Angstadt, M., Hect, J. L., Wiens, J., van den Heuval, M., Scheinost, D., Thomason, M. E., & Sripada, C. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/525386 · Cited by 1
Cited by
SynthStrip: skull-stripping for any brain image
Hoopes, A., Mora, J. S., Dalca, A. V., Fischl, B., & Hoffmann, M. (2022) · NeuroImage · doi:10.1016/j.neuroimage.2022.119474 · Cited by 488
Single-cell brain organoid screening identifies developmental defects in autism
Li, C., Fleck, J. S., Martins-Costa, C., Burkard, T. R., Themann, J., Stuempflen, M., Peer, A. M., Vertesy, Á., Littleboy, J. B., Esk, C., et al. (2023) · Nature · doi:10.1038/s41586-023-06473-y · Cited by 283
Mapping fetal brain development based on automated segmentation and 4D brain atlasing
Li, H., Yan, G., Luo, W., Liu, T., Wang, Y., Liu, R., Zheng, W., Zhang, Y., Li, K., Zhao, L., et al. (2021) · Brain Structure and Function · doi:10.1007/s00429-021-02303-x · Cited by 41
Machine learning and disease prediction in obstetrics
Arain, Z., Iliodromiti, S., Slabaugh, G., David, A. L., & Chowdhury, T. T. (2023) · Current Research in Physiology · doi:10.1016/j.crphys.2023.100099 · Cited by 40
Self-citationRegional Distribution of Brain Injury After Cardiac Arrest: Clinical and Electrographic Correlates
Snider, S. B., Fischer, D., McKeown, M. E., Cohen, A. L., Schaper, F. L. W. V. J., Amorim, E., Fox, M. D., Scirica, B., Bevers, M. B., & Lee, J. W. (2022) · Neurology · doi:10.1212/wnl.0000000000013301 · Cited by 33
Metadata
- Authors
- Ebner, M., Wang, G., Li, W., Aertsen, M., Patel, P. A., Aughwane, R., Melbourne, A., Doel, T., Dymarkowski, S., De Coppi, P., David, A. L., Deprest, J., Ourselin, S., & Vercauteren, T.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2020-02
- Volume
- 206
- Pages
- 116324
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2989249732
- Cited by
- 288
- References
- 72
- FWCI
- 12.18
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.