Estimating CT Image From MRI Data Using Structured Random Forest and Auto-Context Model
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Computed tomography (CT) imaging is an essential tool in various clinical diagnoses and radiotherapy treatment planning. Since CT image intensities are directly related to positron emission tomography (PET) attenuation coefficients, they are indispensable for attenuation correction (AC) of the PET images. However, due to the relatively high dose of radiation exposure in CT scan, it is advised to limit the acquisition of CT images. In addition, in the new PET and magnetic resonance (MR) imaging scanner, only MR images are available, which are unfortunately not directly applicable to AC. These issues greatly motivate the development of methods for reliable estimate of CT image from its corresponding MR image of the same subject. In this paper, we propose a learning-based method to tackle this challenging problem. Specifically, we first partition a given MR image into a set of patches. Then, for each patch, we use the structured random forest to directly predict a CT patch as a structured output, where a new ensemble model is also used to ensure the robust prediction. Image features are innovatively crafted to achieve multi-level sensitivity, with spatial information integrated through only rigid-body alignment to help avoiding the error-prone inter-subject deformable registration. Moreover, we use an auto-context model to iteratively refine the prediction. Finally, we combine all of the predicted CT patches to obtain the final prediction for the given MR image. We demonstrate the efficacy of our method on two datasets: human brain and prostate images. Experimental results show that our method can accurately predict CT images in various scenarios, even for the images undergoing large shape variation, and also outperforms two state-of-the-art methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300
Robust Face Recognition via Sparse Representation
Wright, J., Yang, A. Y., Ganesh, A., Sastry, S. S., & Ma, Y. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.79 · Cited by 9,388
Computed Tomography — An Increasing Source of Radiation Exposure
Brenner, D. J., & Hall, E. J. (2007) · New England Journal of Medicine · doi:10.1056/nejmra072149 · Cited by 8,748
A global optimisation method for robust affine registration of brain images
Jenkinson, M., & Smith, S. (2001) · Medical Image Analysis · doi:10.1016/s1361-8415(01)00036-6 · Cited by 6,872
Shape matching and object recognition using shape contexts
Belongie, S., Malik, J., & Puzicha, J. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.993558 · Cited by 6,306
Elastix: a toolbox for intensity-based medical image registration
Klein, S., Staring, M., Murphy, K., Viergever, M. A., & Pluim, J. (2010) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2009.2035616 · Cited by 4,311 · cited 1×
“As there is often a large deformation on soft tissues for the prostate images, we perform intra-subject deformable registration with B-Splines (Elastix [20]), using mutual information as a similarity measure.”
The JPEG 2000 still image compression standard
Skodras, A., Christopoulos, C., & Ebrahimi, T. (2001) · IEEE Signal Processing Magazine · doi:10.1109/79.952804 · Cited by 1,787
Diffeomorphic demons: Efficient non-parametric image registration
Vercauteren, T., Pennec, X., Perchant, A., & Ayache, N. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.10.040 · Cited by 1,592
Attenuation correction for a combined 3D PET/CT scanner
Kinahan, P. E., Townsend, D. W., Beyer, T., & Sashin, D. (1998) · Medical Physics · doi:10.1118/1.598392 · Cited by 946 · cited 1×
“Besides, CT images are also indispensable for attenuation correction (AC) of positron emission tomography (PET) images [1] in the PET/CT system.”
Structured Forests for Fast Edge Detection
Dollar, P., & Zitnick, C. L. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.231 · Cited by 899
Cited by
Medical Image Synthesis with Context-Aware Generative Adversarial Networks
Nie, D., Trullo, R., Lian, J., Petitjean, C., Ruan, S., Wang, Q., & Shen, D. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66179-7_48 · Cited by 691
Self-citationMedical Image Synthesis with Deep Convolutional Adversarial Networks
Nie, D., Trullo, R., Lian, J., Wang, L., Petitjean, C., Ruan, S., Wang, Q., & Shen, D. (2018) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2018.2814538 · Cited by 625
Self-citationResViT: Residual Vision Transformers for Multimodal Medical Image Synthesis
Dalmaz, O., Yurt, M., & Cukur, T. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3167808 · Cited by 597
Unsupervised Medical Image Translation With Adversarial Diffusion Models
Özbey, M., Dalmaz, O., Dar, S. U. H., Bedel, H. A., Özturk, Ş., Güngör, A., & Çukur, T. (2023) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3290149 · Cited by 517
A review of substitute CT generation for MRI-only radiation therapy
Edmund, J. M., & Nyholm, T. (2017) · Radiation Oncology · doi:10.1186/s13014-016-0747-y · Cited by 378
Multimodal MR Synthesis via Modality-Invariant Latent Representation
Chartsias, A., Joyce, T., Giuffrida, M. V., & Tsaftaris, S. A. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2764326 · Cited by 341
Xiang, L., Qiao, Y., Nie, D., An, L., Lin, W., Wang, Q., & Shen, D. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.06.048 · Cited by 308
Self-citationEa-GANs: Edge-Aware Generative Adversarial Networks for Cross-Modality MR Image Synthesis
Yu, B., Zhou, L., Wang, L., Shi, Y., Fripp, J., & Bourgeat, P. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2895894 · Cited by 298
Self-citationMRI‐only based synthetic CT generation using dense cycle consistent generative adversarial networks
Lei, Y., Harms, J., Wang, T., Liu, Y., Shu, H., Jani, A. B., Curran, W. J., Mao, H., Liu, T., & Yang, X. (2019) · Medical Physics · doi:10.1002/mp.13617 · Cited by 297
Paired cycle‐GAN‐based image correction for quantitative cone‐beam computed tomography
Harms, J., Lei, Y., Wang, T., Zhang, R., Zhou, J., Tang, X., Curran, W. J., Liu, T., & Yang, X. (2019) · Medical Physics · doi:10.1002/mp.13656 · Cited by 257
Estimating CT Image from MRI Data Using 3D Fully Convolutional Networks
Nie, D., Cao, X., Gao, Y., Wang, L., & Shen, D. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46976-8_18 · Cited by 256
Self-citationUnsupervised MR-to-CT Synthesis Using Structure-Constrained CycleGAN
Yang, H., Sun, J., Carass, A., Zhao, C., Lee, J., Prince, J. L., & Xu, Z. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.3015379 · Cited by 204
Multi-modal mri image synthesis via gan with multi-scale gate mergence
Zhan, B., Li, D., Wu, X., Zhou, J., & Wang, Y. (2022) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2021.3088866 · Cited by 90
Sikka, A., Peri, S., Virk, J. S., Niyaz, U., & Bathula, D. R. (2025) · The Journal of Precision Medicine: Health and Disease · doi:10.1016/j.premed.2025.100004 · Cited by 58
7T-guided super-resolution of 3T MRI
Bahrami, K., Shi, F., Rekik, I., Gao, Y., & Shen, D. (2017) · Medical Physics · doi:10.1002/mp.12132 · Cited by 56
Self-citation
Metadata
- Authors
- Huynh, T., Gao, Y., Kang, J., Wang, L., Zhang, P., Lian, J., & Shen, D.
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2016-01
- Volume
- 35
- Issue
- 1
- Pages
- 174-183
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W2208340121
- Cited by
- 282
- References
- 31
- FWCI
- 19.35
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.