Image quality transfer and applications in diffusion MRI
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
This paper introduces a new computational imaging technique called image quality transfer (IQT). IQT uses machine learning to transfer the rich information available from one-off experimental medical imaging devices to the abundant but lower-quality data from routine acquisitions. The procedure uses matched pairs to learn mappings from low-quality to corresponding high-quality images. Once learned, these mappings then augment unseen low quality images, for example by enhancing image resolution or information content. Here, we demonstrate IQT using a simple patch-regression implementation and the uniquely rich diffusion MRI data set from the human connectome project (HCP). Results highlight potential benefits of IQT in both brain connectivity mapping and microstructure imaging. In brain connectivity mapping, IQT reveals, from standard data sets, thin connection pathways that tractography normally requires specialised data to reconstruct. In microstructure imaging, IQT shows potential in estimating, from standard "single-shell" data (one non-zero b-value), maps of microstructural parameters that normally require specialised multi-shell data. Further experiments show strong generalisability, highlighting IQT's benefits even when the training set does not directly represent the application domain. The concept extends naturally to many other imaging modalities and reconstruction problems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Image Super-Resolution Using Deep Convolutional Networks
Dong, C., Loy, C. C., He, K., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2439281 · Cited by 10,105
Sparse MRI: The application of compressed sensing for rapid MR imaging
Lustig, M., Donoho, D., & Pauly, J. M. (2007) · Magnetic Resonance in Medicine · doi:10.1002/mrm.21391 · Cited by 6,952
MR diffusion tensor spectroscopy and imaging
Basser, P. J., Mattiello, J., & LeBihan, D. (1994) · Biophysical Journal · doi:10.1016/s0006-3495(94)80775-1 · Cited by 5,970
The WU-Minn Human Connectome Project: An overview
Van Essen, D. C., Smith, S. M., Barch, D. M., Behrens, T. E. J., Yacoub, E., & Ugurbil, K. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.05.041 · Cited by 5,651
The minimal preprocessing pipelines for the Human Connectome Project
Glasser, M. F., Sotiropoulos, S. N., Wilson, J. A., Coalson, T. S., Fischl, B., Andersson, J. L., Xu, J., Jbabdi, S., Webster, M., Polimeni, J. R., et al. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.04.127 · Cited by 5,253
Self-citationBasser, P. J., & Pierpaoli, C. (1996) · Journal of Magnetic Resonance, Series B · doi:10.1006/jmrb.1996.0086 · Cited by 4,306
NODDI: Practical in vivo neurite orientation dispersion and density imaging of the human brain
Zhang, H., Schneider, T., Wheeler-Kingshott, C. A., & Alexander, D. C. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.03.072 · Cited by 3,288
Self-citationJensen, J. H., Helpern, J. A., Ramani, A., Lu, H., & Kaczynski, K. (2005) · Magnetic Resonance in Medicine · doi:10.1002/mrm.20508 · Cited by 2,488 · cited 2×
“The closest previous work on this topic (Golkov et al., 2016) learns a prior from examples to stabilise estimates of advanced diffusion MRI indices, specifically NODDI parameters and diffusion kurtosis (Jensen et al., 2005), from sparse data sets.”
BackgroundPerisylvian language networks of the human brain
Catani, M., Jones, D. K., & ffytche, D. H. (2005) · Annals of Neurology · doi:10.1002/ana.20319 · Cited by 1,832 · cited 2×
“However, exploitation of IQT in this way promises major benefits in neuroanatomy (Catani et al., 2005; Wedeen et al., 2012) and patient connectivity studies (Catani and ffytche, 2005; Warren et al., 2013), where tractography has provided fundamental advances in understanding.”
BackgroundMoeller, S., Yacoub, E., Olman, C. A., Auerbach, E., Strupp, J., Harel, N., & Uğurbil, K. (2010) · Magnetic Resonance in Medicine · doi:10.1002/mrm.22361 · Cited by 1,586 · cited 4×
“However, even greater future potential lies in IQT’s complementarity to rapid image acquisition strategies, such as compressed sensing [11], MR fingerprinting [12], or simultaneous multislice [30, 63].”
BackgroundMethodInfluentialMagnetic resonance fingerprinting
Ma, D., Gulani, V., Seiberlich, N., Liu, K., Sunshine, J. L., Duerk, J. L., & Griswold, M. A. (2013) · Nature · doi:10.1038/nature11971 · Cited by 1,577 · cited 4×
“acquisition (compressed sensing or MR fingerprinting) (Lustig et al., 2007; Ma et al., 2013), or predicting one contrast or modality from another (“image synthesis” or “modality propagation”) (Jog et al.”
BackgroundInfluentialDomain adaptation with structural correspondence learning
Blitzer, J., McDonald, R., & Pereira, F. (2006) · Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing - EMNLP '06 · doi:10.3115/1610075.1610094 · Cited by 1,543 · cited 2×
“More generally, future work could explore ideas from domain adaptation (Blitzer et al., 2006) to address the challenges of generalisability particularly in situations where direct training data”
BackgroundSetsompop, K., Gagoski, B. A., Polimeni, J. R., Witzel, T., Wedeen, V. J., & Wald, L. L. (2012) · Magnetic Resonance in Medicine · doi:10.1002/mrm.23097 · Cited by 1,285 · cited 1×
“However, even greater future potential lies in IQT's complementarity to rapid image acquisition strategies, such as compressed sensing (Lustig et al., 2007), MR fingerprinting (Ma et al., 2013), or simultaneous multislice (Moeller et al., 2010; Setsompop et al., 2012).”
BackgroundAutomatic classification of MR scans in Alzheimer’s disease.
Kloppel, S., Stonnington, C. M., Chu, C., Draganski, B., Scahill, R. I., Rohrer, J. D., Fox, N. C., Jack, C. R., Ashburner, J., & Frackowiak, R. S. J. (2008) · Brain · doi:10.1093/brain/awm319 · Cited by 1,170
Pushing the limits of in vivo diffusion MRI for the Human Connectome Project
Setsompop, K., Kimmlingen, R., Eberlein, E., Witzel, T., Cohen-Adad, J., McNab, J. A., Keil, B., Tisdall, M. D., Hoecht, P., Dietz, P., et al. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.05.078 · Cited by 545 · cited 1×
“For example, the Human Connectome Project (HCP) developed specialised human MRI scanners fitted with 100 mTm−1 and 300 mTm−1 gradient coils (Ugurbil et al., 2013; Setsompop et al., 2013), which are up to an order of magnitude more powerful than standard clinical scanners.”
BackgroundMulti-compartment microscopic diffusion imaging
Kaden, E., Kelm, N. D., Carson, R. P., Does, M. D., & Alexander, D. C. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.06.002 · Cited by 345
Self-citationCOMMIT: Convex Optimization Modeling for Microstructure Informed Tractography
Daducci, A., Dal Palu, A., Lemkaddem, A., & Thiran, J.-P. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2014.2352414 · Cited by 255
Chang, Y. S., Owen, J. P., Pojman, N. J., Thieu, T., Bukshpun, P., Wakahiro, M. L. J., Berman, J. I., Roberts, T. P. L., Nagarajan, S. S., Sherr, E. H., et al. (2015) · PLOS ONE · doi:10.1371/journal.pone.0123656 · Cited by 178 · cited 1×
“13 shows how this manifests in a group study: IQT-NODDI recovers the known trend across age-groups of NODDI's fICVF parameter, which increases to middle age then decreases towards old age (Chang et al., 2015).”
BackgroundA Machine Learning Based Approach to Fiber Tractography Using Classifier Voting
Neher, P. F., Götz, M., Norajitra, T., Weber, C., & Maier-Hein, K. H. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-24553-9_6 · Cited by 47 · cited 2×
“Moreover, the benefits that IQT offers tractography are mostly complementary to other advances in tractography, such as global and microstructureinformed tractography (Sherbondy et al., 2010; Reisert et al., 2014; Daducci et al., 2015) or machine-learning based tractography (Neher et al., 2015).”
Background
Cited by
The Human Connectome Project: A retrospective
Elam, J. S., Glasser, M. F., Harms, M. P., Sotiropoulos, S. N., Andersson, J. L. R., Burgess, G. C., Curtiss, S. W., Oostenveld, R., Larson-Prior, L. J., Schoffelen, J.-M., et al. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2021.118543 · Cited by 307
Self-citationSurvey on deep learning for radiotherapy
Meyer, P., Noblet, V., Mazzara, C., & Lallement, A. (2018) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2018.05.018 · Cited by 302
Quantitative magnetic resonance imaging of brain anatomy and in vivo histology
Weiskopf, N., Edwards, L. J., Helms, G., Mohammadi, S., & Kirilina, E. (2021) · Nature Reviews Physics · doi:10.1038/s42254-021-00326-1 · Cited by 300
Building connectomes using diffusion MRI: why, how and but
Sotiropoulos, S. N., & Zalesky, A. (2019) · NMR in Biomedicine · doi:10.1002/nbm.3752 · Cited by 290
Self-citationFiber tractography using machine learning
Neher, P. F., Côté, M.-A., Houde, J.-C., Descoteaux, M., & Maier-Hein, K. H. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.07.028 · Cited by 68
Metadata
- Authors
- Alexander, D. C., Zikic, D., Ghosh, A., Tanno, R., Wottschel, V., Zhang, J., Kaden, E., Dyrby, T. B., Sotiropoulos, S. N., Zhang, H., & Criminisi, A.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2017-05
- Volume
- 152
- Pages
- 283-298
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2591999117
- Cited by
- 130
- References
- 20
- FWCI
- 8.33
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.