Image registration by maximization of combined mutual information and gradient information
Abstract
Mutual information has developed into an accurate measure for rigid and affine monomodality and multimodality image registration. The robustness of the measure is questionable, however. A possible reason for this is the absence of spatial information in the measure. The present paper proposes to include spatial information by combining mutual information with a term based on the image gradient of the images to be registered. The gradient term not only seeks to align locations of high gradient magnitude, but also aims for a similar orientation of the gradients at these locations. Results of combining both standard mutual information as well as a normalized measure are presented for rigid registration of three-dimensional clinical images [magnetic resonance (MR), computed tomography (CT), and positron emission tomography (PET)]. The results indicate that the combined measures yield a better registration function does mutual information or normalized mutual information per se. The registration functions are less sensitive to low sampling resolution, do not contain incorrect global maxima that are sometimes found in the mutual information function, and interpolation-induced local minima can be reduced. These characteristics yield the promise of more robust registration measures. The accuracy of the combined measures is similar to that of mutual information-based methods.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
GI and GC metrics have been shown previously to be useful when handling partial content mismatch.
“The GI and GC metrics have been shown previously (Penney et al 1998, Pluim et al 2000, Otake et al 2012b) to be useful when handling partial content mismatch.”
From 3D–2D image registration for target localization in spine surgery: investigation of similarity metrics providing robustness to content mismatch (2016) · cites this paper as Pluim et al 2000
Image gradients can filter out low spatial frequency differences such as soft tissue and act as a high-pass filter to focus registration on bony anatomy visible in x-ray images.
“Image gradients can be used to filter out low spatial frequency differences such as soft tissue (Penney et al 1998, Pluim et al 2000) and act as a high-pass filter to focus the registration on the bony anatomy clearly visible in x-ray images.”
From 3D–2D image registration for target localization in spine surgery: investigation of similarity metrics providing robustness to content mismatch (2016) · cites this paper as Pluim et al 2000
Cites
Multimodality image registration by maximization of mutual information
Maes, F., Collignon, A., Vandermeulen, D., Marchal, G., & Suetens, P. (1997) · IEEE Transactions on Medical Imaging · doi:10.1109/42.563664 · Cited by 4,547 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Buckner, R. L., Snyder, A. Z., Shannon, B. J., LaRossa, G., Sachs, R., Fotenos, A. F., Sheline, Y. I., Klunk, W. E., Mathis, C. A., Morris, J. C., et al. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.2177-05.2005 · Cited by 2,140 · see citing works
Deformable medical image registration: a survey
Sotiras, A., Davatzikos, C., & Paragios, N. (2013) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2013.2265603 · Cited by 1,587 · see citing works
A new method for improving functional-to-structural MRI alignment using local Pearson correlation
Saad, Z. S., Glen, D. R., Chen, G., Beauchamp, M. S., Desai, R., & Cox, R. W. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.09.037 · Cited by 405 · see citing works
A survey of methods for 3D histology reconstruction
Pichat, J., Iglesias, J. E., Yousry, T., Ourselin, S., & Modat, M. (2018) · Medical Image Analysis · doi:10.1016/j.media.2018.02.004 · Cited by 207 · see citing works
De Silva, T., Uneri, A., Ketcha, M. D., Reaungamornrat, S., Kleinszig, G., Vogt, S., Aygun, N., Lo, S.-F., Wolinsky, J.-P., & Siewerdsen, J. H. (2016) · Physics in Medicine & Biology · doi:10.1088/0031-9155/61/8/3009 · Cited by 107 · see citing works
PET-MR and SPECT-MR multimodality probes: Development and challenges
Yang, C.-T., Ghosh, K. K., Padmanabhan, P., Langer, O., Liu, J., Eng, D. N. C., Halldin, C., & Gulyás, B. (2018) · Theranostics · doi:10.7150/thno.26610 · Cited by 101 · see citing works
Otake, Y., Wang, A. S., Webster Stayman, J., Uneri, A., Kleinszig, G., Vogt, S., Khanna, A. J., Gokaslan, Z. L., & Siewerdsen, J. H. (2013) · Physics in Medicine and Biology · doi:10.1088/0031-9155/58/23/8535 · Cited by 85 · see citing works
Multi-modal image registration based on gradient orientations of minimal uncertainty
De Nigris, D., Collins, D. L., & Arbel, T. (2012) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2012.2218116 · Cited by 73 · see citing works
- Authors
- Pluim, J. P. W., Maintz, J. B. A., & Viergever, M. A.
- Affiliations
- University Medical Center Utrecht (NL)
- Utrecht University (NL)
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2000
- Volume
- 19
- Issue
- 8
- Pages
- 809-814
- ISSN
- 0278-0062 (ISSN-L)
- OpenAlex
- W2136503713
- Cited by
- 670
- References
- 1
- Citations by year
- 2026: 4 · 2025: 5 · 2024: 7 · 2023: 10 · 2022: 15 · 2021: 17 · 2020: 17 · 2019: 18 · 2018: 32 · 2017: 27 · 2016: 21 · 2015: 28 · 2014: 46 · 2013: 41 · 2012: 45
- FWCI
- 21.71
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Medical Imaging (publishedVersion)
- PubMed (publishedVersion)
- TU/e Research Portal (publishedVersion)
- TU/e Research Portal (submittedVersion)
- Funders
- National Institutes of Health (5r01ns033926-02)
- National Institute of Neurological Disorders and Stroke (1R01 NS 33926-01)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Physical Sciences › Physics and Astronomy › Radiation › Advanced Radiotherapy Techniques
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Medical Imaging Techniques and Applications
- Keywords
- image registration, mutual information, gradient information, normalized mutual information, rigid registration, multimodal image registration, gradient direction, magnetic resonance imaging, computed tomography, positron emission tomography
- MeSH terms
- Humans, Magnetic Resonance Imaging, Probability, Tomography, Emission-Computed, Tomography, X-Ray Computed, Reproducibility of Results, Entropy, Imaging, Three-Dimensional
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review