The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Image Similarity and Tissue Overlaps as Surrogates for Image Registration Accuracy: Widely Used but Unreliable
Open accessAbstract
The accuracy of nonrigid image registrations is commonly approximated using surrogate measures such as tissue label overlap scores, image similarity, image difference, or transformation inverse consistency error. This paper provides experimental evidence that these measures, even when used in combination, cannot distinguish accurate from inaccurate registrations. To this end, we introduce a "registration" algorithm that generates highly inaccurate image transformations, yet performs extremely well in terms of the surrogate measures. Of the tested criteria, only overlap scores of localized anatomical regions reliably distinguish reasonable from inaccurate registrations, whereas image similarity and tissue overlap do not. We conclude that tissue overlap and image similarity, whether used alone or together, do not provide valid evidence for accurate registrations and should thus not be reported or accepted as such.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Measures of the Amount of Ecologic Association Between Species
Dice, L. R. (1945) · Ecology · doi:10.2307/1932409 · Cited by 11,874
AVANTS, B., EPSTEIN, C., GROSSMAN, M., & GEE, J. (2008) · Medical Image Analysis · doi:10.1016/j.media.2007.06.004 · Cited by 5,669
Nonrigid registration using free-form deformations: application to breast mr images
Rueckert, D., Sonoda, L. I., Hayes, C., Hill, D. L. G., Leach, M. O., & Hawkes, D. J. (1999) · IEEE Transactions on Medical Imaging · doi:10.1109/42.796284 · Cited by 5,265
Multimodality image registration by maximization of mutual information
Maes, F., Collignon, A., Vandermeulen, D., Marchal, G., & Suetens, P. (1997) · IEEE Transactions on Medical Imaging · doi:10.1109/42.563664 · Cited by 4,547
Image matching as a diffusion process: an analogy with maxwell’s demons
Thirion, J.-P. (1998) · Medical Image Analysis · doi:10.1016/s1361-8415(98)80022-4 · Cited by 2,445
Evaluation of 14 nonlinear deformation algorithms applied to human brain MRI registration
Klein, A., Andersson, J., Ardekani, B. A., Ashburner, J., Avants, B., Chiang, M.-C., Christensen, G. E., Collins, D. L., Gee, J., Hellier, P., et al. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.12.037 · Cited by 2,227
An overlap invariant entropy measure of 3D medical image alignment
Studholme, C., Hill, D. L. G., & Hawkes, D. J. (1999) · Pattern Recognition · doi:10.1016/s0031-3203(98)00091-0 · Cited by 2,180
Multi-modal volume registration by maximization of mutual information
Wells, W. M., Viola, P., Atsumi, H., Nakajima, S., & Kikinis, R. (1996) · Medical Image Analysis · doi:10.1016/s1361-8415(01)80004-9 · Cited by 1,959
Statistical validation of image segmentation quality based on a spatial overlap index1
Zou, K. H., Warfield, S. K., Bharatha, A., Tempany, C. M. C., Kaus, M. R., Haker, S. J., Wells, W. M., Jolesz, F. A., & Kikinis, R. (2004) · Academic Radiology · doi:10.1016/s1076-6332(03)00671-8 · Cited by 1,849
Computing Large Deformation Metric Mappings via Geodesic Flows of Diffeomorphisms
Beg, M. F., Miller, M. I., Trouvé, A., & Younes, L. (2005) · International Journal of Computer Vision · doi:10.1023/b:visi.0000043755.93987.aa · Cited by 1,719
Diffeomorphic demons: Efficient non-parametric image registration
Vercauteren, T., Pennec, X., Perchant, A., & Ayache, N. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.10.040 · Cited by 1,592
Construction of a 3D probabilistic atlas of human cortical structures
Shattuck, D. W., Mirza, M., Adisetiyo, V., Hojatkashani, C., Salamon, G., Narr, K. L., Poldrack, R. A., Bilder, R. M., & Toga, A. W. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.09.031 · Cited by 1,203
Predicting error in rigid-body point-based registration
Fitzpatrick, J. M., West, J. B., & Maurer, C. R. (1998) · IEEE Transactions on Medical Imaging · doi:10.1109/42.736021 · Cited by 1,010
Magnetic Resonance Image Tissue Classification Using a Partial Volume Model
Shattuck, D. W., Sandor-Leahy, S. R., Schaper, K. A., Rottenberg, D. A., & Leahy, R. M. (2001) · NeuroImage · doi:10.1006/nimg.2000.0730 · Cited by 950
Comparison and Evaluation of Retrospective Intermodality Brain Image Registration Techniques
West, J., Fitzpatrick, J. M., Wang, M. Y., Dawant, B. M., Maurer, C. R., Kessler, R. M., Maciunas, R. J., Barillot, C., Lemoine, D., Collignon, A., et al. (1997) · Journal of Computer Assisted Tomography · doi:10.1097/00004728-199707000-00007 · Cited by 884
Multi-modality image registration by maximization of mutual information
Maes, F., Collignon, A., Vandermeulen, D., Marchal, G., & Suetens, P. (1996) · Proceedings of the Workshop on Mathematical Methods in Biomedical Image Analysis · doi:10.1109/mmbia.1996.534053 · Cited by 795
Christensen, G. E., & Johnson, H. J. (2001) · IEEE Transactions on Medical Imaging · doi:10.1109/42.932742 · Cited by 636
Evaluation of Registration Methods on Thoracic CT: The EMPIRE10 Challenge
Murphy, K., van Ginneken, B., Reinhardt, J. M., Kabus, S., Ding, K., Deng, X., Cao, K., Du, K., Christensen, G. E., Garcia, V., et al. (2011) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2011.2158349 · Cited by 440
Automated 3-D registration of MR and CT images of the head
Studholme, C., Hill, D. L. G., & Hawkes, D. J. (1996) · Medical Image Analysis · doi:10.1016/s1361-8415(96)80011-9 · Cited by 374
Rohlfing, T., & Maurer, C. R. (2003) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2003.808506 · Cited by 373
Self-citationComparison and evaluation of retrospective intermodality image registration techniques:
West, J. B., Fitzpatrick, J. M., Wang, M. Y., Dawant, B. M., Maurer, Jr., Kessler, R. M., Maciunas, R. J., Barillot, C., Lemoine, D., Collignon, A. M. F., et al. (1996) · SPIE Proceedings · doi:10.1117/12.237936 · Cited by 269
Schnabel, J. A., Tanner, C., Castellano-Smith, A. D., Degenhard, A., Leach, M. O., Hose, D. R., Hill, D. L. G., & Hawkes, D. J. (2003) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2002.808367 · Cited by 255
Retrospective evaluation of intersubject brain registration
Hellier, P., Barillot, C., Corouge, I., Gibaud, B., Le Goualher, G., Collins, D. L., Evans, A., Malandain, G., Ayache, N., Christensen, G. E., et al. (2003) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2003.816961 · Cited by 200
Factors influencing the accuracy of biomechanical breast models
Tanner, C., Schnabel, J. A., Hill, D., Hawkes, D. J., Leach, M. O., & Hose, D. R. (2006) · Medical Physics · doi:10.1118/1.2198315 · Cited by 127
Semi-automatic construction of reference standards for evaluation of image registration
Murphy, K., van Ginneken, B., Klein, S., Staring, M., de Hoop, B., Viergever, M. A., & Pluim, J. P. W. (2010) · Medical Image Analysis · doi:10.1016/j.media.2010.07.005 · Cited by 114
Enhanced brain extraction improves the accuracy of brain atrophy estimation
Battaglini, M., Smith, S. M., Brogi, S., & Stefano, N. D. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.10.067 · Cited by 64
Birkfellner, W., Stock, M., Figl, M., Gendrin, C., Hummel, J., Dong, S., Kettenbach, J., Georg, D., & Bergmann, H. (2009) · Medical Physics · doi:10.1118/1.3157111 · Cited by 44
Evaluating Image Registration Using NIREP
Song, J. H., Christensen, G. E., Hawley, J. A., Wei, Y., & Kuhl, J. G. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-14366-3_13 · Cited by 22
Cited by
Deformable medical image registration: a survey
Sotiras, A., Davatzikos, C., & Paragios, N. (2013) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2013.2265603 · Cited by 1,587
“…for image registration ( i.e. , Non-rigid Image Regis-tration Evaluation Project - NIREP [450]) and the increasing understanding regarding the use of surrogate measures for the measurement of the accuracy of registration [451] will further facilitate the comparison between different algorithms.”
BackgroundMachine learning for medical imaging: methodological failures and recommendations for the future
Varoquaux, G., & Cheplygina, V. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00592-y · Cited by 656
Deep MRI brain extraction: A 3D convolutional neural network for skull stripping
Kleesiek, J., Urban, G., Hubert, A., Schwarz, D., Maier-Hein, K., Bendszus, M., & Biller, A. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.01.024 · Cited by 505
A Hierarchical Fused Fuzzy Deep Neural Network for Data Classification
Deng, Y., Ren, Z., Kong, Y., Bao, F., & Dai, Q. (2017) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2016.2574915 · Cited by 396
A survey of medical image registration – under review
Viergever, M. A., Maintz, J. B. A., Klein, S., Murphy, K., Staring, M., & Pluim, J. P. W. (2016) · Medical Image Analysis · doi:10.1016/j.media.2016.06.030 · Cited by 318
Metadata
- Authors
- Rohlfing, T.
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2012-02
- Volume
- 31
- Issue
- 2
- Pages
- 153-163
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W2054902886
- Cited by
- 412
- References
- 28
- FWCI
- 16.91
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.