The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
ITK: enabling reproducible research and open science
Open accessAbstract
Reproducibility verification is essential to the practice of the scientific method. Researchers report their findings, which are strengthened as other independent groups in the scientific community share similar outcomes. In the many scientific fields where software has become a fundamental tool for capturing and analyzing data, this requirement of reproducibility implies that reliable and comprehensive software platforms and tools should be made available to the scientific community. The tools will empower them and the public to verify, through practice, the reproducibility of observations that are reported in the scientific literature. Medical image analysis is one of the fields in which the use of computational resources, both software and hardware, are an essential platform for performing experimental work. In this arena, the introduction of the Insight Toolkit (ITK) in 1999 has transformed the field and facilitates its progress by accelerating the rate at which algorithmic implementations are developed, tested, disseminated and improved. By building on the efficiency and quality of open source methodologies, ITK has provided the medical image community with an effective platform on which to build a daily workflow that incorporates the true scientific practices of reproducibility verification. This article describes the multiple tools, methodologies, and practices that the ITK community has adopted, refined, and followed during the past decade, in order to become one of the research communities with the most modern reproducibility verification infrastructure. For example, 207 contributors have created over 2400 unit tests that provide over 84% code line test coverage. The Insight Journal, an open publication journal associated with the toolkit, has seen over 360,000 publication downloads. The median normalized closeness centrality, a measure of knowledge flow, resulting from the distributed peer code review system was high, 0.46.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Centrality in social networks conceptual clarification
Freeman, L. C. (1978) · Social Networks · doi:10.1016/0378-8733(78)90021-7 · Cited by 17,062
Correspondence - Tranexamic acid for traumatic brain injury
(2005) · London School of Economics and Political Science Theses Online (London School of Economics and Political Science) · doi:10.1016/s0140-6736 · Cited by 11,894
3D Slicer as an image computing platform for the Quantitative Imaging Network
Fedorov, A., Beichel, R., Kalpathy-Cramer, J., Finet, J., Fillion-Robin, J.-C., Pujol, S., Bauer, C., Jennings, D., Fennessy, F., Sonka, M., et al. (2012) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2012.05.001 · Cited by 9,023
The Logic of Scientific Discovery
(2013) · A Realist Theory of Science · doi:10.4324/9780203090732-9 · Cited by 7,731
The Logic of Scientific Discovery.
Hutchison, T. W., & Popper, K. R. (1959) · Economica · doi:10.2307/2550489 · Cited by 7,499
Elastix: a toolbox for intensity-based medical image registration
Klein, S., Staring, M., Murphy, K., Viergever, M. A., & Pluim, J. (2010) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2009.2035616 · Cited by 4,311
(2020) · Radical Treatment · doi:10.2307/j.ctvw1d7dg.9 · Cited by 3,373
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979 · cited 3×
“The importance of restoring the practice of reproducibility verification in scientific research has resurged in recent years in light of worrisome findings of inconsistency, lack of quality and even fraud in what were otherwise considered to be high-quality publications (Begley and Ellis, 2012).”
ALEXANDER, P. (1963) · Philosophical Books · doi:10.1111/j.1468-0149.1963.tb00798.x · Cited by 2,854
A measure of betweenness centrality based on random walks
Newman, M. E. J. (2005) · Social Networks · doi:10.1016/j.socnet.2004.11.009 · Cited by 2,461
Cited by
3D bioprinting of tissues and organs for regenerative medicine
Vijayavenkataraman, S., Yan, W.-C., Lu, W. F., Wang, C.-H., & Fuh, J. Y. H. (2018) · Advanced Drug Delivery Reviews · doi:10.1016/j.addr.2018.07.004 · Cited by 630
SCT: Spinal Cord Toolbox, an open-source software for processing spinal cord MRI data
De Leener, B., Lévy, S., Dupont, S. M., Fonov, V. S., Stikov, N., Louis Collins, D., Callot, V., & Cohen-Adad, J. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2016.10.009 · Cited by 621
Large Deformation Diffeomorphic Image Registration with Laplacian Pyramid Networks
Mok, T. C. W., & Chung, A. C. S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-59716-0_21 · Cited by 283
Integrated intracellular organization and its variations in human iPS cells
Viana, M. P., Chen, J., Knijnenburg, T. A., Vasan, R., Yan, C., Arakaki, J. E., Bailey, M., Berry, B., Borensztejn, A., Brown, E. M., et al. (2023) · Nature · doi:10.1038/s41586-022-05563-7 · Cited by 132
Chen, J., Ding, L., Viana, M. P., Lee, H., Sluezwski, M. F., Morris, B., Hendershott, M. C., Yang, R., Mueller, I. A., & Rafelski, S. M. (2018) · doi:10.1101/491035 · Cited by 99
Metadata
- Authors
- McCormick, M., Liu, X., Jomier, J., Marion, C., & Ibanez, L.
- Venue
- Frontiers in Neuroinformatics
- Publisher
- Frontiers Media SA
- Published
- 2014
- Volume
- 8
- Pages
- 13-13
- ISSN
- 1662-5196 (ISSN-L)
- OpenAlex
- W2063815712
- Cited by
- 376
- References
- 39
- FWCI
- 12.24
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: ITK: enabling reproducible research and open science. https://app.cochat.ai/papers/10.3389/fninf.2014.00013
- The paper
- McCormick, M., Liu, X., Jomier, J., Marion, C., & Ibanez, L. (2014). ITK: enabling reproducible research and open science. Frontiers in Neuroinformatics. https://doi.org/10.3389/fninf.2014.00013
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.