Data preparation for artificial intelligence in medical imaging: A comprehensive guide to open-access platforms and tools
Open accessThe DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
The vast amount of data produced by today's medical imaging systems has led medical professionals to turn to novel technologies in order to efficiently handle their data and exploit the rich information present in them. In this context, artificial intelligence (AI) is emerging as one of the most prominent solutions, promising to revolutionise every day clinical practice and medical research. The pillar supporting the development of reliable and robust AI algorithms is the appropriate preparation of the medical images to be used by the AI-driven solutions. Here, we provide a comprehensive guide for the necessary steps to prepare medical images prior to developing or applying AI algorithms. The main steps involved in a typical medical image preparation pipeline include: (i) image acquisition at clinical sites, (ii) image de-identification to remove personal information and protect patient privacy, (iii) data curation to control for image and associated information quality, (iv) image storage, and (v) image annotation. There exists a plethora of open access tools to perform each of the aforementioned tasks and are hereby reviewed. Furthermore, we detail medical image repositories covering different organs and diseases. Such repositories are constantly increasing and enriched with the advent of big data. Lastly, we offer directions for future work in this rapidly evolving field.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The FAIR Guiding Principles for scientific data management and stewardship
Wilkinson, M. D., Dumontier, M., Aalbersberg, I. J., Appleton, G., Axton, M., Baak, A., Blomberg, N., Boiten, J.-W., da Silva Santos, L. B., Bourne, P. E., et al. (2016) · Scientific Data · doi:10.1038/sdata.2016.18 · Cited by 18,423
Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215
A survey on Image Data Augmentation for Deep Learning
Shorten, C., & Khoshgoftaar, T. M. (2019) · Journal of Big Data · doi:10.1186/s40537-019-0197-0 · Cited by 13,203 · cited 1×
“…range from basic strategies using feasible geometric transformations, flipping, colour modification, cropping, rotation, noise injection and random erasing [106] to other more advanced techniques that involve the creation of new synthetic images, such as generative adversarial networks [50].”
BackgroundDropout as a bayesian approximation: Representing model uncertainty in deep learning
Gal, Y., & Ghahramani, Z. (2015) · arXiv · doi:10.48550/arxiv.1506.02142 · Cited by 6,471
The WU-Minn Human Connectome Project: An overview
Van Essen, D. C., Smith, S. M., Barch, D. M., Behrens, T. E. J., Yacoub, E., & Ugurbil, K. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.05.041 · Cited by 5,651
Wang, X., Peng, Y., Lu, L., Lu, Z., Bagheri, M., & Summers, R. M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.369 · Cited by 4,616
The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository
Clark, K., Vendt, B., Smith, K., Freymann, J., Kirby, J., Koppel, P., Moore, S., Phillips, S., Maffitt, D., Pringle, M., et al. (2013) · Journal of Digital Imaging · doi:10.1007/s10278-013-9622-7 · Cited by 4,599 · cited 1×
“One of the well-known resources is the TCIA data repository [81], which offers a variety of curated imaging collections for multiple organs specifically oriented towards cancer imaging.”
BackgroundSelf-citationSimple and Scalable Predictive Uncertainty Estimation using Deep Ensembles
Lakshminarayanan, B., Pritzel, A., & Blundell, C. (2016) · arXiv · doi:10.48550/arxiv.1612.01474 · Cited by 3,666
What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?
Kendall, A., & Gal, Y. (2017) · arXiv · doi:10.48550/arxiv.1703.04977 · Cited by 3,088 · cited 2×
“Kendall and Gal [114] have demonstrated two types of uncertainties in computer vision that are also applicable in medical image analysis: the epistemic uncertainty caused by lack of knowledge in the AI model (reduced training data) and the aleatoric uncertainty (inherent to the data such as acquisition artefacts, pati…”
BackgroundA practical Bayesian framework for backpropagation networks
MacKay, D. J. C. (1992) · Neural Computation · doi:10.1162/neco.1992.4.3.448 · Cited by 2,917 · cited 1×
“Uncertainty estimation in deep learning scenarios is often obtained by approximating Bayesian posterior using neural networks [115 – 117], although non Bayesian approaches have also been addressed [118].”
MethodGorgolewski, K. J., Auer, T., Calhoun, V. D., Craddock, R. C., Das, S., Duff, E. P., Flandin, G., Ghosh, S. S., Glatard, T., Halchenko, Y. O., et al. (2016) · Scientific Data · doi:10.1038/sdata.2016.44 · Cited by 1,775
Secure, privacy-preserving and federated machine learning in medical imaging
Kaissis, G. A., Makowski, M. R., Rückert, D., & Braren, R. F. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0186-1 · Cited by 1,676 · cited 1×
“Recently, new privacy-preserving approaches, known as Federated learning [49,107], have been promoted in clinical research for privacy-preserving AI and, somehow, to enrich the datasets used by the AI technology.”
BackgroundSheller, M. J., Edwards, B., Reina, G. A., Martin, J., Pati, S., Kotrotsou, A., Milchenko, M., Xu, W., Marcus, D., Colen, R. R., et al. (2020) · Scientific Reports · doi:10.1038/s41598-020-69250-1 · Cited by 1,646 · cited 1×
“Such novel paradigms should enable larger and more representative samples while also assisting in protection of patient privacy [108,109].”
BackgroundBakas, S., Reyes, M., Jakab, A., Bauer, S., Rempfler, M., Crimi, A., Shinohara, R. T., Berger, C., Ha, S. M., Rozycki, M., et al. (2018) · Apollo - University of Cambridge Repository · doi:10.17863/cam.38755 · Cited by 1,441
Self-citationBakas, S., Reyes, M., Jakab, A., Bauer, S., Rempfler, M., Crimi, A., Shinohara, R. T., Berger, C., Ha, S. M., Rozycki, M., et al. (2018) · arXiv · doi:10.48550/arxiv.1811.02629 · Cited by 1,441
Self-citationThe Liver Tumor Segmentation Benchmark (LiTS)
Bilic, P., Christ, P., Li, H. B., Vorontsov, E., Ben-Cohen, A., Kaissis, G., Szeskin, A., Jacobs, C., Mamani, G. E. H., Chartrand, G., et al. (2023) · Medical Image Analysis · doi:10.1016/j.media.2022.102680 · Cited by 1,412 · cited 1×
“Although listed in the Grand-Challenges, it is worth mentioning the medical image segmentation decathlon challenge that provides expert annotated images for ten different tasks: brain tumour (BraTS) [90], heart (LASC) [91], and liver (LiTS) [92] compiled from previous MICCAI challenges and TCIA databases; and brain hi…”
BackgroundThe Liver Tumor Segmentation Benchmark (LiTS)
Bilic, P., Christ, P., Li, H. B., Vorontsov, E., Ben-Cohen, A., Kaissis, G., Szeskin, A., Jacobs, C., Mamani, G. E. H., Chartrand, G., et al. (2019) · arXiv · doi:10.48550/arxiv.1901.04056 · Cited by 1,412
Video-based AI for beat-to-beat assessment of cardiac function
Ouyang, D., He, B., Ghorbani, A., Yuan, N., Ebinger, J., Langlotz, C. P., Heidenreich, P. A., Harrington, R. A., Liang, D. H., Ashley, E. A., et al. (2020) · Nature · doi:10.1038/s41586-020-2145-8 · Cited by 1,153 · cited 1×
“EchoNet-Dynamic is another resource with over 10 K echocardiography videos with corresponding labelled clinical measurements and human expert annotations [86].”
MethodThe first step for neuroimaging data analysis: DICOM to NIfTI conversion
Li, X., Morgan, P. S., Ashburner, J., Smith, J., & Rorden, C. (2016) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2016.03.001 · Cited by 1,073
Deep learning algorithms for detection of critical findings in head CT scans: a retrospective study
Chilamkurthy, S., Ghosh, R., Tanamala, S., Biviji, M., Campeau, N. G., Venugopal, V. K., Mahajan, V., Rao, P., & Warier, P. (2018) · The Lancet · doi:10.1016/s0140-6736(18)31645-3 · Cited by 1,020 · cited 1×
“For example, large sets of neuroimaging datasets could be accessed from IDA, OASIS, NITRC, and CQ500 [83] repositories (see Table 5) that include imaging data for healthy young, adult, ageing, and patient data for various neurological disorders.”
BackgroundPreparing Medical Imaging Data for Machine Learning
Willemink, M. J., Koszek, W. A., Hardell, C., Wu, J., Fleischmann, D., Harvey, H., Folio, L. R., Summers, R. M., Rubin, D. L., & Lungren, M. P. (2020) · Radiology · doi:10.1148/radiol.2020192224 · Cited by 1,020
Medical students' attitude towards artificial intelligence: a multicentre survey
Pinto dos Santos, D., Giese, D., Brodehl, S., Chon, S. H., Staab, W., Kleinert, R., Maintz, D., & Baeßler, B. (2019) · European Radiology · doi:10.1007/s00330-018-5601-1 · Cited by 754
Larrazabal, A. J., Nieto, N., Peterson, V., Milone, D. H., & Ferrante, E. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1919012117 · Cited by 685 · cited 1×
“Routine clinical data collected by clinical sites can be deficient, biased (e.g. gender imbalance [111]), or prone to noise (e.g. presence of image artefacts [112]).”
BackgroundData Science: A Comprehensive Overview
Cao, L. (2018) · ACM Computing Surveys · doi:10.1145/3076253 · Cited by 407 · cited 1×
“The development of AI solutions that are reproducible as well as transferable to clinical practice will require access to large scale data for model training and optimisation [16 – 18] (otherwise known as big data, and also referred to as the ” oil ” of the 21st century [19]).”
BackgroundGeis, J. R., Brady, A. P., Wu, C. C., Spencer, J., Ranschaert, E., Jaremko, J. L., Langer, S. G., Borondy Kitts, A., Birch, J., Shields, W. F., et al. (2019) · Radiology · doi:10.1148/radiol.2019191586 · Cited by 388
Distributed deep learning networks among institutions for medical imaging
Chang, K., Balachandar, N., Lam, C., Yi, D., Brown, J., Beers, A., Rosen, B., Rubin, D. L., & Kalpathy-Cramer, J. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy017 · Cited by 340
Gong, B., Nugent, J. P., Guest, W., Parker, W., Chang, P. J., Khosa, F., & Nicolaou, S. (2019) · Academic Radiology · doi:10.1016/j.acra.2018.10.007 · Cited by 325
Identification of Anonymous MRI Research Participants with Face-Recognition Software
Schwarz, C. G., Kremers, W. K., Therneau, T. M., Sharp, R. R., Gunter, J. L., Vemuri, P., Arani, A., Spychalla, A. J., Kantarci, K., Knopman, D. S., et al. (2019) · New England Journal of Medicine · doi:10.1056/nejmc1908881 · Cited by 215 · cited 1×
“Schwarz et al. [32] showed that computer vision algorithms could be used to identify individuals from their cranial MRIs.”
BackgroundEthics of using and sharing clinical imaging data for artificial intelligence: a proposed framework
Larson, D. B., Magnus, D. C., Lungren, M. P., Shah, N. H., & Langlotz, C. P. (2020) · Radiology · doi:10.1148/radiol.2020192536 · Cited by 199 · cited 1×
“Apart from legal considerations, organisations and individuals responsible for the collection and distribution of such data are encouraged to also apply ethical reasoning [23] to ensure a morally solid decision-making process guiding their actions of sharing or using these sensible data resources.”
BackgroundFiber tract-oriented statistics for quantitative diffusion tensor MRI analysis
COROUGE, I., FLETCHER, P., JOSHI, S., GOUTTARD, S., & GERIG, G. (2006) · Medical Image Analysis · doi:10.1016/j.media.2006.07.003 · Cited by 177 · cited 1×
“This tool has been widely applied in many several areas such as cranio-facial pathologies and anatomical studies [73], carotid artery segmentation [74], diffusion MRI analysis [75], prenatal image analysis [76] and virtual reality in Medicine [77], among others.”
MethodDemystification of AI-driven medical image interpretation: past, present and future
Savadjiev, P., Chong, J., Dohan, A., Vakalopoulou, M., Reinhold, C., Paragios, N., & Gallix, B. (2019) · European Radiology · doi:10.1007/s00330-018-5674-x · Cited by 161
Geis, J. R., Brady, A. P., Wu, C. C., Spencer, J., Ranschaert, E., Jaremko, J. L., Langer, S. G., Kitts, A. B., Birch, J., Shields, W. F., et al. (2019) · Canadian Association of Radiologists Journal · doi:10.1016/j.carj.2019.08.010 · Cited by 140
Cited by
Artificial intelligence and machine learning for medical imaging: A technology review
Barragán-Montero, A., Javaid, U., Valdés, G., Nguyen, D., Desbordes, P., Macq, B., Willems, S., Vandewinckele, L., Holmström, M., Löfman, F., et al. (2021) · Physica Medica · doi:10.1016/j.ejmp.2021.04.016 · Cited by 450
Linardos, A., Kushibar, K., Walsh, S., Gkontra, P., & Lekadir, K. (2022) · Scientific Reports · doi:10.1038/s41598-022-07186-4 · Cited by 130
Self-citationImage annotation and curation in radiology: an overview for machine learning practitioners
Galbusera, F., & Cina, A. (2024) · European Radiology Experimental · doi:10.1186/s41747-023-00408-y · Cited by 62
Lekadir, K., Osuala, R., Gallin, C., Lazrak, N., Kushibar, K., Tsakou, G., Aussó, S., Alberich, L. C., Marias, K., Tsiknakis, M., et al. (2021) · arXiv · doi:10.48550/arxiv.2109.09658 · Cited by 58
Self-citationBelue, M. J., Harmon, S. A., Lay, N. S., Daryanani, A., Phelps, T. E., Choyke, P. L., & Turkbey, B. (2023) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2022.05.022 · Cited by 27
Metadata
- Authors
- Diaz, O., Kushibar, K., Osuala, R., Linardos, A., Garrucho, L., Igual, L., Radeva, P., Prior, F., Gkontra, P., & Lekadir, K.
- Venue
- Physica Medica
- Publisher
- Elsevier BV
- Published
- 2021-03
- Volume
- 83
- Pages
- 25-37
- ISSN
- 1120-1797 (ISSN-L)
- OpenAlex
- W3134656840
- Cited by
- 152
- References
- 32
- FWCI
- 5.10
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.